Data Architect
We are seeking a skilled Data Architect to lead the design and implementation of our data processing systems. The ideal candidate will have extensive experience working with large datasets, cloud-based technologies, and serverless architectures.
Key Responsibilities:
* Design and implement scalable data processing systems using AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB.
* Develop data ingestion pipelines and integration processes to ensure seamless data transfer from various sources into the DataLake.
* Implement data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency.
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake.
* Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data.
* Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues.
* Continuously evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation.
* Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices.
* Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines.
Requirements:
* Extensive experience (5+ years) working as a Data Engineer, with a strong focus on AWS technologies and serverless architectures.
* Experience working as a Data Engineer, with focus on Azure is valuable.
* In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB, and their capabilities for building scalable data processing systems.
* Proven expertise in designing and implementing AWS serverless architectures for large-scale data processing and storage.
* Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying.
* Hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark, for transforming and processing data.
* English
* Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas.
* Solid understanding of data security, access control, and compliance requirements in a data-driven environment.
* Experience with data visualization tools (e.g., Tableau, Power BI) and the ability to collaborate with analysts and data scientists to deliver actionable insights.
* Strong problem-solving and analytical skills, with a detail-oriented approach to ensure data accuracy and integrity.
* Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
What We Offer:
* Professional development and constant evolution of your skills, always in line with your interests.
* Opportunities to work outside Brazil.
* A collaborative, diverse, and innovative environment that encourages teamwork.
* TCS Benefits – Brazil: Health insurance, Dental Plan, Life insurance, Transportation vouchers, Meal/Food Voucher, Childcare assistance, Gympass, TCS Cares, Partnership with SESC, Reimbursement of Certifications, Free TCS Learning Portal, International experience opportunity, Discount Partnership with Universities and Language Schools, Bring Your Buddy, TCS Gems, Xcelerate.
TATA Consultancy Services promotes an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer
Keywords: Data Lake, AWS, Spark, Python
],