Are you a data professional looking to make a career shift? Do you want to work with cutting-edge technologies and be part of a collaborative team?
We are seeking an experienced Data Engineer who can design, implement and maintain large-scale data processing systems using AWS technologies.
About the Role
This is a unique opportunity to join our team as a Data Engineer and take your career to the next level. As a key member of our team, you will be responsible for designing and implementing scalable data processing systems, working closely with cross-functional teams to deliver high-quality solutions.
Responsibilities
1. Design and implement AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows;
2. Develop data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake;
3. Implement data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency;
4. Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake;
5. Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data;
6. Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues;
7. Continuously evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation;
8. Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices;
9. Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines;
Requirements
* 5+ years of experience working as a Data Engineer with a strong focus on AWS technologies and serverless architectures;
* Experience working with data integration and ETL tools, such as AWS Glue or Apache Spark;
* Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying;
* In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB;
* Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas;
* Solid understanding of data security, access control, and compliance requirements in a data-driven environment;
* Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment;
Benefits
* Professional development and constant evolution of your skills;
* Opportunities to work outside Brazil;
* A collaborative, diverse and innovative environment that encourages teamwork;
* TCS Benefits – Brazil: health insurance, dental plan, life insurance, transportation vouchers, meal/food voucher, childcare assistance, Gympass, TCS Cares – free psychological assistance (24 hrs/day), legal, social and financial assistance, partnership with SESC, reimbursement of certifications, free TCS Learning Portal – online courses and live training, international experience opportunity, discount partnership with universities and language schools, bring your buddy, TCS gems, Xcelerate – free mentoring career platform;
Join Our Team
We believe that people make the difference, and we strive to create an inclusive culture that respects individuality. If you are passionate about data engineering and want to be part of a dynamic team, apply now!