At TCS, we're seeking an experienced Data Engineer to join our team. In this role, you'll be responsible for designing and implementing scalable data processing systems using AWS technologies.
You'll work with large datasets, leveraging services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB. Proficiency in programming languages like Python, Java, or Scala is required, along with experience in SQL for data manipulation and querying.
Familiarity with data modeling techniques and data warehousing concepts is essential, including star and snowflake schemas. You should also have a solid understanding of data security, access control, and compliance requirements in a data-driven environment.
A strong problem-solving and analytical mindset, combined with excellent communication and collaboration skills, will help you succeed in this role.
Key Responsibilities:
* Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data.
* Develop data ingestion pipelines and data integration processes to ensure smooth and reliable data transfer into the DataLake.
* Implement data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies.
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas.
* Optimize data storage and retrieval mechanisms using AWS services such as S3, Athena, Redshift, or DynamoDB.
* Monitor and troubleshoot the DataLake infrastructure to identify performance bottlenecks and resolve issues.
Benefits:
* Professional development opportunities, focusing on your interests and growth.
* The chance to work outside Brazil, expanding your global perspective.
* A collaborative and innovative environment that encourages teamwork and diversity.
About Us:
We promote an inclusive culture at TCS, valuing individuality and social responsibility. Our commitment to equity extends to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity, and more. Join us in building a better future!