Lead Data Engineer
As a Lead Data Engineer, you will play a crucial role in driving our company's data strategy forward. You will design and implement scalable data processing systems, ensuring that we have the tools and infrastructure needed to support our business goals.
The ideal candidate will have extensive experience working as a Data Engineer, with a strong focus on AWS technologies and serverless architectures. They will also have hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark, for transforming and processing data.
Responsibilities:
* Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows;
* Develop data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake;
* Implement data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency;
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake;
* Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data;
* Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues;
* Continuously evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation;
Benefits:
* Professional development and constant evolution of your skills, always in line with your interests;
* Opportunities to work outside Brazil;
* A collaborative, diverse and innovative environment that encourages teamwork;
* TCS Benefits – Brazil: health insurance, dental plan, life insurance, transportation vouchers, meal/food voucher, childcare assistance, Gympass, TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates, partnership with SESC, reimbursement of certifications, free TCS Learning Portal – Online courses and live training, international experience opportunity, discount partnership with universities and language schools, bring your buddy – by referring people you become eligible to receive a bonus for each hire, TCS Gems – recognition for performance, Xcelerate – free mentoring career platform;
What We Offer:
At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to gender, people with disabilities, LGBTQIA+, religion, race, ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a part of our team and contribute to our mission.