Key Roles and Responsibilities
Tata Consultancy Services is looking for a Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows.
* Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows;
* Develop data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake;
* Implement data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency;
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake;