Data Engineer Role Description:
We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have extensive experience in designing and implementing large-scale data processing systems using AWS technologies.
The successful candidate will possess in-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB. They will also have strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying.
A key responsibility of the role will be to design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows. This includes developing data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake.
Benefits:
* Professional development and constant evolution of your skills
* Opportunities to work outside Brazil
* A collaborative, diverse, and innovative environment that encourages teamwork
What do we offer?
* Health insurance
* Dental Plan
* Life insurance
* Transportation vouchers
* Meal/Food Voucher
* Childcare assistance
* Gympass
* TCS Cares – free psychological assistance
* Reimbursement of Certifications
* Free TCS Learning Portal – Online courses and live training
* International experience opportunity
* Discount Partnership with Universities and Language Schools
Key Responsibilities:
* Design and implement an AWS Serverless DataLake architecture
* Develop data ingestion pipelines and data integration processes
* Implement data transformation and data enrichment processes
* Collaborate with data scientists and analysts to understand their data requirements
* Optimize data storage and retrieval mechanisms
* Monitor and troubleshoot the DataLake infrastructure
Required Skills and Qualifications:
* Extensive experience working as a Data Engineer (5+ years)
* In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB
* Strong programming skills in languages like Python, Java, or Scala
* Experience using SQL for data manipulation and querying
* Familiarity with data modeling techniques and data warehousing concepts
* Solid understanding of data security, access control, and compliance requirements
Keyword: DataEngineer