Senior Data Engineer
Transform your career with a leading IT services company.
We believe that people make the difference, so we live a culture of unlimited learning, full of opportunities for improvement and mutual development. Our ideal scenario is to expand ideas through the right tools, contributing to our success in a collaborative environment.
Our team is looking for a senior data engineer who wants to learn and transform their career.
Responsibilities:
* Design and implement a scalable data architecture to efficiently handle large volumes of data and support various data processing workflows;
* Develop data ingestion pipelines and integration processes, ensuring the smooth and reliable transfer of data from various sources into the data lake;
* Implement data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency;
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the data lake;
* Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data;
* Monitor and troubleshoot the data infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues;
* Continuously evaluate new AWS services and technologies to enhance the data architecture, improve data processing efficiency, and drive innovation;
* Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices;
* Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines;
Required Skills and Qualifications:
* Strong experience with AWS services, including Lambda, Glue, S3, Athena, Redshift, and DynamoDB;
* Excellent understanding of data engineering principles, including data ingestion, transformation, and storage;
* Ability to collaborate with data scientists and analysts to design and implement data solutions;
* Strong communication and problem-solving skills, with ability to work effectively in a team environment;
* Proficiency in programming languages, including Python and SQL;
Benefits:
* Professional development opportunities, including training and certification programs;
* Opportunities to work outside Brazil and contribute to global projects;
* Collaborative, diverse, and innovative work environment that encourages teamwork and creativity;
* Health insurance, dental plan, life insurance, transportation vouchers, meal/voucher, childcare assistance, gym pass, TCS Cares, partnership with SESC, reimbursement of certifications, free TCS Learning Portal, international experience opportunity, discount partnership with universities and language schools, Bring Your Buddy, TCS Gems, Xcelerate, and more;