Data Engineer
Come to a world-class IT Services company where you can transform your career.
We believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.
Here are some of the responsibilities of this role:
* Extensive experience (5+ years) working as a Data Engineer, with a strong focus on AWS technologies and serverless architectures;
* Experience working as a Data Engineer, with focus on Azure is valuable;
* In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB, and their capabilities for building scalable data processing systems;
* Proven expertise in designing and implementing AWS serverless architectures for large-scale data processing and storage;
* Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying;
* Hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark, for transforming and processing data;
* English
* Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas;
* Solid understanding of data security, access control, and compliance requirements in a data-driven environment;
* Experience with data visualization tools (e.g., Tableau, Power BI) and the ability to collaborate with analysts and data scientists to deliver actionable insights;
* Strong problem-solving and analytical skills, with a detail-oriented approach to ensure data accuracy and integrity;
* Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment
Key responsibilities include:
1.Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows;
2.Develop data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake;
3.Implement data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency;
4.Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake;
5.Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data;
6.Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues;
7.Continuously evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation;
8.Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices;
9.Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines
Required Skills:
* Proficiency in one or more of the following languages: Python, Java, Scala;
* Strong knowledge of AWS services, including S3, Lambda, Glue, Athena, Redshift, and DynamoDB;
* Experience with data integration and ETL tools, such as AWS Glue or Apache Spark;
* Knowledge of data modeling techniques and data warehousing concepts;
* Understanding of data security, access control, and compliance requirements;
* Experience with data visualization tools, such as Tableau or Power BI;
* Excellent communication and collaboration skills
Benefits:
* Professional development and constant evolution of your skills;
* Opportunities to work outside Brazil;
* A collaborative, diverse, and innovative environment;
* Health insurance;
* Dental Plan;
* Life insurance;
* Transportation vouchers;
* Meal/Food Voucher;
* Childcare assistance;
* Gympass;
* TCS Cares - free psychological assistance;
* Reimbursement of certifications;
* Free TCS Learning Portal - online courses and live training;
* International experience opportunity;
* Discount partnership with universities and language schools;
* Bring Your Buddy - referral program
What do we offer?
The ideal candidate will have a strong passion for technology and a willingness to learn and grow with our company.
],