Job Title: Data Engineer
Come and transform your career in one of the world's leading IT services companies.
We live a culture of unlimited learning, full of opportunities for growth and development. Our collaborative environment empowers you to expand your ideas through the right tools, contributing to our success.
We are looking for an experienced Data Engineer who wants to learn and grow with us. In this role, you will:
1. Work on extensive experience (5+ years) as a Data Engineer, with a strong focus on AWS technologies and serverless architectures;
2. Have experience working as a Data Engineer, with a focus on Azure being valuable;
3. Have in-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB, and their capabilities for building scalable data processing systems;
4. Design and implement AWS serverless architectures for large-scale data processing and storage;
5. Develop strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying;
6. Have hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark, for transforming and processing data;
7. Be familiar with data modeling techniques and data warehousing concepts, including star and snowflake schemas;
8. Have a solid understanding of data security, access control, and compliance requirements in a data-driven environment;
9. Have experience with data visualization tools (e.g., Tableau, Power BI) and collaborate with analysts and data scientists to deliver actionable insights;
10. Possess strong problem-solving and analytical skills, with a detail-oriented approach to ensure data accuracy and integrity;
11. Excel in communication and collaboration, with the ability to work effectively in a cross-functional team environment.
Key responsibilities include:
1. Designing and implementing an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows;
2. Developing data ingestion pipelines and data integration processes, ensuring smooth and reliable transfer of data from various sources into the DataLake;
3. Implementing data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency;
4. Collaborating with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake;
5. Optimizing data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data;
6. Monitoring and troubleshooting the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues;
7. Continuously evaluating new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation;
8. Mentoring and providing technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices;
9. Collaborating with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines.
What can you expect from us?
* Professional development and constant evolution of your skills, always aligned with your interests;
* Opportunities to work outside Brazil;
* A collaborative, diverse, and innovative environment that encourages teamwork.
Benefits
* Health insurance;
* Dental plan;
* Life insurance;
* Transportation vouchers;
* Meal/food voucher;
* Childcare assistance;
* Gympass;
* TCS Cares - free 0800 providing psychological assistance, legal, social, and financial assistance;
* Partnership with SESC;
* Reimbursement of certifications;
* Free TCS Learning Portal - online courses and live training;
* International experience opportunity;
* Discount partnership with universities and language schools;
* Bring Your Buddy - refer people to get a bonus for each hire;
* TCS Gems - recognition for performance;
* Xcelerate - free mentoring career platform.
Join our inclusive culture where we value individuality and promote equity. We strive to build a workplace that respects diversity and promotes social responsibility. Come and be part of our team!