Job Title:
Data Architect Lead
Description:
* We are looking for a skilled professional to lead the development and implementation of our data architecture. This will involve designing and implementing scalable data processing systems using AWS technologies.
* The ideal candidate will have extensive experience working as a Data Engineer, with a strong focus on AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB.
* Proven expertise in designing and implementing AWS serverless architectures for large-scale data processing and storage is required.
* Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying, are essential.
* Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas, is also necessary.
Responsibilities:
* Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows.
* Develop data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake.
* Implement data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency.
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake.
* Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data.
* Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues.
* Continuously evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation.
* Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices.
Benefits:
* Professional development and constant evolution of your skills, always in line with your interests.
* Opportunities to work outside Brazil.
* A collaborative, diverse and innovative environment that encourages teamwork.
Requirements:
* 5+ years of experience working as a Data Engineer, with a strong focus on AWS technologies and serverless architectures.
* In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB.
* Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying.
* Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas.
What We Offer:
1. Health insurance
2. Dental Plan
3. Life insurance
4. Transportation vouchers
5. Meal/Food Voucher
6. Childcare assistance
7. Gympass
8. TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates
9. Partnership with SESC
10. Reimbursement of Certifications
11. Free TCS Learning Portal – Online courses and live training
12. International experience opportunity
13. Discount Partnership with Universities and Language Schools
14. Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire
15. TCS Gems – Recognition for performance
16. Xcelerate – Free Mentoring Career Platform