Cloud Data Engineer
We are looking for a seasoned data engineer with extensive experience in designing and implementing scalable data processing systems using cloud technologies. The ideal candidate will have a strong focus on AWS services, including S3, Lambda, Glue, Athena, Redshift, and DynamoDB.
The successful candidate will be responsible for developing and maintaining large-scale data processing architectures, working closely with cross-functional teams to ensure seamless integration with business requirements.
Responsibilities:
* Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data.
* Develop data ingestion pipelines and data integration processes to ensure the smooth transfer of data from various sources into the DataLake.
* Implement data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency.
* Collaborate with data scientists and analysts to design appropriate data models and schemas in the DataLake.
* Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data.
* Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues.
* Continuously evaluate new AWS services and technologies to enhance the DataLake architecture and drive innovation.
* Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices.
Benefits:
* Professional development and constant evolution of your skills, always in line with your interests.
* Opportunities to work outside Brazil.
* A collaborative, diverse, and innovative environment that encourages teamwork.
About Us:
We promote an inclusive culture, valuing diversity, equity, and social responsibility. We strive to build a workplace that respects individuality and fosters growth opportunities for all employees.