Job Overview
We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for designing and implementing an AWS Serverless DataLake architecture, developing data ingestion pipelines, and collaborating with cross-functional teams.
Key Responsibilities:
* Design and implement scalable data processing workflows utilizing AWS services such as S3, Athena, and Redshift;
* Develop and maintain efficient data integration processes to ensure seamless data transfer from various sources into the DataLake;
* Collaborate with data scientists and analysts to design and implement effective data models and schemas in the DataLake;
* Optimize data storage and retrieval mechanisms to provide high-performance access to the data;
* Monitor and troubleshoot the DataLake infrastructure to identify and resolve performance bottlenecks and errors;
* Continuously evaluate new technologies and innovations to enhance the DataLake architecture and improve data processing efficiency;
* Mentor and provide technical guidance to junior data engineers to foster their growth and adherence to best practices.
Requirements:
* Proven experience in designing and implementing cloud-based data architectures;
* Proficiency in programming languages such as Python, Java, or C++;
* Strong understanding of data modeling and schema design principles;
* Excellent problem-solving skills and attention to detail;
* Ability to work collaboratively in a fast-paced environment.
Benefits:
* Opportunity to work with cutting-edge technologies and innovations;
* Chance to collaborate with experienced professionals in the field;
* Competitive salary and benefits package;
* Professional development opportunities and training.
What We Offer:
* A dynamic and supportive work environment;
* Flexible working arrangements and remote work options;
* Access to cutting-edge tools and technologies;
* Opportunities for career growth and advancement.