Job Overview
We are seeking a skilled Data Engineer to design and implement efficient data processing workflows using AWS technologies.
Key Responsibilities:
* Design and develop an AWS Serverless DataLake architecture to handle large volumes of data.
* Develop data ingestion pipelines and integration processes for smooth and reliable data transfer.
* Implement data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies.
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas.
* Optimize data storage and retrieval mechanisms leveraging AWS services like S3, Athena, Redshift, or DynamoDB.
* Monitor and troubleshoot the DataLake infrastructure identifying performance bottlenecks, data processing errors, and other issues.
* Continuously evaluate new AWS services and technologies to enhance the DataLake architecture and improve data processing efficiency.
* Provide technical guidance and mentor junior data engineers fostering their growth and adherence to best practices.
Requirements and Qualifications:
* Extensive experience working as a Data Engineer with expertise in AWS technologies and serverless architectures.
* Strong understanding of data processing workflows, data ingestion, and data integration.
* Proficiency in developing data transformation and enrichment processes using AWS Lambda, Glue, or similar technologies.
* Excellent collaboration and communication skills to work effectively with cross-functional teams.
* Ability to continuously evaluate new AWS services and technologies to enhance the DataLake architecture.
Benefits:
As a member of our team you will have opportunities for professional growth, mentoring, and continuous learning.
Other Information:
Please note that we value diversity and inclusion in the workplace.