About the Role
Our organization seeks a skilled Data Engineer to spearhead the design and implementation of an AWS Serverless DataLake architecture.
This individual will be responsible for developing data ingestion pipelines, integrating data from various sources into the DataLake, and ensuring seamless data processing workflows.
We are looking for someone who can implement data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies to guarantee data quality and consistency.
In collaboration with data scientists and analysts, this professional will design appropriate data models and schemas in the DataLake, optimizing data storage and retrieval mechanisms to provide high-performance access to the data.
The ideal candidate will also be responsible for monitoring and troubleshooting the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues.
Furthermore, this person will continually evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation.
This role offers opportunities for growth and development, as well as mentorship and technical guidance to junior data engineers.
* Design and implement an AWS Serverless DataLake architecture.
* Develop data ingestion pipelines and data integration processes.
* Implement data transformation and data enrichment processes.
* Collaborate with data scientists and analysts to design data models and schemas.
* Optimize data storage and retrieval mechanisms.
* Mstrument and troubleshoot the DataLake infrastructure.
* Evaluate new AWS services and technologies.
* Mentor and provide technical guidance to junior data engineers.
As a key member of our team, you will have the opportunity to work collaboratively with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines.