Job Title: Data Engineer
We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for designing and implementing efficient data processing workflows, developing data ingestion pipelines, and collaborating with cross-functional teams to deliver high-quality solutions.
About the Role
* Design and implement an AWS Serverless DataLake architecture: You will design and develop a scalable and secure data processing infrastructure using AWS services such as S3, Athena, Redshift, or DynamoDB.
* Develop data ingestion pipelines and data integration processes: You will develop robust data ingestion pipelines and data integration processes to ensure seamless data transfer from various sources into the DataLake.
* Implement data transformation and enrichment processes: You will use AWS Lambda, Glue, or similar serverless technologies to transform and enrich data, ensuring data quality and consistency.
* Collaborate with data scientists and analysts: You will work closely with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake.
* Optimize data storage and retrieval mechanisms: You will leverage AWS services to optimize data storage and retrieval mechanisms, providing high-performance access to the data.
* Maintain and troubleshoot the DataLake infrastructure: You will continuously monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues.
* Evaluate new AWS services and technologies: You will stay up-to-date with new AWS services and technologies, evaluating their potential to enhance the DataLake architecture, improve data processing efficiency, and drive innovation.
* Mentor junior engineers: You will mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices.
Requirements
* Bachelor's degree in Computer Science, Information Technology, or related field
* 5+ years of experience in data engineering or a related field
* Strong understanding of AWS services and technologies, including S3, Athena, Redshift, and DynamoDB
* Experience with data ingestion pipelines, data integration processes, and data transformation
* Excellent communication and collaboration skills
* Ability to work in a fast-paced environment and adapt to changing priorities
Benefits
We offer a competitive salary, comprehensive benefits package, and opportunities for professional growth and development.
How to Apply
If you are a motivated and experienced data engineer looking for a new challenge, please submit your resume and cover letter.