Data Engineer Role
We are seeking a seasoned Data Engineer to enhance our data engineering capabilities. As a senior member of our team, you will be responsible for designing and implementing scalable data processing systems using AWS technologies.
* Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data.
* Develop data ingestion pipelines and data integration processes using AWS Lambda and Glue.
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas.
In addition to technical skills, we value strong problem-solving and analytical skills, with a detail-oriented approach to ensure data accuracy and integrity. Excellent communication and collaboration skills are also essential for success in this role.
Key Responsibilities:
1. DataLake Architecture Design: Design and implement an AWS Serverless DataLake architecture.
2. Data Ingestion Pipelines: Develop data ingestion pipelines and data integration processes.
3. Collaboration: Collaborate with data scientists and analysts.
4. Data Storage Optimization: Optimize data storage and retrieval mechanisms.
5. Troubleshooting: Monitor and troubleshoot the DataLake infrastructure.
6. Technology Evaluation: Continuously evaluate new AWS services and technologies.
7. Mentorship: Mentor junior data engineers.
8. Cross-Functional Collaboration: Collaborate with cross-functional teams.