Job Opportunity
We seek a skilled professional to fill the role of Data Engineer. The ideal candidate will have a passion for learning and a desire to transform their career.
Key Responsibilities:
* Data Engineering Design: Develop and implement an efficient Serverless DataLake architecture on AWS, capable of handling large volumes of data and supporting various data processing workflows;
* Data Ingestion Pipelines: Create reliable data ingestion pipelines and integration processes, ensuring seamless transfer of data from diverse sources into the DataLake;
* Data Transformation & Enrichment: Utilize AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency by implementing data transformation and enrichment processes;
* Collaboration & Data Modeling: Work closely with data scientists and analysts to comprehend their data requirements and design suitable data models and schemas in the DataLake;
* Optimized Data Storage & Retrieval: Leverage AWS services such as S3, Athena, Redshift, or DynamoDB to provide high-performance access to data, optimizing storage and retrieval mechanisms;
* Infrastructure Monitoring & Troubleshooting: Continuously monitor and troubleshoot the DataLake infrastructure, identifying performance bottlenecks, data processing errors, and other issues;
* Technology Evaluation & Innovation: Regularly evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation;
* Mentorship & Technical Guidance: Provide technical guidance and mentor junior data engineers, fostering their growth and ensuring adherence to best practices;
* Team Collaboration & Task Prioritization: Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines