Job Opportunity
We are seeking a Data Engineering professional to lead the design and implementation of large-scale data processing architectures.
Main Responsibilities:
* Data Architecture
Design, develop, and maintain high-performance data processing systems using AWS serverless technologies such as Lambda, Glue, and S3. Ensure efficient data storage, retrieval, and processing for various business workflows.
* Data Ingestion and Integration
Develop robust data ingestion pipelines and integration processes to collect, transform, and load data from diverse sources into our central data repository.
* Data Transformation and Enrichment
Implement data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality, consistency, and accuracy.
* Collaboration and Mentorship
Work closely with data scientists, analysts, and other stakeholders to understand their data requirements, design optimal data models, and provide technical guidance to junior team members.
* Infrastructure Monitoring and Optimization
Monitor and troubleshoot the data infrastructure, identifying performance bottlenecks, data processing errors, and other issues to ensure high-quality data delivery.
* Technological Innovation
Stay up-to-date with the latest AWS services and technologies, evaluating new tools and methodologies to enhance data processing efficiency, drive innovation, and improve overall system performance.