Job Overview
The Senior Data Engineer will be responsible for building and managing data pipelines to meet business requirements. The role involves creating, maintaining, and optimizing data structures that encompass data modeling, transformation, schemas, metadata, and workload management.
Main Responsibilities:
* Create and manage data pipelines using various technologies.
* Drive automation through effective metadata management strategies.
* Ensure compliance and governance during data use, including data catalog maintenance.
* Collaborate with stakeholders on data-related topics.
Main Requirements:
* Strong experience in data management architectures, preferably in an AWS environment.
* Proficiency in data modeling techniques.
* Ability to design, build, and manage complex data pipelines.
* Familiarity with commercial and open-source message queuing technologies.