Design and Maintain Scalable Data Pipelines
As a Senior Data Engineer, you will be responsible for designing and maintaining scalable data pipelines on AWS. Your primary goal will be to ensure performance, quality, and security of the pipelines.
Key Responsibilities:
* Develop ETL pipelines with AWS Glue to efficiently extract, transform, and load data from various sources.
* Collaborate with data scientists and analysts to integrate data from multiple sources and support AI/ML initiatives.
* Work closely with cross-functional teams to implement data governance, documentation, and best practices.
Requirements:
* Proven experience in data engineering with AWS.
* Strong proficiency in Python and SQL programming languages.
* Experience with ETL, data modeling, and pipeline optimization techniques.
* Excellent communication and collaboration skills.
Avenue Code is committed to protecting candidate data and adhering to global data protection laws.