Azure Data Engineer Role Overview
This position entails designing, developing, and maintaining scalable data pipelines using Azure Data Services. A strong background in data processing with Apache Spark on Azure Databricks is also required.
* Design and implement ETL/ELT pipelines using Azure Data Services.
* Collaborate with data scientists, analysts, and stakeholders to deliver high-quality datasets.
* Develop high-performance data processing solutions with Apache Spark on Azure Databricks.
As a senior-level professional, you will implement best practices for data security, governance, and compliance. Developing CI/CD pipelines for data engineering workflows and monitoring existing solutions for reliability and performance are also key responsibilities.
The ideal candidate has expertise in:
* Data pipeline design and implementation.
* Data processing with Apache Spark on Azure Databricks.
* Cloud-based data storage and management.
This role offers the opportunity to work on diverse projects, collaborate with a team of experts, and continuously learn and grow in the field of data engineering.