Unlock your potential as a Data Engineering expert in Azure.
About the Role:
We're seeking an experienced data professional to design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Services. This role requires collaboration with cross-functional teams to implement CI/CD pipelines for data engineering workflows and monitor, troubleshoot, and enhance existing data solutions for reliability and performance.
Key Responsibilities:
1. Design and develop scalable ETL/ELT pipelines using Azure Data Services.
2. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
3. Implement CI/CD pipelines for data engineering workflows and monitor, troubleshoot, and enhance existing data solutions for reliability and performance.
Requirements:
To succeed in this role, you'll need:
4. Expertise in Apache Spark (PySpark) on Azure Databricks and best practices around data security, governance, and compliance.
5. Familiarity with cloud-based data platforms and services.
6. Strong analytical and problem-solving skills.
7. Excellent communication and collaboration skills.
Benefits:
This role offers:
8. A competitive salary and benefits package.
9. The opportunity to work with a talented team of professionals.
10. Professional development and growth opportunities.
About Us:
We're a leading provider of innovative data solutions. Our team is passionate about delivering exceptional results and making a positive impact.