Job Title:
Data Engineering Specialist
About the Role:
We are seeking an experienced Data Engineer to design, develop, and maintain data pipelines using Azure Data Factory (ADF), implement and manage data storage solutions using Azure Data Lake Storage (ADLS) Gen 2, and collaborate with data analysts to understand data requirements and deliver solutions that meet business needs.
This is a challenging opportunity for professionals who enjoy working with cloud technologies and want to be part of a team that fosters innovation and growth.
Main Responsibilities:
* Design, develop, and maintain data pipelines using Azure Data Factory (ADF)
* Implement and manage data storage solutions using Azure Data Lake Storage (ADLS) Gen 2
* Collaborate with data analysts to understand data requirements and deliver solutions that meet business needs
Required Skills and Qualifications:
* Experience with Azure Functions for serverless computing
* Knowledge of Azure Logic Apps for workflow automation
* Experience with Azure Stream Analytics for real-time data processing
* Familiarity with Azure API Management (APIM) for managing APIs
* Understanding of Microsoft Purview for data governance and compliance
* Proficiency in PySpark for data processing and transformation
* Strong experience with Azure Data Factory (ADF) for data integration and ETL processes
* Strong experience of Azure Synapse Analytics for ETL processes
* Expertise in Azure Data Lake Storage (ADLS) Gen 2 for scalable data storage
* Experience with CI/CD practices and tools, particularly Azure DevOps
* Strong problem-solving skills and attention to detail
* Excellent communication and collaboration skills
Benefits:
* A competitive salary and benefits package
* The opportunity to work on exciting projects and collaborate with talented individuals
* Continuous learning and professional development opportunities
Others:
We are committed to equality and non-discrimination in our hiring practices and welcome applications from diverse candidates.