At Decskill, we're seeking a skilled professional to join our team as an Azure Data Engineer.
About the Role
We're looking for a highly motivated and experienced individual to design, develop, and maintain data pipelines using Azure Data Factory (ADF), implement and manage data storage solutions using Azure Data Lake Storage (ADLS) Gen 2, and work on various other key projects.
Main Responsibilities
* Design and develop data pipelines using ADF and ADLS Gen 2.
* Implement real-time data processing and analytics using Azure Stream Analytics.
* Maintain data quality and integrity through effective data governance practices.
* Implement CI/CD pipelines using Azure DevOps for automated build and deployment.
* Collaborate with data analysts and other stakeholders to deliver solutions that meet business needs.
* Monitor and troubleshoot data pipelines to ensure optimal performance and reliability.
Requirements
* Experience with Azure Functions for serverless computing.
* Knowledge of Azure Logic Apps for workflow automation.
* Experience with Azure Stream Analytics for real-time data processing.
* Familiarity with Azure API Management (APIM) for managing APIs.
* Understanding of Microsoft Purview for data governance and compliance.
* Proficiency in PySpark for data processing and transformation over either Spark.
* Strong experience with Azure Data Factory (ADF) for data integration and ETL processes.
* Strong experience of Azure Synapse Analytics for ETL processes.
* Expertise in Azure Data Lake Storage (ADLS) Gen 2 for scalable data storage.
What We Offer
We provide a dynamic and supportive work environment that encourages growth and development. Our ideal candidate will have strong problem-solving skills, excellent communication and collaboration skills, and be passionate about staying up-to-date with industry trends and best practices.
If you're interested in this role, please send your CV to the relevant contact person or use the provided reference.