Join to apply for the Azure Data Engineer role at Decskill
Responsibilities
1. Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
2. Implement and manage data storage solutions using Azure Data Lake Storage (ADLS) Gen 2.
3. Design, develop, and maintain data pipelines using Azure Synapse Analytics.
4. Utilize Azure Stream Analytics for real-time data processing and analytics.
5. Ensure data quality and integrity through effective data governance practices.
6. Implement CI/CD pipelines using Azure DevOps for automated build and deployment.
7. Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
8. Monitor and troubleshoot data pipelines to ensure optimal performance and reliability.
9. Stay up to date with the latest industry trends and best practices in data engineering and cloud technologies.
Requirements
1. Experience with Azure Functions for serverless computing.
2. Knowledge of Azure Logic Apps for workflow automation.
3. Experience with Azure Stream Analytics for real-time data processing.
4. Familiarity with Azure API Management (APIM) for managing APIs.
5. Understanding of Microsoft Purview for data governance and compliance.
6. Proficiency in PySpark for data processing and transformation over Spark or Azure Databricks.
7. Strong experience with Azure Data Factory (ADF) for data integration and ETL processes.
8. Strong experience with Azure Synapse Analytics for ETL processes.
9. Expertise in Azure Data Lake Storage (ADLS) Gen 2 for scalable data storage.
10. Experience with CI/CD practices and tools, particularly Azure DevOps.
11. Strong problem-solving skills and attention to detail.
12. Excellent communication and collaboration skills.
If you're interested in this job, please send your CV to ****** or with reference "AzureDataEngineer".
Decskill is committed to equality and non-discrimination in all our recruitment and promotion practices, regardless of age, gender, ethnicity, race, nationality or any other characteristic protected by law.
#J-18808-Ljbffr