Azure Data Engineer Role
To drive data-driven decision making, design scalable ETL/ELT pipelines using Azure Data Services.
* Built high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks.
* Collaborated with data analysts and business stakeholders to understand data requirements and deliver clean, reliable datasets.
* Optimized data workflows/pipelines for performance and cost efficiency in a cloud environment.
Main Responsibilities:
* Implement best practices around data security, governance, and compliance.
* Develop automated pipelines for data engineering workflows.
* Monitor, troubleshoot, and enhance existing data solutions for reliability and performance.