Azure Data Engineer Role
We are looking for a highly skilled data engineer to join our team. In this role, you will design, develop, and maintain scalable data pipelines using Azure Data Services.
* You will build high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks.
* Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
The ideal candidate will have experience with columnar and table formats such as Parquet, Delta, Hudi, Iceberg, and use of Data Quality tools like Great Expectations and Soda. Additionally, knowledge of Step Functions, EventBridge, or Kinesis is beneficial.
This role requires strong communication and teamwork skills, as well as the ability to handle agile environments and rapid changes.