Job Opportunity
We are seeking an experienced data professional to fill the role of Data Architect. The ideal candidate will have expertise in designing and implementing scalable ETL/ELT pipelines using Azure Data Services.
The key responsibilities of this position include:
* Building high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks.
* Collaborating with data scientists, analysts, and business stakeholders to understand data requirements.
* Delivering clean, reliable datasets through optimization of data workflows/pipelines for performance and cost efficiency in a cloud environment.
This position requires a strong understanding of best practices around data security, governance, and compliance. Additionally, experience with CI/CD pipelines for data engineering workflows is highly desirable.