Senior Data Engineering Specialist
We are seeking a highly skilled Senior Data Engineering Specialist to join our team. This key role will focus on designing, developing, and maintaining scalable data processing pipelines using Azure Data Services.
* Develop high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks.
* Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver reliable datasets.
* Optimize data workflows/pipelines for performance and cost efficiency in a cloud environment.
Required Skills:
* Experience with columnar storage formats (Parquet, Delta, Hudi, Iceberg).
* Proficiency in using Data Quality tools (Great Expectations, Soda).
* Knowledge of serverless architecture concepts.
What We Offer:
* Professional growth opportunities.
* International collaboration possibilities.
* A dynamic work environment that encourages teamwork and innovation.