Type: Contract
Role Summary
We are looking for a Developer Senior Developer Data Engineer to build and operate scalable data pipelines and curated datasets that enable Digital and Customer Experience Applications across a global FMCG enterprise. You will work hands on with Python, PySpark, Databricks and SQL, contribute to modern engineering practices using Git-based workflows and CICD, and support end-to-end delivery through Azure DevOps.
Key Responsibilities
* Design, develop and optimize ETLELT pipelines using Databricks PySpark to ingest, transform and serve data for digital customer experience use cases.
* Build and maintain high quality, performant SQL transformations and dimensional curated data layers for analytics and downstream consumption.
* Implement best practices for Databricks engineering notebooks, repos, modular code, cluster job configuration, performance tuning and cost awareness.
* Use Python for data processing, utilities, validations, orchestration helpers and reusable libraries.
* Manage source control using Git with enterprise workflows across GitHub and Bitbucket; enforce PR reviews, branching strategies and coding standards.
* Build and maintain CICD pipelines using Azure DevOps automating testing, packaging and deployment of data code artifacts across environments.
* Ensure data quality and reliability through validations, reconciliation checks, monitoring and operational runbooks.
* Collaborate with product, app teams, analysts and platform teams to translate requirements into scalable data products aligned to customer experience journeys.
* For Senior Developer: lead module-level design, mentor engineers, drive standards for CICD and code quality and own delivery for critical pipelines.
Primary Skills Must Have
* Strong hands‐on experience with Python, PySpark, Databricks jobs, workflows, clusters, repos.
* SQL advanced querying, optimization.
* Strong experience with Git and repository platforms GitHub or Bitbucket.
* Hands‐on experience implementing CICD for data engineering workloads.
* Strong working experience with Azure DevOps Boards, Repos, Pipelines, build, release workflows.
Secondary Skills Good-to-Have
* Azure Data Factory (ADF) for orchestration, ingestion and scheduling patterns.
* Power BI experience for consumption layer, understanding datasets, measures, refresh patterns, supporting analytics enablement.
#J-18808-Ljbffr