Senior Data Engineer
We are looking for a Senior Developer Data Engineer to build and operate scalable data pipelines and curated datasets that enable Digital and Customer Experience Applications across a global FMCG enterprise. You will work hands on with Python, PySpark, Databricks and SQL contribute to modern engineering practices using Gitbased workflows and CI/CD to support end to end delivery through Azure DevOps.
Responsibilities
* Design, develop and optimize ETL ELT pipelines using Databricks, PySpark to ingest, transform and serve data for digital customer experience.
* Build and maintain highquality performant SQL transformations and dimensional curated data layers for analytics and downstream consumption.
* Implement best practices for Databricks engineering notebooks vs repos modular code cluster job configuration, performance tuning and cost awareness.
* Use Python for data processing utilities validations orchestration helpers and reusable libraries.
* Manage source control using Git with enterprise workflows across GitHub Bitbucket enforce PR reviews branching strategies and coding standards.
* Build and maintain CI/CD pipelines using Azure DevOps automating testing packaging and deployment of data code artifacts across environments.
* Ensure data quality and reliability through validations reconciliation, checks monitoring and operational runbooks.
* Collaborate with product app teams analysts and platform teams to translate requirements into scalable data products aligned to customer experience journeys.
* For Senior Developer lead module level design, mentor engineers drive standards for CI/CD and code quality and own delivery for critical pipelines.
Requirements
* Strong handson experience with: Python, PySpark, Databricks, jobs workflows, clusters repos, SQL advanced querying optimization.
* Strong experience with Git and repository platforms, GitHub and/or Bitbucket.
* Hands on experience implementing CI/CD for data engineering workloads.
* Strong working experience with Azure DevOps, Boards Repos Pipelines, build release workflows.
* English for reading, writing and verbal communication directly with foreigners.
If this sounds like the next challenge for you, apply now with an updated resume in English and we'll take it from here :)