Role: Senior Data Engineer (Databricks & Azure)
Location: Remote (Brazil, Mexico, or Costa Rica)
Type: Contract
Role Summary
We are looking for a Developer Senior Developer Data Engineer to build and operate scalable data pipelines and curated datasets that enable Digital and Customer Experience Applications across a global FMCG enterprise You will work hands on with Python PySpark Databricks and SQL contribute to modern engineering practices using Git based workflows and CICD and support end-to-end delivery through Azure DevOps
Key Responsibilities
Design develop and optimize ETLELT pipelines using Databricks PySpark to ingest transform and serve data for digital customer experience use cases
Build and maintain highquality performant SQL transformations and dimensional curated data layers for analytics and downstream consumption
Implement best practices for Databricks engineering notebooks vs repos modular code cluster job configuration performance tuning and cost awareness
Use Python for data processing utilities validations orchestration helpers and reusable libraries
Manage source control using Git with enterprise workflows across GitHub Bitbucket enforce PR reviews branching strategies and coding standards
Build and maintain CICD pipelines using Azure DevOps automating testing packaging and deployment of data code artifacts across environments
Ensure data quality and reliability through validations reconciliation checks monitoring and operational runbooks
Collaborate with product app teams analysts and platform teams to translate requirements into scalable data products aligned to customer experience journeys
For Senior Developer lead module level design mentor engineers drive standards for CICD and code quality and own delivery for critical pipelines
Primary Skills Must Have
• Strong hands on experience with
Python
PySpark
Databricks jobs workflows clusters repos
SQL advanced querying optimization
• Strong experience with Git and repository platforms GitHub andor Bitbucket
• Handson experience implementing CICD for data engineering workloads
• Strong working experience with Azure DevOps Boards Repos Pipelines build release workflows
Secondary Skills Good-to-Have
• Azure Data Factory ADF for orchestration ingestion and scheduling patterns
• Power BI experience for consumption layer understanding datasets measures refresh patterns supporting analytics enablement
Apply or share your resume to