Role: Senior Data Engineer (Databricks & Azure)
Location: Remote (Brazil, Mexico, or Costa Rica)
Type: Contract
Role Summary
We are looking for a Developer Senior Developer Data Engineer to build and operate scalable data pipelines and curated datasets that enable Digital and Customer Experience Applications across a global FMCG enterprise You will work hands on with Python PySpark Databricks and SQL contribute to modern engineering practices using Git based workflows and CICD and support end-to-end delivery through Azure DevOps
Key Responsibilities
* Design develop and optimize ETLELT pipelines using Databricks PySpark to ingest transform and serve data for digital customer experience use cases
* Build and maintain highquality performant SQL transformations and dimensional curated data layers for analytics and downstream consumption
* Implement best practices for Databricks engineering notebooks vs repos modular code cluster job configuration performance tuning and cost awareness
* Use Python for data processing utilities validations orchestration helpers and reusable libraries
* Manage source control using Git with enterprise workflows across GitHub Bitbucket enforce PR reviews branching strategies and coding standards
* Build and maintain CICD pipelines using Azure DevOps automating testing packaging and deployment of data code artifacts across environments
* Ensure data quality and reliability through validations reconciliation checks monitoring and operational runbooks
* Collaborate with product app teams analysts and platform teams to translate requirements into scalable data products aligned to customer experience journeys
* For Senior Developer lead module level design mentor engineers drive standards for CICD and code quality and own delivery for critical pipelines
Primary Skills Must Have
• Strong hands on experience with
* Python
* PySpark
* Databricks jobs workflows clusters repos
* SQL advanced querying optimization
• Strong experience with Git and repository platforms GitHub andor Bitbucket
• Handson experience implementing CICD for data engineering workloads
• Strong working experience with Azure DevOps Boards Repos Pipelines build release workflows
Secondary Skills Good-to-Have
• Azure Data Factory ADF for orchestration ingestion and scheduling patterns
• Power BI experience for consumption layer understanding datasets measures refresh patterns supporting analytics enablement
Apply or share your resume to Gayathri@GeorgiaTek.com