Job Title: Specialist – Software Engineering (Data Engineering)
Experience Required
Job Summary
We are seeking a Specialist – Software Engineering with strong expertise in data engineering, cloud platforms, and ETL/ELT pipeline development. The ideal candidate will play a key role in the migration and expansion of Adobe-based data pipelines, integration of Orion datasets, and creation of new event collection pipelines.
This role requires strong experience in Python, SQL, Google Cloud Platform (GCP), BigQuery, Airflow/Composer, and modern data warehousing concepts.
Key Responsibilities
* Lead the migration and expansion of Adobe-based data pipelines
* Integrate Orion datasets into existing enterprise data platforms
* Design and develop new pipelines for Orion event collection
* Build, maintain, and optimize ETL/ELT pipelines across hybrid cloud environments:
* AWS
* GCP
* Snowflake
* Develop robust data transformation processes using:
* Python
* SQL
* Implement and maintain data quality checks, validation rules, and reconciliation processes
* Optimize:
* Pipeline runtime
* Compute usage
* Storage tiering
* Query performance and cost in BigQuery
* Maintain clear technical documentation for data pipelines and workflows
* Collaborate with cross-functional teams to support data architecture initiatives
* Support CI/CD deployment processes and source control best practices
Required Technical Skills
Cloud & Data Platforms
* Google Cloud Platform (GCP)
* BigQuery
* Cloud Composer
* Apache Airflow
* AWS
* Snowflake
Programming
* Python
* SQL
Version Control / DevOps
* GitHub
* CI/CD pipelines
Data Concepts
* Data Warehousing
* Star Schema
* Dimensional Modeling
* Understanding of:
* OLTP vs OLAP
* Data lifecycle management
* Data governance principles
Preferred Qualifications
* Experience with enterprise-scale data migration projects
* Strong troubleshooting and performance tuning skills
* Experience with hybrid cloud data environments
* Ability to work independently and mentor junior engineers
📩 How to Apply / Contact
* Email:
* WhatsApp: +1 (404) 940-4414