Job Title: Senior Data Engineer (GCP / BigQuery / Adobe Pipelines)
Location: Remote
Job Summary
We are seeking a highly experienced Senior Data Engineer with strong expertise in GCP, BigQuery, and data pipeline development. The ideal candidate will play a key role in building, optimizing, and scaling data pipelines, while supporting Adobe-based data integrations and Orion dataset expansion.
Key Responsibilities
* Lead migration and expansion of Adobe-based data pipelines
* Integrate Orion datasets into existing data platforms
* Design and develop new pipelines for Orion event data collection
* Build, maintain, and optimize ETL/ELT pipelines across hybrid environments (AWS, GCP, Snowflake)
* Implement data quality checks, validation logic, and reconciliation processes
* Optimize BigQuery performance, including runtime, compute usage, and cost efficiency
* Work with Airflow / Composer for workflow orchestration
* Collaborate with cross-functional teams to deliver scalable data solutions
* Maintain proper documentation for all data pipelines and processes
Required Skills & Experience
* Bachelor’s Degree in Computer Science or related field
* 12–15 years of overall IT experience
* 7–9 years of hands-on data engineering experience
* Strong expertise in:
* GCP BigQuery
* Python & SQL
* Apache Airflow / Cloud Composer
* GitHub & CI/CD pipelines
* Experience with Adobe data platforms / pipelines
* Strong understanding of:
* Data Warehousing concepts
* Star Schema & Dimensional Modeling
* OLTP vs OLAP systems