Job Title: Senior Data Engineer (GCP / BigQuery / Python)
Location: Remote
Experience Level: 7–12 years total experience (7–9+ years in Data Engineering)
Job Summary
We are seeking a highly skilled Senior Data Engineer with strong experience in cloud-based data platforms, especially Google Cloud Platform (GCP) and BigQuery. The ideal candidate will design, build, and optimize scalable data pipelines and modern data warehouse solutions across hybrid cloud environments (AWS, GCP, Snowflake).
You will play a key role in migrating and enhancing Adobe-based data pipelines, integrating new datasets (including Orion), and building robust event-driven data architectures.
Key Responsibilities
* Design, develop, and maintain scalable ETL/ELT pipelines across hybrid cloud environments (AWS, GCP, Snowflake)
* Build and optimize data workflows using Python, SQL, Apache Airflow, and GCP Composer
* Develop high-performance solutions in Google BigQuery, ensuring cost and query optimization
* Support migration and enhancement of Adobe-based data pipelines
* Integrate and manage Orion datasets into existing data ecosystems
* Build new pipelines for event data collection and processing
* Implement data quality checks, validation rules, and reconciliation frameworks
* Optimize pipeline performance including runtime, compute usage, and storage efficiency
* Work closely with stakeholders to translate business requirements into scalable data solutions
* Maintain clear and detailed technical documentation for all data pipelines and architectures
Required Skills & Qualifications
* Bachelor’s degree in Computer Science, Engineering, or related field
* 7–12 years of overall experience in software/data engineering
* 7+ years of hands-on experience in data engineering roles
* Strong expertise in Python and SQL
* Proven experience with GCP BigQuery
* Strong knowledge of Apache Airflow / GCP Composer
* Experience in CI/CD pipelines using GitHub or similar tools
* Strong understanding of data warehousing conceptsStar schema
* Dimensional modeling
* OLTP vs OLAP systems
* Experience working with ETL/ELT pipelines in cloud environments
* Familiarity with AWS, GCP, and Snowflake ecosystems
* Experience in performance tuning and cost optimization in BigQuery
Nice to Have
* Experience with Adobe data ecosystem and pipeline migration
* Experience with real-time or event-driven data architectures
* Exposure to large-scale analytics or marketing data platforms
* Knowledge of data governance and metadata management tools
Soft Skills
* Strong problem-solving and analytical skills
* Ability to work in cross-functional global teams
* Good communication and documentation skills
* Ownership mindset and attention to detail