Data Engineer / Data Architect (GCP / Big Query)– 100% Remote
Candidates Location – Brazil
Employment Type: Contract / Full time
Rate – DOE
Job Description
Bachelor’s Degree in Computer Science or a related discipline
12 - 15 years overall experience
7 9 years of applicable engineering experience
GCP Big Query
Python
Airflow
Composer
GitHub
CICD
Familiarity with data warehousing concepts star schemas dimensional modeling
OLTP vs OLAP
Adobe
The migration and expansion of Adobe based pipelines
integration of Orion datasets into existing datasets
Creation of new pipelines for Orion Event collection
Proficiency in Python and SQL
Familiarity with data warehousing concepts star schemas dimensional modeling OLTP vs OLAP
Design build and maintain ETLELT pipelines that move and transform data across hybrid environments AWS GCP Snowflake
Establish data quality checks validation logic and data reconciliation processes
Optimize pipeline runtime compute usage storage tiering and query costs especially in BigQuery
Create and maintain documentation for the data pipelines built