Title : Senior Software Engineer
Location : Brazil Remote
Bachelors Degree in Computer Science or a related discipline
15 years overall experience
7 to 9 years of applicable engineering experience
GCP Big Query
Python
Airflow
Composer
Github
CICD
Familiarity with data warehousing concepts star schemas dimensional modeling
OLTP vs OLAP
Adobe
iThe migration and expansion of Adobebased pipelines
iiintegration of Orion datasets into existing datasets
iiiCreation of new pipelines for Orion Event collection
ivProficiency in Python and SQL
vFamiliarity with data warehousing concepts star schemas dimensional modeling OLTP vs OLAP
viDesign build and maintain ETLELT pipelines that move and transform data across hybrid environments AWS GCP Snowflake
viiEstablish data quality checks validation logic and data reconciliation processes
viiiOptimize pipeline runtime compute usage storage tiering and query costs especially in BigQuery
ixCreate and maintain documentation for the data pipelines built