We are seeking a Senior Data Engineer to spearhead the design and implementation of cutting-edge data architectures on Google Cloud Platform (GCP). Key responsibilities include architecting and optimizing large-scale ETL/ELT pipelines, ensuring robust data quality and security, crafting data models aligned with business objectives, and collaborating with data scientists and analysts to drive strategic initiatives.
* Proficiency in BigQuery, Dataflow (Apache Beam), Cloud Storage, and Pub/Sub
* Experience with SQL, Oracle Database, and PostgreSQL
* Knowledge of orchestration using Cloud Composer (Airflow)
* Hands-on experience with CI/CD applied to data pipelines (Git, Terraform)
* Experience with cloud cost and performance optimization
* GCP certifications
* Knowledge of Kubernetes (GKE) and APIs on GCP
* Experience with Machine Learning pipelines (Vertex AI, AI Platform)
* Previous involvement with Data Mesh and distributed architectures
* Understanding of Data Lake layers
* Knowledge of batch and streaming processing
* Experience with data modeling (relational, dimensional, and NoSQL)