We're seeking a highly skilled Data Engineer to join our team.
Job Description
Data Engineers play a crucial role in designing and implementing data architectures on cloud platforms. In this position, you'll be responsible for designing and implementing scalable, high-performance ETL/ELT pipelines using cloud-based services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and Composer.
Key Responsibilities:
* Design and implement data architectures on cloud platforms.
* Develop and optimize scalable, high-performance ETL/ELT pipelines.
* Ensure data quality, integrity, and security throughout the pipeline.
* Create and maintain data models aligned with business needs.
* Collaborate with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases.
* Automate ingestion, transformation, and data delivery processes.
* Monitor and optimize cost and performance of cloud resources.
Requirements:
To be successful in this role, you'll need:
* Proficiency in BigQuery, Dataflow, Cloud Storage, and Pub/Sub.
* Experience with SQL, Oracle Database, and PostgreSQL.
* Knowledge of orchestration using Cloud Composer (Airflow).
* Hands-on experience with CI/CD applied to data pipelines (Git, Terraform).
* Experience with cloud cost and performance optimization.
* GCP certifications.
* Knowledge of Kubernetes (GKE) and APIs on GCP.
* Experience with Machine Learning pipelines (Vertex AI, AI Platform).
* Previous involvement with Data Mesh and distributed architectures.
* Understanding of Data Lake layers.
* Knowledge of batch and streaming processing.
* Experience with data modeling (relational, dimensional, and NoSQL).
What We Offer:
You'll enjoy:
* Professional development and opportunities for growth.
* A collaborative, diverse, and innovative work environment.
* A range of benefits, including health insurance, dental plan, life insurance, transportation vouchers, meal vouchers, childcare assistance, gympass, and more.
Why Join Us?
We promote an inclusive culture, valuing diversity and equity in all opportunities.
],