Cloud Data Engineering Role
We are seeking a skilled professional to lead our cloud data engineering efforts.
This position involves designing and implementing scalable, high-performance data architectures on GCP using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, among others.
The ideal candidate will have expertise in BigQuery, Dataflow (Apache Beam), Cloud Storage, and Pub/Sub, experience with SQL, Oracle Database, and PostgreSQL, knowledge of orchestration using Cloud Composer (Airflow), hands-on experience with CI/CD applied to data pipelines (Git, Terraform), and experience with cloud cost and performance optimization.
The successful candidate will also possess GCP certifications, knowledge of Kubernetes (GKE) and APIs on GCP, experience with Machine Learning pipelines (Vertex AI, AI Platform), previous involvement with Data Mesh and distributed architectures, understanding of Data Lake layers, knowledge of batch and streaming processing, and experience with data modeling (relational, dimensional, and NoSQL).
The responsibilities of this role include developing and optimizing ETL/ELT pipelines, ensuring data quality, integrity, and security end-to-end, creating and maintaining data models aligned with business needs, collaborating with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases, automating ingestion, transformation, and data delivery processes, monitoring and optimizing cost and performance of GCP resources, and implementing best practices for DataOps and Data Governance.
1. Developing and optimizing scalable, high-performance ETL/ELT pipelines.
2. Ensuring data quality, integrity, and security end-to-end.
3. Creating and maintaining data models aligned with business needs.
4. Collaborating with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases.
5. Automating ingestion, transformation, and data delivery processes.
We offer a dynamic work environment and opportunities for growth and development.
If you're passionate about cloud data engineering and want to make a meaningful impact, we encourage you to apply.