Transform your career as a Data Engineering specialist.
About the Role
We are seeking an experienced professional to design and implement data architectures on Google Cloud Platform using various services.
* Proficiency in BigQuery, Dataflow (Apache Beam), Cloud Storage, and Pub/Sub is essential.
* Experience with SQL, Oracle Database, and PostgreSQL is required.
* Knowledge of orchestration using Cloud Composer (Airflow) and expertise in cloud cost and performance optimization are necessary.
* Hands-on experience with CI/CD applied to data pipelines (Git, Terraform) and familiarity with Kubernetes (GKE) and APIs on GCP is required.
* Previous involvement with Data Mesh and distributed architectures is desirable.
In this role, you will develop and optimize scalable, high-performance ETL/ELT pipelines, ensure data quality, integrity, and security end-to-end, create and maintain data models aligned with business needs, collaborate with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases, automate ingestion, transformation, and data delivery processes, monitor and optimize cost and performance of GCP resources, and implement best practices for DataOps and Data Governance.
Key Responsibilities:
* Design and implement data architectures on GCP using services like BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and Composer.
* Develop and optimize ETL/ELT pipelines for scalable, high-performance data processing.
* Ensure data quality, integrity, and security throughout the data pipeline.
* Collaborate with cross-functional teams to support advanced analytics and machine learning use cases.
* Implement best practices for DataOps and Data Governance.
Requirements:
* Proficiency in programming languages like Java, Python, and Scala.
* Experience with cloud-based technologies like AWS, Azure, or GCP.
* Strong knowledge of data modeling (relational, dimensional, and NoSQL).
* Ability to work in a fast-paced environment and adapt to changing requirements.
What We Offer:
* A competitive salary and benefits package.
* Opportunities for growth and professional development.
* A collaborative and dynamic work environment.