Key Data Engineer Role
We are seeking a highly skilled Data Engineer to join our team. As a key member, you will be responsible for designing and implementing data architectures on Google Cloud Platform (GCP) using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, and others.
* Pipeline Development: Develop and optimize scalable, high-performance Extract, Transform, Load (ETL)/Extract, Load, Transform (ELT) pipelines that meet the needs of our business units.
* Data Quality: Ensure data quality, integrity, and security end-to-end by implementing robust data validation, monitoring, and governance processes.
* Data Modeling: Create and maintain data models aligned with business needs to support advanced analytics and machine learning use cases.
* Collaboration: Collaborate with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases.
* Data Ingestion and Delivery: Automate ingestion, transformation, and data delivery processes to ensure timely and accurate data delivery to stakeholders.
* Resource Optimization: Monitor and optimize cost and performance of GCP resources to ensure optimal resource utilization.
* Data Governance: Implement best practices for DataOps and Data Governance to ensure compliance with regulatory requirements and industry standards.