GCP Data Engineer - Job Description
We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.
Key Responsibilities:
* Design and implement scalable data architectures on GCP using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, and others.
* Develop and optimize high-performance ETL/ELT pipelines.
* Ensure data quality, integrity, and security throughout the data pipeline.
* Create and maintain data models aligned with business needs.
* Collaborate with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases.
* Automate ingestion, transformation, and data delivery processes.
* Monitor and optimize cost and performance of GCP resources.
* Implement best practices for DataOps and Data Governance.
Required Skills and Qualifications:
* Proficiency in BigQuery, Dataflow (Apache Beam), Cloud Storage, and Pub/Sub.
* Experience with SQL, Oracle Database, and PostgreSQL.
* Knowledge of orchestration using Cloud Composer (Airflow).
* Hands-on experience with CI/CD applied to data pipelines (Git, Terraform).
* Experience with cloud cost and performance optimization.
* GCP certifications.
* Knowledge of Kubernetes (GKE) and APIs on GCP.
* Experience with Machine Learning pipelines (Vertex AI, AI Platform).
* Previous involvement with Data Mesh and distributed architectures.
* Understanding of Data Lake layers.
* Knowledge of batch and streaming processing.
* Experience with data modeling (relational, dimensional, and NoSQL).
Benefits:
* Professional development and constant evolution of your skills
* Opportunities to work outside Brazil
* A collaborative, diverse, and innovative environment that encourages teamwork
* TCS Benefits – Brazil:
o Health insurance
o Dental Plan
o Life insurance
o Transportation vouchers
o Meal/Food Voucher
o Childcare assistance
o Gympass
Others:
At TCS, we promote an inclusive culture and strive for equity. We believe in diversity and respect individuality. Come and be part of our team!