Senior Data Engineer Job Description
Job Overview
We are seeking an experienced Senior Data Engineer to design and implement data architectures on Google Cloud Platform (GCP) using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, and others.
Key Responsibilities
* Develop and optimize scalable, high-performance ETL/ELT pipelines
* Ensure data quality, integrity, and security end-to-end
* Create and maintain data models aligned with business needs
* Collaborate with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases
* Automate ingestion, transformation, and data delivery processes
* Monitor and optimize cost and performance of GCP resources
* Implement best practices for DataOps and Data Governance
Requirements
* Proficiency in BigQuery, Dataflow (Apache Beam), Cloud Storage, and Pub/Sub
* Experience with SQL, Oracle Database, and PostgreSQL
* Knowledge of orchestration using Cloud Composer (Airflow)
* Hands-on experience with CI/CD applied to data pipelines (Git, Terraform)
* Experience with cloud cost and performance optimization
* GCP certifications
* Knowledge of Kubernetes (GKE) and APIs on GCP
* Experience with Machine Learning pipelines (Vertex AI, AI Platform)
* Previous involvement with Data Mesh and distributed architectures
* Understanding of Data Lake layers
* Knowledge of batch and streaming processing
* Experience with data modeling (relational, dimensional, and NoSQL)
Benefits
We offer a collaborative, diverse, and innovative environment that encourages teamwork. Our benefits include:
* Professional development and constant evolution of your skills
* Opportunities to work outside Brazil
* TCS Benefits – Brazil: health insurance, dental plan, life insurance, transportation vouchers, meal/food voucher, childcare assistance, Gympass, TCS Cares, partnership with SESC, reimbursement of certifications, free TCS Learning Portal, international experience opportunity, discount partnership with universities and language schools, bring your buddy, TCS Gems, Xcelerate
About Us
We promote an inclusive culture and work for equity based on gender, people with disabilities, LGBTQIA+, religion, race, ethnicity. All our opportunities are based on these principles.