Job Title
As a Data Engineer, you will play a crucial role in designing and implementing data architectures on GCP using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, among others.
The ideal candidate will have proficiency in BigQuery, Dataflow (Apache Beam), Cloud Storage, and Pub/Sub. Additionally, they should have experience with SQL, Oracle Database, and PostgreSQL, as well as knowledge of orchestration using Cloud Composer (Airflow).
A strong understanding of cloud cost and performance optimization is also essential, along with hands-on experience with CI/CD applied to data pipelines (Git, Terraform). GCP certifications are highly valued, as well as knowledge of Kubernetes (GKE) and APIs on GCP.
Experience with Machine Learning pipelines (Vertex AI, AI Platform) and previous involvement with Data Mesh and distributed architectures are highly desirable. Understanding of Data Lake layers and knowledge of batch and streaming processing are also necessary.
Responsibilities
1. Design and implement scalable, high-performance ETL/ELT pipelines.
2. Ensure data quality, integrity, and security end-to-end.
3. Create and maintain data models aligned with business needs.
4. Collaborate with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases.
5. Automate ingestion, transformation, and data delivery processes.
6. Monitor and optimize cost and performance of GCP resources.
7. Implement best practices for DataOps and Data Governance.
What We Offer
* Professional development and constant evolution of your skills.
* Opportunities to work outside Brazil.
* A collaborative, diverse, and innovative environment that encourages teamwork.
Benefits
* Health insurance.
* Dental Plan.
* Life insurance.
* Transportation vouchers.
* Meal/Food Voucher.
* Childcare assistance.
* Gympass.
* TCS Cares - free 0800 that provides psychological assistance, legal, social, and financial assistance to associates.
* Partnership with SESC.
* Reimbursement of Certifications.
* Free TCS Learning Portal - Online courses and live training.
* International experience opportunity.
* Discount Partnership with Universities and Language Schools.
* Bring Your Buddy - By referring people you become eligible to receive a bonus for each hire.
* TCS Gems - Recognition for performance.
* Xcelerate - Free Mentoring Career Platform.
Why Join Us?
We promote an inclusive culture that values diversity and equity. Our opportunities are based on these principles, and we strive to create a workplace where everyone feels valued and respected.