Job Description
We are seeking a highly skilled Data Engineer to join our team.
This role involves designing and implementing data architectures on GCP using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, among others.
The successful candidate will have expertise in BigQuery, Dataflow (Apache Beam), Cloud Storage, and Pub/Sub, with experience in SQL, Oracle Database, and PostgreSQL.
Key responsibilities include developing and optimizing scalable, high-performance ETL/ELT pipelines, ensuring data quality, integrity, and security end-to-end, creating and maintaining data models aligned with business needs, collaborating with data scientists, analysts, and software engineers to support advanced analytics and machine learning use cases, automating ingestion, transformation, and data delivery processes, monitoring and optimizing cost and performance of GCP resources, and implementing best practices for DataOps and Data Governance.
Required Skills and Qualifications
* Proficiency in BigQuery, Dataflow (Apache Beam), Cloud Storage, and Pub/Sub
* Experience with SQL, Oracle Database, and PostgreSQL
* Knowledge of orchestration using Cloud Composer (Airflow)
* Hands-on experience with CI/CD applied to data pipelines (Git, Terraform)
* Experience with cloud cost and performance optimization
* GCP certifications
* Knowledge of Kubernetes (GKE) and APIs on GCP
* Experience with Machine Learning pipelines (Vertex AI, AI Platform)
* Previous involvement with Data Mesh and distributed architectures
* Understanding of Data Lake layers
* Knowledge of batch and streaming processing
* Experience with data modeling (relational, dimensional, and NoSQL)
Benefits
* Health insurance
* Dental Plan
* Life insurance
* Transportation vouchers
* Meal/Food Voucher
* Childcare assistance
* Gympass
* TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates
* Partnership with SESC
* Reimbursement of Certifications
* Free TCS Learning Portal – Online courses and live training
* International experience opportunity
* Discount Partnership with Universities and Language Schools
* Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire
* TCS Gems – Recognition for performance
* Xcelerate – Free Mentoring Career Platform