Description
As a key member of our data engineering team, you will play a crucial role in designing and developing scalable ETL/ELT pipelines using Azure Data Services.
You will be responsible for building high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks. This includes collaborating with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
To excel in this role, you should have experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg), as well as knowledge of Step Functions, EventBridge, or Kinesis. You should also be familiar with best practices for API security (Cognito, WAF, IAM Policies).
Azure Data Bricks; Azure Data Factory; Azure Data Services
Key skills include:
* Design and development of scalable data pipelines
* High-performance data processing using Apache Spark
* Collaboration with cross-functional teams
* API security and governance
* Cloud-based data storage and processing
What can you expect from us?
* Professional development and constant evolution of your skills
* Opportunities to work outside Brazil
* A collaborative, diverse and innovative environment that encourages teamwork
Our benefits package includes:
* Health insurance
* Dental Plan
* Life insurance
* Transportation vouchers
* Meal/Food Voucher
* Childcare assistance
* Gympass
* TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates
* Partnership with SESC
* Reimbursement of Certifications
* Free TCS Learning Portal – Online courses and live training
* International experience opportunity
* Discount Partnership with Universities and Language Schools
* Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire
* TCS Gems – Recognition for performance
* Xcelerate – Free Mentoring Career Platform
We promote an inclusive culture at TATA Consultancy Services and welcome applicants from all backgrounds.