Job Description
We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining scalable ETL/ELT pipelines using Azure Data Services.
The ideal candidate will have experience with data processing solutions, including Apache Spark on Azure Databricks, and will be able to collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
The role involves optimizing data workflows/pipelines for performance and cost efficiency in a cloud environment, implementing best practices around data security, governance, and compliance, and developing CI/CD pipelines for data engineering workflows.
The Data Engineer will also be responsible for monitoring, troubleshooting, and enhancing existing data solutions for reliability and performance, as well as documenting design patterns, best practices, and operational procedures.
-----------------------------------
Required Skills and Qualifications
* Experience with Azure Data Bricks; Azure Data Factory; Azure Data Services
* Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg)
* Use of Data Quality tools (Great Expectations, Soda)
* Knowledge of Step Functions, EventBridge, or Kinesis
* Best practices for API security (Cognito, WAF, IAM Policies)
* Soft Skills: Good communication and teamwork, Proactivity in problem-solving, Ability to handle agile environments and rapid changes
-----------------------------------
Benefits
* Professional development and constant evolution of your skills, always in line with your interests
* Opportunities to work outside Brazil
* A collaborative, diverse and innovative environment that encourages teamwork
* TCS Benefits – Brazil: Health insurance, Dental Plan, Life insurance, Transportation vouchers, Meal/Food Voucher, Childcare assistance, Gympass, TCS Cares, Partnership with SESC, Reimbursement of Certifications, Free TCS Learning Portal, International experience opportunity, Discount Partnership with Universities and Language Schools, Bring Your Buddy, TCS Gems, Xcelerate
-----------------------------------
Others
At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles.
We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality.