Transform your career with our team of innovative data engineers who design, develop and maintain scalable ETL/ELT pipelines using Azure Data Services.
We're seeking a highly skilled professional to build high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks.
In this role, you will collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
You will optimize data workflows/pipelines for performance and cost efficiency in a cloud environment.
Implement best practices around data security, governance, and compliance.
Develop CI/CD pipelines for data engineering workflows.
Monitor, troubleshoot, and enhance existing data solutions for reliability and performance.
Document design patterns, best practices, and operational procedures.
Required Skills and Qualifications
* Azure Data Bricks;
* Azure Data Factory;
* Azure Data Services;
* Columnar and table formats (Parquet, Delta, Hudi, Iceberg);
* Data Quality tools (Great Expectations, Soda);
* Step Functions, EventBridge, or Kinesis;
* Best practices for API security (Cognito, WAF, IAM Policies);
* Good communication and teamwork;
* Proactivity in problem-solving;
* Ability to handle agile environments and rapid changes;
Benefits
* Professional development and constant evolution of your skills, always in line with your interests;
* Opportunities to work outside Brazil;
* A collaborative, diverse and innovative environment that encourages teamwork;
* TCS Benefits – Brazil: Health insurance, Dental Plan, Life insurance, Transportation vouchers, Meal/Food Voucher, Childcare assistance, Gympass;
* TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates;
* Partnership with SESC;
* Reimbursement of Certifications;
* Free TCS Learning Portal – Online courses and live training;
* International experience opportunity;
* Discount Partnership with Universities and Language Schools;
* Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire;
* TCS Gems – Recognition for performance;
* Xcelerate – Free Mentoring Career Platform;