We are seeking a talented Data Engineer to join our team. This is an exciting opportunity to work with cutting-edge technology and be part of a dynamic team.
The ideal candidate will have experience in designing, developing, and maintaining scalable data pipelines using Azure Data Services (Azure Data Factory, Azure Databricks, Azure Synapse). They will also have expertise in building high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks.
In this role, you will collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets. You will also optimize data workflows/pipelines for performance and cost efficiency in a cloud environment.
Additionally, the successful candidate will implement best practices around data security, governance, and compliance. They will develop CI/CD pipelines for data engineering workflows and monitor, troubleshoot, and enhance existing data solutions for reliability and performance.
This role offers opportunities for professional growth and development, as well as collaboration with a diverse and innovative team.
Required Skills:
* Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg)
* Use of Data Quality tools (Great Expectations, Soda)
* Knowledge of Step Functions, EventBridge, or Kinesis
* Best practices for API security (Cognito, WAF, IAM Policies)
Benefits:
* Professional development and constant evolution of your skills
* Opportunities to work outside Brazil
* A collaborative, diverse, and innovative environment that encourages teamwork
* TCS Benefits – Brazil: health insurance, dental plan, life insurance, transportation vouchers, meal/food voucher, childcare assistance, Gympass, TCS Cares, partnership with SESC, reimbursement of certifications, free TCS Learning Portal, international experience opportunity, discount partnership with universities and language schools, Bring Your Buddy, TCS Gems, Xcelerate
Other Opportunities:
At TCS, we promote an inclusive culture, and we believe in diversity, equity, and inclusion. We offer equal opportunities for everyone, regardless of their background, race, ethnicity, religion, gender, or disability.