We are looking for a skilled professional to join our team as a Data Engineer.
This is an exciting opportunity to work with cutting-edge technologies and be part of a collaborative environment.
Job Description
The ideal candidate will have hands-on experience with AWS, PySpark, Glue, CloudWatch, and other related tools. They will also possess strong knowledge of data quality, API security, and infrastructure as code.
Responsibilities include designing, developing, and maintaining APIs using AWS API Gateway, implementing integrations with Lambda or Fargate for data ingestion, and developing processing pipelines in PySpark (AWS Glue or EMR).
The successful candidate will also be responsible for managing data in S3 and Glue Data Catalog, ensuring data quality and integrity, optimizing pipeline costs and performance, and creating and maintaining technical documentation and development standards.
Required Skills and Qualifications
* Proven experience with AWS (API Gateway, Lambda/Fargate, S3, Glue, CloudWatch)
* Strong knowledge of PySpark (partitioning, joins, optimization)
* Experience with Glue Data Catalog and querying via Athena
* Experience with integration and manipulation of data in REST APIs
* Knowledge of infrastructure as code (Terraform or CloudFormation)
* Good practices in version control (Git) and CI/CD
* Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg)
* Use of Data Quality tools (Great Expectations, Soda)
* Knowledge of Step Functions, EventBridge, or Kinesis
* Best practices for API security (Cognito, WAF, IAM Policies)
Benefits
We offer a range of benefits to support the health, wellbeing, and career development of our employees.
* Health insurance
* Dental Plan
* Life insurance
* Transportation vouchers
* Meal/Food Voucher
* Childcare assistance
* Gympass
* TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates
* Partnership with SESC
* Reimbursement of Certifications
* Free TCS Learning Portal – Online courses and live training
* International experience opportunity
* Discount Partnership with Universities and Language Schools
* Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire
* TCS Gems – Recognition for performance
* Xcelerate – Free Mentoring Career Platform
Others
We promote an inclusive culture and believe in equity for all employees, regardless of gender, disability, LGBTQIA+, religion, race, or ethnicity.