Our company is seeking a highly skilled and motivated Data Engineer to join our team.
About the Role
We are looking for a talented professional who can design, develop, and maintain APIs using AWS API Gateway. The ideal candidate will have strong knowledge of PySpark, experience with Glue Data Catalog and querying via Athena, and expertise in integration and manipulation of data in REST APIs.
* Design and implement processing pipelines in PySpark (AWS Glue or EMR)
* Manage data in S3 and Glue Data Catalog
* Ensure data quality and integrity through data quality checks
* Optimize pipeline costs and performance
Required Skills and Qualifications
The following skills and qualifications are required for this role:
* Proven experience with AWS (API Gateway, Lambda/Fargate, S3, Glue, CloudWatch)
* Strong knowledge of PySpark (partitioning, joins, optimization)
* Experience with Glue Data Catalog and querying via Athena
* Experience with integration and manipulation of data in REST APIs
* Knowledge of infrastructure as code (Terraform or CloudFormation)
Benefits
We offer a range of benefits to our employees, including:
* Professional development and constant evolution of your skills
* Opportunities to work outside Brazil
* A collaborative, diverse, and innovative environment that encourages teamwork
What We Offer
We provide a comprehensive package of benefits and perks to our employees, including:
* Health insurance
* Dental plan
* Life insurance
* Transportation vouchers
* Meal/food voucher
* Childcare assistance
* Gympass