Expert Data Scientist
We are seeking an expert in data engineering to join our team.
The ideal candidate will have strong problem-solving skills and experience in AWS, PySpark, and Glue Data Catalog.
* Design, develop, and maintain APIs using AWS API Gateway.
* Implement integrations with Lambda or Fargate for data ingestion.
* Develop processing pipelines in PySpark (AWS Glue or EMR).
The role involves:
* Proven experience with AWS services, including API Gateway, Lambda/Fargate, S3, Glue, and CloudWatch.
* Strong knowledge of PySpark, including partitioning, joins, and optimization.
* Experience with integration and manipulation of data in REST APIs.
* Knowledge of infrastructure as code (Terraform or CloudFormation) and good practices in version control (Git) and CI/CD.
Our team offers a collaborative environment, professional development opportunities, and a diverse team.
Key responsibilities include designing and developing scalable data pipelines, implementing data governance, and ensuring high-quality data delivery.
Additionally, the successful candidate will have excellent communication and teamwork skills.