Job Title: Cloud Data Engineer
We are seeking a skilled Cloud Data Engineer to design, develop and maintain large-scale data processing systems using AWS technologies.
About the Role:
* Design and develop scalable data pipelines using AWS Glue and PySpark.
* Implement data integration and manipulation using REST APIs.
* Develop and maintain APIs using AWS API Gateway.
* Collaborate with cross-functional teams to identify business needs and develop solutions.
* Stay up-to-date with the latest advancements in cloud computing technologies.
Key Responsibilities:
1. Analyzing and resolving complex technical issues related to data engineering and cloud computing.
2. Collaborating with data scientists and analysts to understand data requirements and develop data-driven solutions.
3. Participating in agile development environments to deliver high-quality software products.
Requirements:
* Extensive experience with AWS services including API Gateway, Lambda/Fargate, S3, Glue, CloudWatch.
* In-depth knowledge of PySpark programming language.
* Familiarity with Glue Data Catalog and querying via Athena.
* Strong analytical and problem-solving skills.
What We Offer:
* Ongoing training and professional development opportunities.
* A diverse and collaborative work environment.
* A competitive compensation package.
About Us:
We are a leading provider of innovative IT solutions that drive business growth. Our team is passionate about delivering exceptional results and creating a culture of unlimited learning and mutual development.