Job Overview
We are seeking an experienced Data Engineer with expertise in Pyspark to join our team.
The successful candidate will have a strong background in data engineering, with a proven track record of delivering high-quality projects using Pyspark and related technologies. They will also possess excellent communication skills, both written and verbal, and be able to effectively collaborate with cross-functional teams.
Key Responsibilities
* Design, develop, and deploy scalable data pipelines using Pyspark;
* Maintain and optimize existing data processing systems for optimal performance and reliability;
* Collaborate with data analysts and scientists to identify business opportunities and implement solutions;
* Participate in code reviews and contribute to the development of best practices and standards within the team.
Requirements
* Bachelor's degree in Computer Science, Engineering, or related field;
* At least 4 years of experience as a Data Engineer, preferably with a focus on Pyspark and related technologies;
* Proficiency in AWS services such as Lambda, Glue, and Databricks;
* Excellent problem-solving skills, with the ability to analyze complex problems and develop creative solutions;
* Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
What We Offer
* A competitive salary and benefits package;
* Ongoing training and professional development opportunities;
* A dynamic and supportive work environment, with opportunities to work on exciting and challenging projects.