Design and Develop Data Pipelines
The ideal candidate for this role will have experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg) and data quality tools (Great Expectations, Soda).
1. Key Responsibilities:
2. Develop Scalable ETL/ELT Pipelines: Utilize Azure Data Services to design, develop, and maintain high-performance data processing solutions.
3. Collaborate with Cross-Functional Teams: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
4. Build High-Quality Data Products: Create innovative data solutions that drive business value and improve decision-making.
This is an excellent opportunity for a talented data engineer to join our team and take their career to the next level. As a data engineer in this role, you will have the chance to work on challenging projects, collaborate with experienced professionals, and develop your skills in cutting-edge technologies.
The successful candidate will possess strong analytical and problem-solving skills, as well as excellent communication and collaboration abilities. If you are a motivated and detail-oriented individual who is passionate about working with data, we encourage you to apply for this exciting opportunity.