Cloud Data Engineer
We are seeking a skilled Cloud Data Engineer to join our team. As a key member of our data engineering team, you will design, develop, and maintain scalable ETL/ELT pipelines using cloud-based services.
Responsibilities include:
* Designing and implementing high-performance data processing solutions with Apache Spark (PySpark) on cloud-based platforms.
* Collaborating with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
* Optimizing data workflows/pipelines for performance and cost efficiency in cloud environments.
* Implementing best practices around data security, governance, and compliance.
* Developing CI/CD pipelines for data engineering workflows.
* Monitoring, troubleshooting, and enhancing existing data solutions for reliability and performance.
Requirements:
* Experience with cloud-based services: Azure Data Services, AWS services.
* Proficient in Apache Spark (PySpark) for large-scale data processing.
* Knowledge of columnar and table formats: Parquet, Delta Lake, Apache Hudi, Apache Iceberg.
* Familiarity with Data Quality tools: Great Expectations, Soda.
* Experience with CI/CD pipelines for data engineering workflows.
Benefits:
* A competitive salary package.
* Opportunities for career growth and professional development.
* A collaborative and dynamic work environment.
* A comprehensive benefits package, including health insurance, dental plan, life insurance, and more.
We offer:
* An inclusive and diverse work environment.
* Flexible working arrangements.
* A commitment to employee well-being and work-life balance.
* Professional training and development opportunities.
The ideal candidate will have:
* A strong background in cloud computing and data engineering.
* Excellent problem-solving and analytical skills.
* Effective communication and collaboration skills.
* Ability to adapt to changing priorities and deadlines.
Apply now and take the first step towards an exciting new career opportunity!