Cloud Data Engineer Role
We are looking for a skilled Cloud Data Engineer to design, develop and maintain scalable data pipelines using cloud-based services.
* Design and implement high-performance data processing solutions with Apache Spark (PySpark) on cloud platforms.
* Collaborate with data scientists, analysts and stakeholders to understand data requirements and deliver clean datasets.
* Optimize data workflows for performance and cost efficiency in the cloud environment.
* Implement best practices around data security, governance and compliance.
The ideal candidate will have experience with columnar and table formats, use of data quality tools and knowledge of automation technologies.
Requirements:
* Experience with cloud-based big data platforms, data lakes and cloud storage.
* Familiarity with file formats, data transformation and data validation.
* Soft skills: Good communication, teamwork, problem-solving and ability to handle agile environments.