Cloud Data Specialist Opportunity
We're seeking a Cloud Data Specialist to join our team in Brazil. In this role, you will design, develop and maintain scalable ETL/ELT pipelines using cloud services.
You will build high-performance data processing solutions with Apache Spark on cloud platforms. Collaboration with data scientists, analysts and business stakeholders is essential to understand data requirements and deliver clean datasets.
* Optimize data workflows for performance and cost efficiency
You will implement best practices around data security, governance and compliance. Developing CI/CD pipelines for data engineering workflows is also required.
Required Skills:
1. Data engineering expertise with a focus on cloud-based solutions;
2. Familiarity with Apache Spark (PySpark) for building high-performance data processing solutions;
3. Azure Data Services experience (Azure Data Factory, Azure Databricks etc.) is highly preferred;