Cloud Data Architect
We are looking for a skilled Cloud Data Architect to join our team. In this role, you will be responsible for designing and implementing scalable data processing pipelines using cloud-based services.
* Design high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks.
* Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
* Implement data quality tools such as Great Expectations and Soda.
The ideal candidate has experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg), knowledge of Step Functions, EventBridge, or Kinesis, and best practices for API security (Cognito, WAF, IAM Policies).
Required Skills:
* Experience with Apache Spark (PySpark)
* Knowledge of Azure Databricks
* Ability to design high-performance data processing solutions
* Excellent communication and teamwork skills
Benefits:
* Opportunity to work with cutting-edge technology
* Collaborative and dynamic work environment
* Professional growth and development opportunities