Role Overview
A cloud data architect plays a vital role in ensuring the design and implementation of scalable, secure, and efficient cloud-based data systems.
Key Responsibilities:
* Cloud Infrastructure Design: Responsible for designing and implementing cloud infrastructure on Azure, utilizing Terraform or equivalent tools to ensure scalability and security.
* DataOps/MLOps Practices: Implements data operations and machine learning operations practices for pipelines, version control, and automated deployment on GitHub/Azure DevOps.
* Pipeline Monitoring: Ensures observability and monitoring of pipelines and clusters to guarantee optimal performance.
Requirements:
* Technical Expertise: Solid experience with Azure, including Data Lake Gen2, Databricks, Azure Data Factory, and Synapse.
* Strong Data Engineering Skills: Proficient in data modeling, batch and streaming processing, performance optimization, and cost optimization.
* Governance and Data Security: Knowledge of data governance and security best practices, including RBAC, IAM, and LGPD compliance.