DevOps Engineer
The ideal candidate will be responsible for designing and implementing scalable Continuous Integration/Continuous Deployment pipelines for Data Lake components, utilizing Infrastructure-as-Code principles with Terraform.
A strong understanding of enterprise security practices, observability tools, backup and restoration procedures, disaster-recovery patterns, and configuration drift management is required.
* Main Responsibilities:
* Design and implement CI/CD pipelines for Data Lake components.
* Implement Infrastructure-as-Code with Terraform.
* Maintain and optimize agents, service connections, and deployment runtimes.
Requirements:
* Strong understanding of Azure DevOps and data engineering principles.
* Experience with Terraform, Git repositories, and artifact management.
* Knowledge of Azure Data Lake Storage Gen2, hierarchical namespace, and ACL models.
* Familiarity with Azure Functions, Key Vault, and networking concepts.
* Ability to design and implement monitoring stacks using Log Analytics, Application Insights, and Azure Monitor.
* Scripting experience in PowerShell, Python, and Bash.
* Understanding of security controls, including RBAC, managed identities, secrets management, and encryption.
* CI/CD patterns, release strategy design, and automated testing frameworks.