Job Overview
* We are seeking a skilled Cloud Infrastructure Engineer to join our team. As a key member of our data engineering team, you will be responsible for architecting and maintaining CI/CD pipelines for Data Lake components.
* This includes implementing Infrastructure-as-Code with Terraform for provisioning storage accounts, networking, compute, identity, and security layers.
* You will enforce branching discipline, artifact integrity, automated testing, and controlled release gates.
* A key aspect of this role is automating environment provisioning, ACL management, key rotation, lifecycle policies, and cluster configuration.
* Additionally, you will integrate DevOps processes with enterprise security: RBAC, managed identities, Key Vault, private networking, encryption controls.
* Built-in observability through logging, metrics, alerting, and dashboards for pipelines and platform components is also a critical part of this position.
* Maintaining backup, restoration, disaster-recovery patterns and testing them for reliability is also an important responsibility.
* Furthermore, you will eliminate configuration drift through standardized templates and environment baselines.
* Maintaining and optimizing agents, service connections, and deployment runtimes will also be your responsibility.
* You will perform incident response and root-cause analysis, documenting systemic fixes.
* Finally, delivering reusable automation modules for data engineering teams and optimizing workload performance and cost within the Data Lake environment are key goals.
* In addition, ensuring compliance with governance, audit requirements, and data protection mandates is essential.
* Last but not least, driving continuous reduction of manual operational work through automation will be crucial.