Job Title: DevOps Engineer
Our organization seeks a seasoned DevOps Engineer to join our team and drive the development, deployment, and management of our Data Lake components.
Key Responsibilities:
* CI/CD Pipeline Architect: Design, build, and maintain continuous integration and continuous delivery pipelines for our Data Lake components.
* Infrastructure-as-Code Specialist: Implement Infrastructure-as-Code with Terraform for provisioning storage accounts, networking, compute, identity, and security layers.
* Release Management Expert: Enforce branching discipline, artifact integrity, automated testing, and controlled release gates.
* Environment Provisioning Automation: Automate environment provisioning, ACL management, key rotation, lifecycle policies, and cluster configuration.
* DevOps Process Integration: Integrate DevOps processes with enterprise security: RBAC, managed identities, Key Vault, private networking, encryption controls.
* Observability: Build observability: logging, metrics, alerting, dashboards for pipelines and platform components.
* Backup and Disaster Recovery: Maintain backup, restoration, disaster-recovery patterns and test them for reliability.
* Configuration Drift Prevention: Eliminate configuration drift through standardized templates and environment baselines.
* Agent Maintenance: Maintain and optimize agents, service connections, and deployment runtimes.
* Incident Response: Perform incident response and root-cause analysis, document systemic fixes.
* Automation Module Delivery: Deliver reusable automation modules for data engineering teams.
* Workload Optimization: Optimize workload performance and cost within the Data Lake environment.
* Compliance and Governance: Ensure compliance with governance, audit requirements, and data protection mandates.
* Automation Continuously: Drive continuous reduction of manual operational work through automation.
Required Skills and Qualifications:
* Proven experience in designing, building, and maintaining CI/CD pipelines.
* Expertise in Infrastructure-as-Code with Terraform.
* Strong understanding of branching discipline, artifact integrity, automated testing, and controlled release gates.
* Ability to automate environment provisioning, ACL management, key rotation, lifecycle policies, and cluster configuration.
* Experience with integrating DevOps processes with enterprise security.
* Proficiency in building observability: logging, metrics, alerting, dashboards for pipelines and platform components.
* Knowledge of backup, restoration, disaster-recovery patterns.
* Understanding of configuration drift prevention through standardized templates and environment baselines.
* Ability to maintain and optimize agents, service connections, and deployment runtimes.
* Strong problem-solving skills for incident response and root-cause analysis.
* Excellent communication and documentation skills.
Benefits:
* Competitive salary and benefits package.
* Ongoing training and professional development opportunities.
* Collaborative and dynamic work environment.
Others:
* Opportunity to work with cutting-edge technology.
* Chance to make a meaningful impact on the organization's success.