Senior Automation Specialist
We are seeking an experienced Senior Automation Specialist to join our team. As a key member of the infrastructure and development teams, you will be responsible for designing, implementing, and maintaining efficient automation frameworks that streamline operations and improve productivity.
Key Responsibilities:
* Develop and maintain CI/CD pipelines for Data Factory, Databricks, Functions, Synapse, Spark workloads, storage configurations using Terraform and Azure DevOps.
* Implement Infrastructure-as-Code with Terraform for provisioning storage accounts, networking, compute, identity, and security layers.
* Enforce branching discipline, artifact integrity, automated testing, and controlled release gates.
* Audit and improve existing environments to reduce configuration drift through standardized templates and environment baselines.
* Maintain and optimize agents, service connections, and deployment runtimes.
* Perform incident response and root-cause analysis, document systemic fixes.
* Deliver reusable automation modules for data engineering teams.
* Optimize workload performance and cost within the Data Lake environment.
* Ensure compliance with governance, audit requirements, and data protection mandates.
Requirements:
* Strong experience in Azure DevOps, Terraform, IaC governance patterns, Azure Data Lake Storage Gen2, hierarchical namespace, ACL models, Azure Data Factory, Databricks, Synapse, Spark, Azure Functions, Key Vault, monitoring stacks, scripting languages, security controls, CI/CD patterns, Jira, Confluence, ServiceNow, and other related technologies.
* Self-motivated individual who can work independently and as part of a team, prioritize tasks effectively, and meet deadlines.
Benefits:
* Opportunity to work on exciting projects and contribute to the growth of the company.
* Collaborative and dynamic work environment.
* Professional development opportunities.
* Competitive compensation package.