Job Description: Azure Cloud & DevOps Specialist

(ADF • Databricks  • AKS • GitHub CI/CD)

Role Summary

We are looking for a hands-on Azure Cloud & DevOps Specialist with proven, real-world experience in automating deployments for data platforms and cloud-native applications on Microsoft Azure.
This role requires end-to-end ownership of CI/CD pipelines—from GitHub to production—covering ADF, Databricks, SQL databases, and microservices.

Azure Platform Scope (Mandatory)

Candidates must have hands-on experience deploying and automating the following Azure services:

Data & Analytics

• Azure Data Factory (ADF)
  
  

• Azure SQL Database
  
  

• Databricks
  
  

Application & Compute

• Azure Function Apps
  
  

• Azure Web Apps
  
  

• Azure Container Apps
  
  

• Azure Kubernetes Service (AKS)
  
  

Caching

• Azure Redis Cache
  
  

Key Responsibilities

1. CI/CD & Deployment Automation (Core Responsibility)

• Design, implement, and maintain GitHub Actions–based CI/CD pipelines for Azure workloads.
  
  

• Automate deployments for:
  
  

• ADF pipelines (ARM/Bicep/Terraform-based)
  
  

• Azure SQL schemas & migrations
  
  

• Databricks notebooks, jobs, and workflows
  
  

• Delta Lake table definitions and schema evolution
  
  

• Enable environment promotion (Dev → QA → UAT → Prod) with approvals and rollback mechanisms.
  
  

• Ensure zero manual deployments for production environments.
  
  

2. Azure Data Factory (ADF) – Mandatory Hands-On

• Automate ADF deployments using:
  
  

• ARM templates / Bicep / Terraform
  
  

• Parameterized pipelines and linked services
  
  

• Implement:
  
  

• Incremental and CDC-based pipelines
  
  

• Robust retry, alerting, and logging mechanisms
  
  

• Integrate ADF CI/CD with GitHub Actions.
  
  

3. Database & Data Platform Automation

• Azure SQL
  
  

• Automate schema changes using version-controlled SQL scripts
  
  

• Handle backward-compatible deployments and rollback strategies
  
  

4. Databricks Deployment & CI/CD

• Automate deployment of:
  
  

• Databricks notebooks
  
  

• Jobs and workflows
  
  

• Use:
  
  

• Databricks CLI / REST APIs
  
  

• GitHub integration
  
  

• Implement workspace isolation across environments.
  
  

5. Application & Microservices Deployment

• Deploy Python, Django, and React-based microservices to:
  
  

• Azure Function Apps
  
  

• Azure Web Apps
  
  

• Azure Container Apps
  
  

• AKS
  
  

• Build and maintain Docker images.
  
  

• Manage Kubernetes manifests or Helm charts.
  
  

• Implement autoscaling, health checks, and observability.
  
  

6. Security, Secrets & Governance

• Manage secrets using Azure Key Vault.
  
  

• Implement RBAC and managed identities.
  
  

• Secure networking using VNets and private endpoints.
  
  

• Enforce compliance and audit requirements (financial data handling).
  
  

Required Skills & Experience (Non-Negotiable)

Core Requirements

• 5+ years of experience in DevOps / Cloud Engineering
  
  

• 3+ years of hands-on Azure experience
  
  

• Proven CI/CD automation for:
  
  

• Azure Data Factory
  
  

• Azure SQL
  
  

• Databricks
  
  

DevOps Tooling

• GitHub Actions (mandatory)
  
  

• Scripting:
  
  

• Python, Bash, or PowerShell
  
  

Explicit Screening & Rejection Criteria

Candidates will be rejected during screening if they:

• Have only manual or UI-based deployments
  
  

• Lack CI/CD experience for ADF, Azure SQL, Databricks.
  
  

• Cannot explain real deployment pipelines they personally built
  
  

• Have theoretical knowledge without production ownership
  
  

Preferred (Nice-to-Have)

• Experience in financial services / regulated environments
  
  

• Docker, Kubernetes and Terraform.
  
  

• FinOps / cost optimization experience
  
  

• Microsoft Azure certifications (DevOps Expert)