Data Platform DevOps Engineer

About the Role:

We are seeking an experienced Data Platform DevOps Engineer to design, automate, and manage modern cloud-based data platforms using Microsoft Azure, Azure DevOps, and Microsoft Fabric. The ideal candidate will have strong expertise in CI/CD, Infrastructure as Code (IaC), deployment automation, cloud security, and data platform operations.

This role requires close collaboration with Data Engineering, Analytics, and Platform teams to build secure, scalable, and highly automated data solutions.

Key Responsibilities:

DevOps & CI/CD:

- Design, develop, and maintain CI/CD pipelines using Azure DevOps.

- Implement Git branching strategies, pull requests, code reviews, and release management processes.

- Automate deployments across Development, UAT, and Production environments.

- Build deployment governance, approval workflows, and environment promotion mechanisms.

Microsoft Fabric Platform Engineering:

- Deploy and manage Microsoft Fabric workspaces and environments.

- Automate deployment of Lakehouses, Data Warehouses, Data Pipelines, Notebooks, and Power BI Components.

- Configure and manage OneLake environments.

- Implement Fabric Git Integration and Deployment Pipelines.

- Support workspace administration, capacity management, and operational governance.

Infrastructure Automation:

- Provision and manage Azure infrastructure using Terraform and Infrastructure-as-Code practices.

- Develop reusable modules, templates, and deployment frameworks.

- Automate environment creation and configuration management.

Security & Governance:

- Implement RBAC, Microsoft Entra ID, Managed Identities, and Service Principals.

- Ensure adherence to security, governance, and compliance standards.

- Support data governance initiatives using Microsoft Purview.

- Implement secure access controls, encryption, and secrets management.

Monitoring & Operations:

- Build monitoring, logging, and alerting solutions using Azure Monitor and Log Analytics.

- Troubleshoot deployment, platform, and performance issues.

- Support incident management and root cause analysis.

- Drive reliability, scalability, and operational excellence.

Required Skills:

Microsoft Fabric: Microsoft Fabric Administration, OneLake, Lakehouse, Data Warehouse, Data Factory, Data Pipelines, Notebooks, Deployment Pipelines, Git Integration.

Azure DevOps: Azure Repos, Azure Pipelines, CI/CD Automation, Git Workflows, Release Management, YAML Pipelines.

Microsoft Azure: Azure Storage, Azure SQL, Azure Data Services, Virtual Networking, Identity & Access Management.

Infrastructure as Code: Terraform, ARM Templates, IaC Automation.

Scripting & Automation: Python, PowerShell, Azure CLI, Bash, SQL.

Security: Microsoft Entra ID, RBAC, Managed Identities, Service Principals, Microsoft Purview.

Monitoring: Azure Monitor, Log Analytics, Performance Monitoring, Observability.

Preferred Skills: GitHub Actions, Docker, Kubernetes (AKS), Azure Synapse Analytics, Azure Data Factory, Databricks, Prometheus & Grafana, MLOps and AI Platform Automation, Multi-region Azure Deployments, Azure or Microsoft Fabric Certifications.

Qualification & Experience:

- 5+ years of experience in DevOps, Cloud Platform Engineering, Data Platform Engineering, or SRE roles.

- 3+ years of hands-on Azure and Azure DevOps experience.

- Experience working with Microsoft Fabric or modern Azure Data Platforms.

- Strong understanding of CI/CD, Infrastructure as Code, and deployment automation.

- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

- Excellent troubleshooting, communication, and stakeholder management skills.

Poonam Phule

Skills

DevOps, Microsoft Fabric, Azure, Terraform, CI/CD, Python, PowerShell, Microsoft Purview, CI/CD Pipeline