Senior Platform Engineer (Azure & Databricks)
SNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.
Responsibilities:
Provision and manage Azure data platform infrastructure and Databricks workspaces using modular Terraform.
Administer Databricks compute, cluster policies, SQL warehouses, and Unity Catalog resources (catalogues, schemas, volumes, external locations).
Implement Azure RBAC, Microsoft Entra ID groups, managed identities, service principals, and Databricks access controls.
Configure secure Azure networking, including VNet integration, private endpoints, private DNS, routing, and firewall controls.
Build multi-stage Azure DevOps YAML pipelines with automated validation, security scanning, approval gates, and deployment controls.
Develop production-grade Bash scripts (integrated with Azure CLI, Databricks CLI, and Terraform) for operational automation and provisioning.
Support platform onboarding, troubleshoot infrastructure and CI/CD issues, and maintain operational runbooks, governance, and cost-optimization standards.
Assist with secondary cloud infrastructure provisioning on AWS as needed.
Skills:
5+ years of experience in Azure cloud or platform engineering.
2-3+ years of production experience with Terraform (reusable modules, remote state, drift management, AzureRM, Entra ID, and Databricks providers).
2-3+ years of hands-on Azure Databricks administration (Unity Catalog, workspace policies, compute, SQL warehouses, access controls).
Advanced proficiency in Azure core services: ADLS Gen2, Key Vault, Microsoft Entra ID, Azure RBAC, Log Analytics, and private networking.
Strong Bash scripting skills for operational automation (error handling, ShellCheck, CLI integrations, secret management).
Deep experience with Azure DevOps (multi-stage YAML pipelines, pipeline templates, Git pull requests, service connections, workload identity federation).
Proven ability to independently troubleshoot complex network, security, and deployment issues.
Nice to have:
Working knowledge of Python (Azure/Databricks Python SDKs, REST APIs) or PowerShell.
Experience with Databricks Asset Bundles (DABs).
Familiarity with Bicep, Azure Policy, policy-as-code, or AWS cloud infrastructure.
Relevant Microsoft Azure, HashiCorp Terraform, or Databricks certifications.
Follow us on Linkedin! http://linkedin.com/company/snisourcing/