DevOps Engineer

We are excited to announce an opening for a DevOps Engineer (Data Platform) at Stolt-Nielsen Digital Innovation Centre. Please find below the details of the role and its responsibilities.

We're looking for a DevOps Engineer to deploy, manage, and maintain the Azure infrastructure that our data platform runs on. You will sit close to the data platform team and be responsible for the full range of Azure resources the platform depends on, from Databricks workspaces and Power BI services to Logic Apps and Function Apps that support custom data ingestion components. A significant part of the role involves building and maintaining CI/CD pipelines in Azure DevOps to deploy and manage data platform resources, including infrastructure, Databricks Asset Bundles (DABS) and application components. You'll use Infrastructure as Code (Bicep) to keep deployments consistent, secure, and repeatable.

Responsibilities:

• Deploy and manage Azure infrastructure for the data platform using Bicep and IaC best practices.
• Build and maintain CI/CD pipelines in Azure DevOps for deploying Databricks resources (including DABS), Power BI, Logic Apps, Function Apps, and other platform components.
• Manage and monitor Databricks workspaces, Power BI services, and supporting Azure resources.
• Configure and maintain networking components to enable secure connectivity between the data platform and cloud and on-premises data sources.
• Deploy and support Logic Apps and Function Apps used for custom data ingestion.
• Collaborate with data engineers and the Data Platform Lead to ensure infrastructure meets platform needs.
• Monitor and troubleshoot Azure resources and pipelines for reliability, performance, and cost efficiency.
• Maintain documentation of infrastructure, deployment processes, and operational procedures.
• Deploy and manage Azure infrastructure for the data platform using Bicep and IaC best practices.
• Build and maintain CI/CD pipelines in Azure DevOps for deploying Databricks resources (including DABS), Power BI, Logic Apps, Function Apps, and other platform components.
• Manage and monitor Databricks workspaces, Power BI services, and supporting Azure resources.
• Configure and maintain networking components to enable secure connectivity between the data platform and cloud and on-premises data sources.
• Deploy and support Logic Apps and Function Apps used for custom data ingestion.
• Collaborate with data engineers and the Data Platform Lead to ensure infrastructure meets platform needs.
• Monitor and troubleshoot Azure resources and pipelines for reliability, performance, and cost efficiency.
• Maintain documentation of infrastructure, deployment processes, and operational procedures.

Requirements:

• Skills Required: Azure Infrastructure as Code (Bicep/ARM). Azure DevOps CI/CD Pipelines. Azure PaaS Services (Logic Apps, Function Apps, App Services). Networking (VNETs, Private Endpoints, Firewalls, hybrid connectivity). Familiarity with Databricks and Power BI infrastructure. Azure Data Services - Fabric/Azure SQL DB. Source control (Git, Azure DevOps Repos). Scripting (PowerShell or Python).
• Experience Range: 5+ years.

Must Have Skills:

• Azure Infrastructure as Code (Bicep/ARM).
• Azure DevOps CI/CD Pipelines.
• Azure PaaS Services (Logic Apps, Function Apps, App Services).
• Azure Data Services - Fabric/Azure SQL DB.
• Networking (VNETs, Private Endpoints, Firewalls, hybrid connectivity).
• Scripting (PowerShell or Python).

Nice to have Skills:

• Experience with Databricks Asset Bundles (DABS) and workspace provisioning.
• Knowledge of Power BI gateway and capacity infrastructure.
• Familiarity with Azure Policy and compliance tooling.
• Experience with monitoring and observability tools (Azure Monitor, Log Analytics, App Insights).
• Experience with Azure API Management (APIM).
• Understanding of DevSecOps and governance automation.

Skills

ARM, Azure, Bicep, CI/CD, DevOps