377,351open jobs
9,828companies
48,306added this week
Browse all
Location
In office (Hyderabad)
Seniority
Senior · 8+ years exp
Overview
Company
Impact
Profile match
Run AI products in production with a unified stack for agents, inference, and cloud—built for control, performance, and economics at scale.

We are looking for a Senior Software Engineer II (IC4) who is passionate about distributed systems orchestration, high-throughput API design, and building the multi-tenant control plane that powers Agentic AI applications.

As a Senior Software Engineer II (IC4) at DigitalOcean, you will join a dynamic engineering team dedicated to revolutionising cloud computing and AI. In this role, you will report directly to the Engineering Manager of the Sandbox Team. You will act as the technical anchor for the squad responsible for the entire management tier, user lifecycle, and API orchestration of our sandbox platform. You will design and develop the "brain" of the product, interfacing directly with developer SDKs and coordinating with underlying internal virtualisation services to deliver a seamless, secure, and scalable developer experience.

Responsibilities:

  • Design and scale the core Orchestrator using Go, managing the global state, session lifecycles, and rapid allocation of sandboxes for millions of user requests.
  • Design and implement robust multi-tenant API Gateways and authentication layers to securely isolate customer workloads, rate-limit abuse, and track usage for billing.
  • Build high-performance routing proxies (HTTP/WebSocket/gRPC) capable of instantly tunnelling traffic from external client SDKs directly to internal service endpoints.
  • Manage complex state synchronisation and service discovery patterns using tools like Consul, Nomad, or Kubernetes to ensure high availability across distributed clusters.
  • Own the developer interface, optimising how the control plane surfaces real-time execution telemetry, structured logging pipelines, and file streaming back to the user's application.

Key Metrics:

  • Control Plane API Latency: Maintain sub-20ms overhead for API authentication, routing, and command dispatching.
  • System Uptime and Reliability: Target a 99.99% uptime SLA for the control plane API and proxy layers.
  • Multi-Tenant Isolation: Ensure zero cross-tenant data leaks or unauthorised API access at the control plane level.
  • Token/Session Handover Time: Minimise the time it takes from a user requesting a sandbox to the control plane establishing a secure proxy tunnel.

Requirements:

  • Distributed Systems Mastery: 8+ years of professional software engineering experience, with a heavy emphasis on building large-scale SaaS or PaaS control products using Go (Golang) or similar backend languages.
  • API and Proxy Expertise: Proven experience building high-throughput REST/gRPC APIs, custom reverse proxies, or network routers handling concurrent connection scaling.
  • Orchestration and State Management: Practical experience with cluster schedulers (Nomad, Kubernetes), service meshes, or distributed key-value stores (Consul, Etcd) for real-time state tracking.
  • Data Layer Architecture: Strong experience modelling application state in PostgreSQL and designing high-volume telemetry ingestion pipelines using columnar data stores like ClickHouse.
  • Product-First Mindset: Experience building products designed for other developers (APIs, SDKs, Cloud Consoles) with a deep empathy for developer workflows and latency constraints.
  • Preferred Attributes: Familiarity with the unique orchestration challenges of Agentic AI, LLM orchestration frameworks, or building multi-tenant user platforms.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
377,351 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Hyderabad
In office • Full-Time • 2+ years exp • Bachelor's Degree • Sofia
Bash
PowerShell
Python
DevOps
AWS
Azure
Bicep
Chef
CI/CD
Docker
FinOps
GCP
Kubernetes
Platform Engineering
Puppet
Terraform
Apply
In office • 12+ years exp • Bachelor's Degree
Bash
PowerShell
Python
DevOps
AIOps
Ansible
AWS
Azure
Chef
CI/CD
Configuration Management
Datadog
Docker
GCP
Grafana
Incident Management
Kubernetes
Nagios
Prometheus
Puppet
Rest API
Self-Healing
Service Mesh
Splunk
Terraform
Zabbix
Apply
$15k – $36k per year (Estimated) • In office • Bachelor's Degree • Moscow
Python
SQL
Databases
PostgreSQL
DevOps
Docker
Grafana
KVM
Proxmox VE
QEMU
VirtualBox
Zabbix
QA
Postman
Apply
$29k – $62k per year (Estimated) • Remote/Hybrid • Moscow
C#
C#
.NET
Databases
Apache Kafka
PostgreSQL
DevOps
Docker
gRPC
IAM
Kubernetes
Apply
$78k – $220k per year (Estimated) • In office • Full-Time • 10+ years exp • Bachelor's Degree • Melbourne • Brisbane • Canberra • Sydney
Databases
Databricks
Google BigQuery
Snowflake
BigQuery
AI/ML
AI Agents
Claude
Gemini
LangSmith
LLM
LLMOps
Model Context Protocol
Prompt Engineering
Promptfoo
RAG
Weights & Biases
DevOps
AWS
Azure
CI/CD
Docker
GCP
Vector
Apply
$114k – $142k per year • Equity • Remote • Full-Time • 3+ years exp • Boston
Go
JavaScript
Rust
DevOps
CI/CD
DigitalOcean
Cybersecurity
CVE
Apply
$46k – $100k per year (Estimated) • In office • Bengaluru
Go
Databases
Apache Kafka
MySQL
OpenSearch
PostgreSQL
DevOps
DigitalOcean
Docker
Grafana
gRPC
Kubernetes
Apply
$45k – $97k per year (Estimated) • In office • 15+ years exp • Bachelor's Degree • Bengaluru
Java
Python
Databases
MinIO
DevOps
DigitalOcean
Incident Management
Kubernetes
Platform Engineering
Amazon S3
Apply
In office • 5+ years exp • Bachelor's Degree • Hyderabad
C++
Go
Java
Node JS
C#
JavaScript
C#
.NET
Databases
MySQL
Frontend
React.js
Apply
In office • 5+ years exp • PhD • Hyderabad
Bash
JavaScript
PowerShell
Python
SQL
Databases
Google BigQuery
DevOps
Ansible
Azure
Azure DevOps
CI/CD
GitHub
GitHub Actions
Puppet
Terraform
Analytics
Power BI
Apply
$42k – $91k per year (Estimated) • Equity • In office • Full-Time • Hyderabad
Python
Ruby
Rust
Scala
Databases
DynamoDB
ElasticSearch
PostgreSQL
Redis
Apply
$20k – $47k per year (Estimated) • In office • Full-Time • 7+ years exp • Hyderabad
Design
Figma
Management
Confluence
Jira
Marketing
Salesforce
Apply
Remote/Hybrid • Full-Time • Hyderabad
Bash
Groovy
Java
Python
SQL
JavaScript
Java
Maven
Databases
PostgreSQL
AI/ML
Replicate
Frontend
npm
DevOps
AWS
Azure
Bamboo
CI/CD
Docker
GCP
Jenkins
Kubernetes
Cybersecurity
SBOM
Snyk
Sonatype Nexus IQ
Apply
See all jobs
This is one of many
377,351 more open roles from verified company boards, updated every day.