368,530open jobs
9,432companies
50,439added this week
Browse all
Salary
$250k – $300k per year
Location
In office (San Francisco)
Seniority
Architect
Employment
Contractor
Overview
Company
Impact
Profile match
Together AI (Together Computer, Inc.) is a full-stack AI infrastructure and cloud platform headquartered in San Francisco, California. Founded in 2022 by prominent AI researchers and system engineers - including CEO Vipul Ved Prakash, CTO Ce Zhang, Chief Scientist Tri Dao (co-creator of FlashAttention), Chris Ré, and Percy Liang - the company operates as an "AI Native Cloud" designed to train, fine-tune, and deploy open-source generative AI models at scale with high performance and optimized unit economics.

About the Role

Together AI is scaling its physical AI infrastructure rapidly - and we're looking for a Director of Data Center Operations to help us build it right. This is a ground-floor opportunity to own the operational foundation of Together's growing data center portfolio across the US and Asia.

You'll be responsible for designing and commissioning white space deployments - taking pre-built environments and fitting them out with the power distribution, cooling distribution, and systems infrastructure needed to run high-density GPU workloads at scale. At the same time, you'll be building the break-fix and smart hands team from scratch: hiring, defining the playbook, and standing up the function that keeps our sites running around the clock.

This is not a steady-state operations role. It's a builder role. You'll be joining a small but fast-moving team, with real ownership over outcomes and the autonomy to shape how Together AI operates its physical infrastructure for years to come. If you've scaled data center infrastructure through hypergrowth before and want to do it again with more ownership - this is that opportunity.

Responsibilities

  • Own the design, fit-out, and commissioning of white space sites across the US and Asia, with a focus on power distribution (PDUs), cooling distribution (CDUs), and IT-adjacent infrastructure
  • Build and lead a ~20-person break-fix and smart hands team from scratch - define the operating model, hire the initial team, and establish the processes and playbooks that keep sites running
  • Manage a portfolio of 5+ sites across two regions in various stages of deployment and live operation
  • Partner with vendors, contractors, and equipment suppliers to drive site deployments to schedule and quality
  • Establish operational standards, runbooks, and escalation processes for a nascent but rapidly growing infrastructure function
  • Serve as the technical authority on data center infrastructure decisions - from white space evaluation through to live production operation
  • Travel to Asia periodically to oversee regional site deployments and support the local team

Requirements

  • Deep, hands-on technical knowledge of data center power and cooling systems at the IT-adjacent layer - PDUs, CDUs, power distribution, and white space fit-out
  • Proven experience designing and commissioning data center infrastructure, from evaluation through to live operation
  • Experience operating data center infrastructure at meaningful scale, supporting large production workloads
  • People leadership experience - you've hired, developed, and led technical operations teams
  • A builder's instinct - you're comfortable standing up teams and functions from scratch, writing the playbook where none exists, and operating with ambiguity
  • Strong vendor and contractor management skills - you know how to hold external partners accountable to timeline and quality
  • Nice to have: experience with GPU or AI infrastructure deployments, multi-site or multi-region portfolio management, or familiarity with Asian markets

About Together AI

Together AI is a research-driven AI infrastructure company on a mission to dramatically lower the cost of modern AI by co-designing software, hardware, algorithms, and models. We believe open and transparent AI systems create the best outcomes for society - and we're building the physical and computational foundation to make that real. Our team has been behind landmark advances including FlashAttention, Hyena, FlexGen, and RedPajama.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy   

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,530 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
San Francisco
$120k – $150k per year • In office • Full-Time • 1+ year exp • Bachelor's Degree • San Francisco
Python
SQL
Databases
Snowflake
AI/ML
dbt
Together AI
Marketing
Amplitude
Salesforce
Apply
$155k – $339k per year (Estimated) • In office • Full-Time • San Francisco
Databases
Databricks
Pinecone
Snowflake
AI/ML
Embeddings
Knowledge Distillation
Multimodal AI
Perplexity
Ray
Together AI
DevOps
AWS
Apply
$56k – $151k per year (Estimated) • In office • Contractor • Bristol
AI/ML
Together AI
Apply
$180k – $350k per year • Equity • In office • Full-Time • 5+ years exp • San Francisco
Python
Rust
Databases
Databricks
AI/ML
LangChain
OpenRouter
Perplexity
Together AI
OpenAI
Post-training
Red Teaming
SFT
AI Agents
Function Calling
DevOps
Cloudflare
Datadog
eBPF
GCP
Kubernetes
Service Mesh
Cybersecurity
Falco
FedRAMP
ISO 27001
SOC 2
Threat Modeling
Zero Trust
Management
Zapier
Apply
$150k – $300k per year • Equity • In office • Full-Time • San Francisco
TypeScript
JavaScript
Databases
Databricks
AI/ML
AI Agents
DSPy
LangChain
LangGraph
LLM
OpenRouter
Perplexity
Ray
Reinforcement Learning
RLHF
SGLang
Synthetic Data
Together AI
vLLM
GRPO
LLM Evaluation
OpenAI
Post-training
SFT
Function Calling
Model Context Protocol
Frontend
Next.js
React.js
DevOps
Cloudflare
Datadog
Docker
Grafana
Kubernetes
Prometheus
Terraform
Management
Zapier
Apply
$120k – $150k per year • In office • Full-Time • 1+ year exp • Bachelor's Degree • San Francisco
Python
SQL
Databases
Snowflake
AI/ML
dbt
Together AI
Marketing
Amplitude
Salesforce
Apply
$36k – $140k per year (Estimated) • In office • Amsterdam
Go
Python
Rust
Databases
Apache Kafka
NATS
AI/ML
CUDA
CUDA Toolkit
Together AI
Human-in-the-Loop
InfiniBand
NCCL
DevOps
Ansible
CI/CD
Kubernetes
Self-Healing
Apply
$30k – $78k per year (Estimated) • In office • 5+ years exp
Go
Python
Rust
TypeScript
Databases
Apache Kafka
NATS
AI/ML
AI Agents
LLM
RAG
Semantic Search
Together AI
Function Calling
Knowledge Graph
Semantic Search
DevOps
ArgoCD
GitOps
Grafana
Incident Management
Kubernetes
Prometheus
Management
Slack
Apply
$140k – $170k per year • Remote • Full-Time • 3+ years exp • San Francisco
SQL
AI/ML
Claude
Claude Code
Together AI
Apply
$200k – $250k per year • Remote • Full-Time • 5+ years exp • San Francisco
Python
SQL
AI/ML
Together AI
InfiniBand
DevOps
HPC
Apply
$223k – $424k per year (Estimated) • In office • Bachelor's Degree • San Francisco
AI/ML
AI Agents
LLM
Recommender Systems
Apply
$83k – $188k per year (Estimated) • In office • 2+ years exp • San Francisco
Python
AI/ML
AI Agents
LLM Guardrails
Model Context Protocol
DevOps
Terraform
Cybersecurity
Crowdstrike
GDPR
Least Privilege
Okta
SentinelOne
Management
Google Workspace
Slack
Apply
$171k – $273k per year • In office • Full-Time • 8+ years exp • PhD • San Francisco • Washington
AI/ML
A2A
Agentforce
AI Agents
Model Context Protocol
DevOps
AWS
GCP
Marketing
Salesforce
Apply
Security GRC Analyst 2 hours ago
$119k – $268k per year (Estimated) • Remote/Hybrid • 4+ years exp • Bachelor's Degree • San Francisco
AI/ML
Ignite
PyTorch
Cybersecurity
ISO 27001
NIST CSF
SOC 2
Apply
$173k – $260k per year • In office • Full-Time • PhD • San Francisco
JavaScript
Node JS
Python
Python
Celery
Django
Flask
Databases
RabbitMQ
Redis
AI/ML
Agentforce
AI Agents
DevOps
Akamai
AWS
CI/CD
Cloudflare
CloudFormation
Helm
Jenkins
Kubernetes
Spinnaker
Terraform
Marketing
Salesforce
Apply
See all jobs
This is one of many
368,530 more open roles from verified company boards, updated every day.