2,299,313open jobs
145,909companies
270,197added this week
Browse all
Location
In office (New York)
Seniority
Staff
Visa
H-1B filings in 12 months: 10 · for this role: 7
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 16, 2026. First seen by Alion on Nov 16, 2026. Cohere scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Cohere is a Canadian artificial intelligence company founded in Toronto in 2019 by researchers including one of the co-authors of the transformer architecture paper. It builds large language models aimed specifically at enterprise use rather than consumer chat, with a product line covering text generation, embeddings, reranking and an agent platform, and it emphasises private deployment inside a customer's own cloud or data centre for regulated industries. The company has raised substantial funding from technology and industrial investors, and partners with cloud providers and system integrators to reach banking, healthcare and public sector customers.

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

Why this role?

The Data Infrastructure team at Cohere is responsible for the storage and data movement layer underlying every model training run. We're building the unified storage layer that feeds our training workloads at petabyte scale. In this role, you would have the opportunity to architect and lead the design of this system from the ground up, serving petabytes of training data and model checkpoints fast enough to keep thousands of GPUs busy across several training clusters. You'd be a key contributor, leading the effort to solve a problem few teams have tackled at this scale.

In this role, you will:

  • Design, architect, and operate the distributed storage system that feeds model training and evaluation, driving the technical vision from concept through production.

  • Lead and own the deployment of this system across multiple Kubernetes clusters at petabyte scale, setting standards and best practices for the organization.

  • Collaborate with researchers and training-infra teams to define how jobs read and write data, translating those patterns into throughput, latency, and durability requirements that shape the platform's roadmap.

  • Navigate the networking, I/O, and consistency challenges of moving large datasets and checkpoints across regions and backends, with GPU idle time and time-to-insight as the key metrics of success - and drive the solutions that improve them.

You may be a good fit if you have:

  • Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management, with demonstrated architecture and design experience.

  • Strong coding ability in Python and Go, with the ability to lead implementations and mentor others in either language, and the willingness to contribute to the other.

  • Proven experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets, with the capacity to design and execute operational strategies.

  • Hands-on experience with cloud object storage such as S3 as well as POSIX-style filesystems.

It’s a bonus if you have:

  • Experience with parallel or HPC filesystems such as Weka, VAST, or Lustre, and a track record of applying them at scale.

  • Familiarity with the data-loading and checkpointing patterns used in large-scale model training, with the ability to innovate on them.

  • An interest in how large models are trained and evaluated, including the trajectory and eval data those runs generate, and a desire to understand the workloads the platform is serving - with the capacity to guide others in that understanding.

Full-Time Employees at Cohere enjoy these Perks:

  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

  • Full health and dental benefits, including a separate budget for mental health.

  • RRSP matching, 401K, Pension Scheme.

  • 100% Parental Leave top-up for up to 6 months, for either parent.

  • Annual enrichment benefits:

    Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.

    Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)

  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

How and Where We Work:

  • Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.

  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.

  • For those not near an office: a co-working benefit so you can work alongside others in your city.

  • Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.

We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,299,313 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Remote, many countries
Similar stack
Same company
New York
$110k – $200k per year · Equity · In office · Secret · 7+ years exp · Bachelor's Degree · Dahlgren
Python
Java
PowerShell
C++
Bash
Java
OpenJDK
DevOps
Terraform
Ansible
Helm
GitLab CI
Azure
CI/CD
AWS
Docker
Kubernetes
Ubuntu
GitLab
Linux
Windows
Cybersecurity
SonarQube
Fortify
Chips/EDA
Statistical Process Control
Management
Confluence
Jira
Agile
SpaceTech
SysML
Cameo Systems Modeler
MBSE
Apply
$150k – $200k per year · Hybrid · Full-Time · 6+ years exp · New York
JavaScript
TypeScript
Node JS
AI/ML
AI Agents
Frontend
React.js
Mobile
React Native
DevOps
AWS
Cybersecurity
HIPAA
Apply
$143k – $275k per year · In office · 12+ years exp · Bachelor's Degree · Redmond
Python
JavaScript
Rust
C#
C++
AI/ML
Copilot
Multimodal AI
AI Agents
OpenAI
Copilot Studio
Mobile
Clean Architecture
DevOps
Azure
Kubernetes
Azure AKS
Linux
Windows
Apply
In office · Full-Time · Bachelor's Degree · Atlanta
Java
PHP
AI/ML
Hallucination
LLM Guardrails
DevOps
GCP
Azure
Git
AWS
Docker
Kubernetes
Apply
In office · Full-Time · Atlanta
AI/ML
AI Agents
Hallucination
LLM Guardrails
Apply
Remote (Europe, Israel) · 5+ years exp · Amsterdam · Prague
JavaScript
Node JS
Node JS
Nest.JS
Databases
PostgreSQL
Frontend
React.js
DevOps
Rest API
Docker
Kubernetes
Linux
Apply
Python developer 5 hours ago
$43k – $51k per year · Remote (EAEU) · Moscow
Python
JavaScript
SQL
Python
Flask
FastAPI
Django
Asyncio
Databases
MySQL
PostgreSQL
Redis
RabbitMQ
Apache Kafka
TiDB
Frontend
Socket.IO
DevOps
OpenTelemetry
Git
Docker
Kubernetes
GitLab
QA
Sentry
Apply
$142k – $250k per year · Remote (Europe) · Full-Time · 6+ years exp
JavaScript
TypeScript
Node JS
Databases
PostgreSQL
Snowflake
ClickHouse
CockroachDB
Frontend
React.js
DevOps
Terraform
GCP
Vercel
AWS
Fly.io
IAM
Apply
Product Engineer 6 hours ago
Remote (EAEU) · 3+ years exp · Moscow
Python
Go
JavaScript
Ruby
AI/ML
Cursor
Claude Code
AI Agents
LLM
OpenAI Codex
Frontend
Vue.js
React.js
Apply
Remote (EAEU) · Moscow
Java
Kotlin
SQL
Java
Maven
Spring Boot
Hibernate
Gradle
Kotlin
Mockito
Databases
PostgreSQL
Oracle
RabbitMQ
Apache Kafka
Mobile
JUnit
DevOps
Rest API
Git
Docker
Apply
$36k per year · In office · New York
Apply
$38k per year · In office · Contractor · New York
Apply
$36k per year · In office · Contractor · New York
Apply
$38k per year · In office · Contractor · New York
Apply
$36k per year · In office · Contractor · New York
Apply
See all jobs
This is one of many
2,299,313 more open roles from verified company boards, updated every day.