2,461,237open jobs
149,644companies
318,579added this week
Browse all
Salary
$200k – $250k per year
Location
Remote (United States)
Seniority
Senior
Visa
H-1B filings in 12 months: 1 · for this role: 1

Confirmed on the employer's own hiring board on Nov 22, 2026. First seen by Alion on Mar 2, 2025. You.com scores B on the Alion truth index.

Overview
Company
Impact
Profile match
You.com builds AI search and research infrastructure for developers and enterprises, having moved away from its original consumer search engine. It offers Web Search, Contents, Answer, Research and Finance Research APIs, an MCP server and the ARI research agent, and its platform routes each task across multiple data sources and models. Founded in 2020 in Palo Alto by former Salesforce researchers Richard Socher and Bryan McCann, it handles more than a billion queries a month for customers such as DuckDuckGo, Windsurf and Harvey and raised a $100 million Series C led by Cox Enterprises in 2025.

About Us

At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge layer that agents, applications, and enterprises rely on to retrieve real-time, accurate, and citation-backed information.

Our platform combines proprietary vertical indexes with LLM-optimized retrieval systems to power AI agents, applications, and enterprise workflows. We are solving hard problems across search, large language models, and large-scale infrastructure to make AI systems more reliable, transparent, and useful.

Our team includes engineers, researchers, product builders, and operators who care about solving meaningful problems and delivering real-world impact. Whether you are improving core infrastructure, shaping product experiences, or helping bring new AI capabilities to market, your work will help define how modern AI finds and uses knowledge.

About the Role

Every model call from our products and customers passes through one layer: our inference gateway. It allows users to select a model and we intelligently route the call to optimize on cost , latency and high availability. We are now building the control plane above it, to manage and govern access, performance and cost.  

You will own and scale that gateway. The work sits between model serving and product: routing and fallback across hosted providers and our own models, cache-aware routing decisions, metering accurate enough to bill on, and enforcement on the request path within a single-digit-millisecond budget.

This is a remote position open to candidates based anywhere in the United States. We give preference to candidates in the San Francisco Bay Area or New York, where we have offices, but we are happy to consider strong remote candidates elsewhere in the US.

Responsibilities

  • Own the inference gateway that every model call routes through, including provider and model selection, fallback, and caps
  • Build intelligence layer to autonomously pick the right model for the right turn in the task 
  • Make routing decisions that account for prefix-cache behavior, batching, and time to first token, not only price and availability
  • Build cost attribution and metering across providers, including cached-token accounting, accurate enough to bill and enforce on
  • Build request-path enforcement that degrades gracefully and never takes down a customer's inference call
  • Ship inference-time changes in shadow mode first, with the measurement to prove they work

Qualifications

  • Hands-on production experience with model serving on stacks such as vLLM, SGLang (or similar platforms), with a working understanding of continuous batching, KV and prefix caching, and the tradeoff between time to first token and throughput
  • You have tuned a serving stack against live traffic and know what moves p99 in practice, not only in theory
  • Fluency across provider APIs: tokenization, prompt-caching semantics, and the differences in how usage and cached tokens are reported and priced
  • Experience building or operating a proxy, gateway, or data plane on the critical path of production traffic, with sound instincts for failing open
  • Comfort with streaming responses and the parts that get awkward: partial state, mid-stream failures, and work that can only happen once the stream closes
  • A strong backend generalist (Python, Kubernetes). We expect you to pick up whatever you have not touched yet
  • We weigh trajectory and recent growth more heavily than years of experience

Nice to Have

  • Experience at an inference provider or GPU cloud, or contributions to an open-source serving stack
  • Fine-tuning and evaluating models in production
  • Usage metering, billing, or cost optimization at scale

Our salary bands are structured based on a combination of geographic tiers and internal leveling. Compensation is determined by multiple factors assessed during the interview process, with the final offer reflecting these considerations.

Salary Band

$200,000—$250,000 USD

Company Perks:

  • Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions

  • Flexible PTO with U.S. holidays observed and an end of year shutdown in December to rest and recharge*

  • A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*

  • Function Health membership
  • 12 weeks of paid parental leave in the US*

  • 401k program, 3% match - vested immediately!*

  • $500 work-from-home stipend to be used up to a year of your start date*

  • $600 technology stipend to support a portion of our hybrid/remote team's cell phone and internet expenses*
  • $1,200 per year Health & Wellness Allowance to support your personal goals*

  • The chance to collaborate with a team at the forefront of AI research

*Benefits eligibility varies by employment type and tenure.

You.com participates in E-Verify. We will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee’s Form I-9 to confirm work authorization. (English/Spanish: E-Verify Participation /Right to Work) We are also an inclusive, equitable, and accessible workplace. Please let us know if you require accommodation for any portion of the recruitment and hiring process.

Beware of Recruiting Scams:

You.com will only contact you through official @You.com  email addresses and will never ask for payment or sensitive personal information during the hiring process.

Use of AI Tools During Our Hiring Process:

At You.com, we're thoughtful about how we use AI throughout our business - including our hiring process.

During certain stages of the interview process, we may use AI-powered tools to assist with administrative tasks such as scheduling, note-taking, transcription, or summarizing interview discussions. These tools are intended to support our interviewers by improving accuracy and efficiency - they do not make hiring decisions or replace human judgment.

All employment decisions are made by our recruiting team and hiring managers based on a holistic review of each candidate and applicable evaluation criteria.

If AI-assisted note-taking or transcription may be used during your interview, we will notify you in advance. If you prefer not to participate in an interview that uses these tools, you may opt out by informing your recruiter before your scheduled interview. We will work with you to provide an alternative interview experience where reasonably practicable.

Information collected during the hiring process is handled in accordance with our Privacy Policy and applicable law. By continuing with the application process, you acknowledge that you have read this notice. If AI-assisted tools are used during your interview and you have not opted out after receiving notice, you consent to their use as described above, where permitted by applicable law.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,461,237 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
San Francisco
Remote (Europe) · Full-Time · 5+ years exp
Python
JavaScript
TypeScript
SQL
C#
C#
ASP.NET Core
Entity Framework Core
MassTransit
Databases
Azure SQL Database
AI/ML
Function Calling
AI Agents
LLM
Frontend
React.js
Mobile
Clean Architecture
DevOps
Azure
CI/CD
Docker
Kubernetes
Azure AKS
Analytics
Azure Data Factory
Apply
$300k – $400k per year · Hybrid · Full-Time · 5+ years exp · PhD · San Francisco · Bellevue
Python
AI/ML
Machine Learning
DevOps
CI/CD
Apply
$70k – $80k per year · In office · Full-Time · 2+ years exp · Bachelor's Degree · San Diego
Python
JavaScript
TypeScript
Databases
PostgreSQL
ElasticSearch
AI/ML
LLM
Frontend
Vue.js
D3.js
Angular
React.js
Sass
DevOps
Ansible
CI/CD
Docker
Ubuntu
Nginx
GitHub
Linux
Apply
Remote (Vietnam) · Full-Time · 5+ years exp · Vietnam
Java
PHP
SQL
Ruby
Java
Spring Boot
Databases
PostgreSQL
DevOps
Rest API
CI/CD
Docker
Kubernetes
Apply
In office · Full-Time · Waterbury
Apply
$152k – $223k per year · Remote (United States) · Full-Time · PhD · San Francisco
JavaScript
SQL
Databases
Databricks
Apache Kafka
DevOps
Rest API
Cybersecurity
FedRAMP
Analytics
ETL/ELT
Management
ServiceNow
ITSM
Apply
Founding Engineer 1 day ago
$100k – $160k per year · Equity 1–4% · In office · Full-Time · San Francisco
Apply
$440k – $500k per year · In office · 10+ years exp · New York · San Francisco
Apply
$240k per year · Equity 0.5–2% · In office · Full-Time · 3+ years exp · San Francisco
Go
Rust
TypeScript
Databases
PostgreSQL
AI/ML
Model Context Protocol
AI Agents
Multi-Agent Systems
DevOps
Docker
Kubernetes
Linux
Apply
$127k – $159k per year · Hybrid · 6+ years exp · Bachelor's Degree · San Francisco
Design
AutoCAD
Apply
See all jobs
This is one of many
2,461,237 more open roles from verified company boards, updated every day.