{"id":57531,"url":"https://alion.io/job/menlo-backend-engineer","title":"Backend Engineer","company":{"id":19297,"name":"Menlo Research","domain":"menlo.ai","url":"https://alion.io/company/menlo","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Backend","role_family":"Backend","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Ho Chi Minh City, Vietnam"],"countries":["VN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Anthropic","optional":false},{"name":"Bootstrap","optional":false},{"name":"ChatGPT","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude","optional":false},{"name":"Function Calling","optional":false},{"name":"Gemini","optional":false},{"name":"LiteLLM","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"OpenAI","optional":false},{"name":"OpenRouter","optional":false},{"name":"Tool Use","optional":false},{"name":"Docker","optional":true},{"name":"Go","optional":true},{"name":"JavaScript","optional":true},{"name":"Kubernetes","optional":true},{"name":"Model Context Protocol","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Python","optional":true},{"name":"Redis","optional":true},{"name":"Rust","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-07-23T03:51:55Z","employer_posted_date":"2026-07-23","last_verified_at":"2026-10-14T02:08:43Z","board_verified":true,"closed_at":null,"days_open":83,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":83},"description":"About Jan\nJan is an open source AI assistant built by Menlo. It began as a private, offline alternative to ChatGPT and has grown into a general purpose agent that runs open models locally on your own hardware, or connects to frontier models like GPT, Claude, and Gemini when you want them. Give Jan a task and it works on its own until the job is done. Built in public around one belief: AI should be open, private, and answer only to you.\nThe Role\nWe are building Jan Router, an enterprise LLM gateway. Think OpenRouter, but for organizations: one gateway in front of many model providers that routes traffic intelligently and gives an org a single place to manage keys, budgets, quotas, usage, and billing. You will bootstrap it from scratch and own the architecture, the first production deploy, and everything from the request proxy to the billing ledger. This is a lean, agent-native setup. Rather than leaning on a large team, you will orchestrate coding and execution agents to ship at team-scale velocity, while keeping the hard backend judgment to build a billing-grade gateway that does not fall over. The router is your primary charge, but not your only one: you will also contribute to the Jan Agent, wiring agent and tool traffic through the same routing, metering, and controls. You are fluent in trade-offs. You know which parts can ship fast and be hardened later, and which parts, like the money path and auth, have to be right the first time. This role suits a Backend or Software Engineer ready to open a new chapter: working closely with a frontier research team and building real AI services from the bottom up, starting at the model level.\nWhat You'll Do\nBuild the core gateway: a unified, OpenAI-compatible API in front of multiple providers (OpenAI, Anthropic, Google, plus self-hosted and OSS models).\n\nOwn provider routing and reliability: load balancing, automatic failover, and cost and latency-aware routing.\n\nBuild billing and metering that is correct, not approximate: per-request token accounting, usage ledgers, cost attribution per team, user, and key, budgets, and spend limits.\n\nShip org controls: API key management, per-team and per-user quotas, rate limiting, and RBAC.\n\nHandle streaming and performance: low-overhead proxying, streaming responses, connection handling, and caching where it helps.\n\nContribute to the Jan Agent and connect it to the router: route its model and tool calls through the gateway, and make agent traffic first-class in metering, controls, and observability.\n\nMake deliberate speed-versus-correctness calls: move fast where iteration is cheap, refuse to cut corners where a bug means a bad charge or a leaked key, and pay down debt on your own initiative.\n\nWhat We Look For\nWork agent-natively as your default, running multiple agents in parallel, pushing token throughput hard, with your own review and guardrail discipline, using open harnesses like Pi, Hermes Agent, and OpenCode as your daily drivers, on open and frontier models alike.\n\nAcquainted with LLM API systems: providers, OpenAI-compatible endpoints, streaming, tool calling, and token accounting.\n\nExperience with LLM infra: inference proxies, provider SDKs, token counting, or existing gateways and routing services (LiteLLM, cliproxyapi, 9router, Omnirouter, and similar) as reference points.\n\nAcquainted with core AI concepts: context windows, inference, prompting, evals, and how open models differ from hosted providers in practice.\n\nProven ability to ship from zero to production and own the result, including infra, deploy, alerting, and CI/CD, regardless of which stack you did it in.\n\nOpen-minded and pragmatic: you weigh speed against correctness case by case, hold strong opinions loosely, and change course when the evidence says so, all while staying fast-moving and comfortable with full ownership and ambiguity.\n\nNice to Have\nA track record building production backend services that handle real traffic: APIs, auth, data modeling, deploy, and monitoring.\n\nExperience with payments, billing, metering, or usage-based systems, or the rigor to build them correctly (idempotency, reconciliation, no dropped or double charges).\n\nComfort with high-throughput proxying, gateways, and streaming, and the performance concerns that come with them.\n\nSolid datastore skills: PostgreSQL, Redis, queues where needed, and sound schema design for usage and billing data.\n\nStrong in at least one of TypeScript or Python.\n\nComfort with Docker, Kubernetes, OAuth and OIDC, API keys, RBAC, tenant isolation, and secure secrets handling.\n\nFamiliarity with the Jan.ai ecosystem or other OSS LLM tooling.\n\nMCP and tool-calling knowledge, directly relevant since you will help the router carry the Jan Agent's agent and tool traffic.\n\nGo or Rust for high-performance proxying, not required.\n\nContributions to open agent tooling or harnesses: a Pi extension, a Hermes skill, an OpenCode plugin, or anything in the open-models ecosystem we can look at.\n\nWhy Join Menlo\nJan is open-source, built in public, and already in the hands of millions. You will own a real product end to end, work shoulder to shoulder with a frontier research team, drive agents hard to ship at a pace a traditional team cannot match, and set the bar for how a lean, agent-native backend gets built. If you want to be in the arena shipping something that matters, this is the place.\nA Note on AI\nYou don't need deep AI expertise for every role, but we do expect everyone at Menlo to be intellectually curious, drawn to tinkering and discovery, and excited to use AI as a real collaborator in their work. For some roles, AI fluency is a core requirement. When that's the case, we'll say so explicitly in the qualifications. People who thrive here don't treat AI as a novelty. They use it to think better, and make their work easier for others to build on.\nEqual Opportunity and Accommodations\nWe hire talented people from a wide range of backgrounds. If you're excited about a role but don't meet every bullet, we still encourage you to apply. Menlo Research is an equal opportunity employer and does not discriminate on the basis of any legally protected characteristic. Menlo provides reasonable accommodations during the application process. If you need one, please let your recruiter know.","description_format":"text","description_chars":6287,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Vietnam","iso":"VN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Humanoid Robots","AI Research Labs"],"lifecycle":[{"event":"open","at":"2026-07-23T03:51:55Z"}],"visa":[],"liveness":{"score":23,"band":"cold","label":"Long shot","p_open":1,"p_active":0.518,"p_room":0.44,"age_days":82,"expected_fill_days":60,"reasons":["conf:1","win:tail","crowd:"],"computed_at":"2026-10-13T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/menlo-backend-engineer","json_url":"https://alion.io/job/menlo-backend-engineer.json","meta":{"generated_at":"2026-10-14T05:47:15Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7298,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":19297},"rest":"https://alion.io/mcp/rest/get_company?id=19297"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmenlo-backend-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmenlo-backend-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmenlo-backend-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/menlo-backend-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmenlo-backend-engineer"}]}