{"id":3955723,"url":"https://alion.io/job/nominal-staff-research-engineer-agent-evals-post-training-uk","title":"Staff Research Engineer, Agent Evals & Post-training - UK","company":{"id":63575,"name":"Nominal","domain":"nominal.io","url":"https://alion.io/company/nominal","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Gem","truth_index":{"grade":"A","score":86,"open_postings":23,"ghost_share":0,"stale_share":0.565,"repost_share":0,"time_to_fill_p50_days":57,"computed_at":"2026-11-09T06:03:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":180000,"max":220000,"currency":"GBP","period":"year","gross":null,"usd_annual":293851},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Claude Code","optional":false},{"name":"Cursor","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Knowledge Distillation","optional":false},{"name":"LLM","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Model Distillation","optional":false},{"name":"OpenAI Codex","optional":false},{"name":"Post-training","optional":false}],"status":"live","first_seen_at":"2026-11-09T03:26:40Z","employer_posted_date":"2026-11-09","last_verified_at":"2026-11-09T23:21:54Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"About Nominal\nEngineers today are building some of the most ambitious machines humanity has ever seen. They should have AI that’s purpose-built for them.\nNominal is building the Hardware Intelligence Platform that gives engineers increased visibility into complex physical systems, helps them make better decisions, and ultimately gets their products into the real world faster. It brings together the systems, data, intelligence, and applications hardware engineering requires to meet the AI moment. Hardware engineering teams use Nominal to simulate, test, manufacture, and operate the physical systems that keep the world moving, from spacecraft and autonomous vehicles to next-generation energy systems and robotics.\nOur customers span aerospace, defense, manufacturing, transportation, energy, and robotics. They include Anduril, Shield AI, Wisk Aero, Pratt Miller Motorsports, Antares, and Shinkei Systems, amongst others, alongside programs within the U.S. Air Force and Navy. Our team draws from SpaceX, Palantir, Anduril, Applied Intuition, Tesla, and other leading companies, united by a common mission: giving hardware engineers the tools to build the future with speed, safety, and confidence. We're a fast-moving team that owns problems end-to-end, works across disciplines, and thrives at the intersection of hardware and software.\nSome of the world’s leading technology investors, including Sequoia, Lightspeed, Founders Fund, General Catalyst, Lux Capital, and Insight Partners, are backing Nominal’s ambition to change how machines are built and operated. We’re looking for engineers who want to take on hard problems and help make a new generation of world-changing hardware possible.\nAbout Hardware Intelligence\nWe're the team behind Nominal's agents, AI-native applications, and MCP, and its forward-leaning AI bets. Our mission is to unlock the bottlenecks of the hardware lifecycle with AI. Our agents reason over physical reality, from high-rate telemetry and test campaigns to designs and simulations, where real test results are the ground truth their work is checked against. We believe opinionated AI, built for the real work of hardware programs, will change how the world engineers.\nWe're collaborative, iterative, and high-agency, and we're human-centered and customer-focused. We build with the newest AI tools every day, and because those tools keep changing, so do we: we stay curious and keep looking for the better way. Our team spans data science and ML, distributed systems, search, and knowledge systems, and we obsess over how agents can be genuinely useful to the engineers who rely on them.\nThe role\nAs a Staff Research Engineer supporting agent evals & post-training, you'll define how Nominal measures its agents, for customers and for ourselves, and build the path from evals to post-trained models when hardware needs them. Evals come first; post-training follows when air-gapped deployment or cost makes it the right investment.\nWhat you'll do\nBuild eval suites for our agents, the MCP tool layer, and our internal company agent, grounded in real hardware tasks.\nInvent new benchmarks for agents working over physical engineering data, where none exist today.\nBenchmark our agents against frontier agents using our MCP, and show where and why ours win.\nBuild the eval infrastructure: datasets, model-based and human graders, and regression gates in CI.\nTurn evals into reward signals and training data, and lead post-training (fine-tuning, RL, distillation) when we need models we can run anywhere, including air-gapped environments.\nSet Nominal's strategy for measurement and model improvement, working with hardware experts on what \"correct\" means.\nWhat you'll bring\n8+ years in ML engineering or research, including evals or post-training work you led in production.\nStatistical rigor: you design evals that don't fool you, and you know when a difference is real.\nDeep experience evaluating LLM or agent systems, including model-graded evals and their limits.\nHands-on post-training experience: fine-tuning, RL from feedback, or distillation on real tasks.\nThe judgment to know when to measure, when to train, and when a better prompt or tool is the answer.\nA track record of setting technical direction across a team and raising the bar for the engineers around you.\nYou build with modern AI coding agents (Claude Code, Cursor, Codex) every day, and stay curious and open to better ways of working. The tools keep changing, and so do we.\nNice to have\nYou've built evals or post-training at a frontier lab or an AI-native company.\nYou've published benchmarks or eval methods that others use.\nYou've trained or served open-weight models in restricted, on-prem, or air-gapped environments.\nYou've worked in test, reliability, or verification engineering for physical systems.\nBenefits/Perks\n Unlimited PTO and sick leave\n Free lunch, snacks, and coffee\n Professional Development Stipend\n Annual company retreat\n Hardware sensor stipend\n Employee-friendly equity terms\n In-office 5 days per week\nAll qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.\nCompensation\nThe base pay range for this role is £180,000 - £220,000 per year.","description_format":"text","description_chars":5290,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Professional development","Unlimited PTO"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Manufacturing & Industrial Software"],"lifecycle":[{"event":"open","at":"2026-11-09T07:58:04Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":91,"reasons":["conf:4","win:early"],"computed_at":"2026-11-10T04:03:43Z"},"pay":{"stated_usd_annual":293851,"is_top_pay":true},"html_url":"https://alion.io/job/nominal-staff-research-engineer-agent-evals-post-training-uk","json_url":"https://alion.io/job/nominal-staff-research-engineer-agent-evals-post-training-uk.json","meta":{"generated_at":"2026-11-10T04:03:43Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9528,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":63575},"rest":"https://alion.io/mcp/rest/get_company?id=63575"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnominal-staff-research-engineer-agent-evals-post-training-uk"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnominal-staff-research-engineer-agent-evals-post-training-uk"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnominal-staff-research-engineer-agent-evals-post-training-uk"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nominal-staff-research-engineer-agent-evals-post-training-uk\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnominal-staff-research-engineer-agent-evals-post-training-uk"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3955723}},{"tool":"search_jobs","arguments":{"company":"nominal.io","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3955723},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}