{"id":1245213,"url":"https://alion.io/job/openbenchmarks-founding-engineer-ai-backend","title":"Founding Engineer (AI + Backend)","company":{"id":3779219,"name":"Openbenchmarks","domain":"openbenchmarks.com","url":"https://alion.io/company/openbenchmarks","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Work at a Startup","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":100000,"max":120000,"currency":"USD","period":"year","gross":null,"usd_annual":120000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"Firecrawl","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"LLM","optional":false},{"name":"Synthetic Data","optional":false}],"status":"live","first_seen_at":"2026-09-25T17:18:16Z","employer_posted_date":"2026-09-25","last_verified_at":"2026-09-28T00:54:39Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"Founding Engineer (AI + Backend)\nAbout OpenBenchmarks\nAgents are becoming first-class users and consumers of the internet. They research, evaluate, compare tools and increasingly make build-versus-buy decisions on behalf of people. Every company will need to get their products picked and used by agents.\nAgents increasingly prefer open, independent and grounded benchmarks to make decisions.\nOpenbenchmarks is the evaluation infrastructure for agents - domain-specific, reproducible evaluations that help agents pick tools with confidence.\nOur mission is to be the trusted evaluation layer for agents.\nFounders previously led AI research and Infra teams at Oracle and Appfolio;\nWe started Openbenchmarks as an output of our research in the field of model behavior and how agents actually chose between different tools.\nWe're a team of researchers, engineers and work with the fastest growing AI first companies like Parallel, Firecrawl, Telnyx, TinyFish and more.\nAbout the role\nWe're a team of researchers, engineers and theorists, in person in SF. You'll be building the benchmarks and the systems that run them.\nHere are the broad themes that you’ll be working on\nBenchmarks and evals design - designing domain-specific benchmarks from scratch: what to measure, how to ground it, and what makes a benchmark that an agent will continuously trust and pick from.\nContinuously running large-scale autonomous eval systems - infrastructure that runs without a human in the loop: vendor APIs at scale, LLM-as-judge pipelines, scoring and metric computation, drift detection as models and products change underneath.\nResearch - understanding model behavior - why agents choose what they choose, and what survives their scrutiny. Adjacent to this you'll work on synthetic data generation, and problems like self-improvement code/software.\nYou'll build benchmarks & evals that the fastest-growing AI-first companies pay close attention to and produce continuous evals that their engineering teams care about.\nIf you want to do your life's work, reach out.\nIntro Call\nSpend a day in office with the team in SF\n2 day work trial\nAccepted","description_format":"text","description_chars":2128,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","LLM & Generative AI"],"lifecycle":[{"event":"open","at":"2026-09-25T17:18:16Z"}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":40,"reasons":["conf:1","win:early"],"computed_at":"2026-09-27T05:45:00Z"},"pay":{"stated_usd_annual":120000,"is_top_pay":false},"html_url":"https://alion.io/job/openbenchmarks-founding-engineer-ai-backend","json_url":"https://alion.io/job/openbenchmarks-founding-engineer-ai-backend.json","meta":{"generated_at":"2026-09-28T02:39:50Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":1394,"day_limit":5000,"remaining_today":3606,"minute_limit":60,"resets_at":"2026-09-29T00:00:00Z"}}}