{"id":2373723,"url":"https://alion.io/job/board-intelligence-software-engineer-ai-evaluation","title":"Software Engineer - AI Evaluation","company":{"id":1920002,"name":"Board Intelligence","domain":"boardintelligence.com","url":"https://alion.io/company/boardintelligence","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":null},"role":"Backend","role_family":"Backend","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":["GB"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":65000,"max_usd":163000,"period":"year","method":"role_country_seniority_unknown","sample_n":359},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Machine Learning","optional":true},{"name":"Python","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-10-12T16:13:07Z","employer_posted_date":"2026-10-12","last_verified_at":"2026-10-12T18:08:18Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"The Role\nAI is at the heart of what Board Intelligence builds. Boards and senior leaders rely on our AI to support their most important decisions, so the quality of its output has to be close to perfect.\nWe are looking for a Software Engineer to join our AI team as its dedicated engineer. The team includes prompt engineers and subject matter experts, and you will build the systems they need. Your first priority is our AI evaluation suite: the tools we use to measure and improve the quality of AI output across our products. Over time, you may move on to building one of our AI-powered products.\nYou do not need deep AI or machine learning experience; the team will help you get up to speed quickly. What matters is that you are a strong full-stack engineer who is comfortable in ambiguity and happy to build largely independently, in a field where good practice is still being defined.\nMain Responsibilities\nDesign and build our AI evaluation suite, the systems we use to measure and improve the quality of AI output\n\nBuild across the full stack yourself, from data pipelines and backend services to the front-end tools our experts use\n\nWork closely with prompt engineers and subject matter experts, turning their knowledge into tests, metrics and tooling\n\nHelp define how we measure AI quality, in a field where practices are still forming\n\nMake evaluation processes and results automated as part of our SDLC, so product teams can ship with confidence\n\nOver time, contribute to building our AI-powered products\n\nPerson Specification\nWe are looking for a strong all-round engineer who is comfortable working independently, enjoys ambiguity and wants to work at the forefront of AI quality.\nRequired Skills and Experience\nUpper mid-level to senior professional software engineering experience\n\nExperience building AI powered products or tooling\n\nFull-stack experience across front end and back end\n\nComfort working independently and in ambiguity, setting your own direction\n\nExperience collaborating with non-engineers and turning their expertise into working software\n\nA strong focus on quality, testing and attention to detail\n\nExperience using AI coding tools in your day-to-day work\n\nFluent written and spoken English\n\nNice to haves\nExperience with building evaluation suites for AI products\n\nExperience with Python and TypeScript\n\nExperience building internal tools, testing frameworks or data pipelines\n\nExperience at a startup or in a small team where you built things end to end\n\nWhat good looks like in this role\nAfter three months: the first version of the evaluation suite is running and our engineering teams are using it\n\nAfter six months: evaluations cover all of our AI products and are integrated into the SDLC\n\nAfter twelve months: evaluation is a standard part of how we ship AI, and you are a trusted voice on AI quality across engineering","description_format":"text","description_chars":2862,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Construction Management Software"],"lifecycle":[{"event":"open","at":"2026-10-12T18:08:18Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker","cap_exempt":false,"checked_at":"2026-10-10T06:21:00+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":38,"reasons":["conf:3","win:early"],"computed_at":"2026-10-12T21:48:49Z"},"pay":null,"html_url":"https://alion.io/job/board-intelligence-software-engineer-ai-evaluation","json_url":"https://alion.io/job/board-intelligence-software-engineer-ai-evaluation.json","meta":{"generated_at":"2026-10-12T21:48:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":35605,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1920002},"rest":"https://alion.io/mcp/rest/get_company?id=1920002"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fboard-intelligence-software-engineer-ai-evaluation"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fboard-intelligence-software-engineer-ai-evaluation"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fboard-intelligence-software-engineer-ai-evaluation"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/board-intelligence-software-engineer-ai-evaluation\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fboard-intelligence-software-engineer-ai-evaluation"}]}