{"id":2865133,"url":"https://alion.io/job/incubator-for-ai-ai-evaluation-engineer-data-scientist","title":"AI Evaluation Engineer (Data Scientist)","company":{"id":1787286,"name":"Incubator for AI","domain":"ai.gov.uk","url":"https://alion.io/company/ai-gov-uk","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":["GB"],"hiring_countries_total":1,"salary":{"min":45740,"max":59835,"currency":"GBP","period":"year","gross":null,"usd_annual":80094},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Python","optional":false}],"status":"live","first_seen_at":"2026-10-19T16:51:01Z","employer_posted_date":"2026-10-22","last_verified_at":"2026-10-25T12:10:52Z","board_verified":true,"closed_at":null,"days_open":5,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":5},"description":"Applications for this position close on 3rd November 2026 - 23.45pm UK Time\nIncubator for AI, i.AI\nHelp shape how people interact with some of the most ambitious AI products in government\nThe Incubator for AI (i.AI) is a team of ~80 builders and operators using frontier AI to improve public services across healthcare, education, planning and parliament. We combine startup pace and autonomy with the opportunity to tackle national-scale challenges.\nWe operate under three core principles: \nTalent: We bring together the UK’s best AI talent across a range of functions. You will work alongside exceptional researchers and top government leaders, staying at the cutting edge of technology. \nInnovation: We set precedents for what is possible in government. We combine the pace of a start-up with the influence of being at the digital centre of government. You will test new ideas, expand what is possible, and leverage unique government data to create novel solutions. \nImpact: We are dedicated to using AI as a tool for public good - this can mean improving outcomes in schools, boosting housebuilding or providing more personalised support for those in need. With the backing of the Prime Minister, you will turn technical breakthroughs into real-world applications that affect millions of citizens. \nAbout the role\ni.AI’s Impact and Evaluation team builds evaluation into each stage of product development, from scoping and incubation through to scaling. Team members embed within product development teams, designing and delivering robust evaluations throughout the product journey to inform product decisions and, ultimately, understand their impact on the quality and efficiency of public service delivery.\nThe team is now recruiting for two AI Evaluation Engineers, to implement evaluation methods and run evaluation experiments across AI products. These roles will focus on model-level evaluation, including assessment of accuracy, bias and safety.\nWhat you will work on\nDesign and build evaluation pipelines and experiments for AI products\nRun model and system evaluations to assess accuracy, bias, safety and overall performance\nWork closely with product and engineering teams to embed evaluation throughout the product lifecycle, from early scoping through to scaling\nPartner with domain experts to create and maintain high-quality golden datasets and evaluation benchmarks\nAnalyse evaluation results and turn findings into clear, practical recommendations for product teams\nHelp teams understand the impact of AI products on the quality and efficiency of public service delivery\nContribute to reports, presentations and other outputs that communicate evaluation findings to technical and non-technical audiences\nSupport the development of robust evaluation approaches that can be reused across different AI products and services\nWho we think will thrive in this role\nYou may be a strong fit if you bring some of the following:\nExperience in a scientific, analytic or engineering role\nExcellent analytical and critical thinking skills, with the ability to synthesise complex information and draw insights from data\nPractical knowledge of experimental design and statistical hypothesis testing\nProficient in Python\nAbility to use version control tools (e.g. git)\nExperience of evaluating generative or predictive AI/ML systems\nExperience of working as part of a software development team\nAbility to communicate technical work to a broad audience\nWhat we offer\nCareer-defining projects with outsized impact\nBacking from the Prime Minister and No10 to scope and build transformative AI projects. \nUnique opportunities to apply technology that could transform the public sector and impact citizens’ lives.\nTalented, supportive and mission-driven colleagues.\nResources & access\nAccess to frontier models and ample compute.\nExtensive operational, product, strategy, design and delivery support so you can focus on shipping.\nWork with experts across national security, policy, AI research and adjacent sciences.\nGrowth & empowerment\nA team culture and development support that prioritises personal growth.\nOpportunities to own important products early and develop them in small empowered teams.\n5 days off learning and development, annual stipends for learning and development and funding for conferences and external collaborations.\nLife & family*\nOpportunity to work from London, Manchester or Bristol offices.\nHybrid working, flexibility for occasional remote work abroad and stipends for work-from-home equipment.\nGenerous annual leave - 25 days plus one additional day for each year of service\nGenerous paid parental leave (up to 39 weeks full pay + option for additional unpaid time).\nOn top of your salary, we contribute 28.97% of your base salary to your pension.\nDiscounts and benefits for cycling to work, dental insurance, donations and retail/gyms.\n*These benefits apply to direct employees. Benefits may differ for people joining through other employment arrangements such as secondments.\nSalary\nSalary is paid within the range shown below. As this is a GDaD role, the maximum salary includes a non-pensionable technical allowance, and successful candidates will be appointed somewhere within that range depending on assessment of skills demonstrated during the interview process. Base salary for candidates joining from outside the civil service be the minimum of the pay band.\nNational: £45,740 - £59,835 (maximum includes non-pensionable technical allowance of up to £9,000)\nLondon: £48,540 - £62,970 (maximum includes non-pensionable technical allowance of up to £9,000)\nWant to find out more about the role?\nJoin our virtual Q&A on Tuesday 27 October, 12-1pm, to hear from the team about what it’s like to be an AI Evaluation Engineer at i.AI. Link below to join: https://teams.microsoft.com/l/meetup-join/19%3ameeting_NjAzZmQ2MDQtZTQ5Ni00MGQ4LThjNjYtOTc1MDUwYzZjMTNl%40thread.v2/0?context=%7b%22Tid%22%3a%22cbac7005-02c1-43eb-b497-e6492d1b2dd8%22%2c%22Oid%22%3a%22a120bdf1-3549-42a0-a8fd-95244a9d8a0f%22%7d \nSelection Process\nAppointment is conditional on successfully completing UK Government SC clearance. Prior clearance is not required-we will sponsor and support you. You should normally have been resident in the UK for 2 of the past 5 years. Employment is conditional on obtaining and maintaining the required clearance(s). More detail on clearance eligibility can be found on the UK Government website: National security vetting: clearance levels - GOV.UK\nIn accordance with the Civil Service Commission rules, the following list contains all elements of the selection process.\nCandidates should expect to go through some or all of the following stages once an application has been submitted:\nPreliminary call - a short initial conversation with members of the team you’d be joining\nTechnical interview - a live online technical assessment\nBehavioural interview - focused on your previous experience and how you approach different workplace situations\nSenior leadership conversation - a final discussion with members of the senior leadership team\nDiversity and Inclusion\nThe Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window). As part of the application process, we monitor statistics on D&I. You can see how we process this data here: Recruitment privacy notice - GOV.UK.\nSalary\n£45,740—£62,970 GBP","description_format":"text","description_chars":7526,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Annual leave","Dental insurance","Hybrid work","Parental leave"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","National Security","Digital Government"],"lifecycle":[{"event":"open","at":"2026-10-19T17:29:50Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.902,"p_room":1,"age_days":5,"expected_fill_days":27,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-10-25T05:49:26Z"},"pay":{"stated_usd_annual":80094,"is_top_pay":false},"html_url":"https://alion.io/job/incubator-for-ai-ai-evaluation-engineer-data-scientist","json_url":"https://alion.io/job/incubator-for-ai-ai-evaluation-engineer-data-scientist.json","meta":{"generated_at":"2026-10-25T13:45:23Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":19631,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-26T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1787286},"rest":"https://alion.io/mcp/rest/get_company?id=1787286"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fincubator-for-ai-ai-evaluation-engineer-data-scientist"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fincubator-for-ai-ai-evaluation-engineer-data-scientist"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fincubator-for-ai-ai-evaluation-engineer-data-scientist"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/incubator-for-ai-ai-evaluation-engineer-data-scientist\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fincubator-for-ai-ai-evaluation-engineer-data-scientist"}]}