{"id":2109250,"url":"https://alion.io/job/path-research-engineer-ai-digital-data","title":"Research Engineer, AI, Digital & Data","company":{"id":5613,"name":"PATH","domain":"path.org","url":"https://alion.io/company/path","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":81,"open_postings":26,"ghost_share":0,"stale_share":0.962,"repost_share":0,"time_to_fill_p50_days":21,"computed_at":"2026-10-09T06:01:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":92000,"max_usd":244000,"period":"year","method":"role_country_seniority_unknown","sample_n":127},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Docker","optional":false},{"name":"Edge AI","optional":false},{"name":"GCP","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"NLP","optional":true},{"name":"Playwright","optional":true}],"status":"live","first_seen_at":"2026-10-08T21:39:29Z","employer_posted_date":"2026-10-08","last_verified_at":"2026-10-09T18:22:22Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"PATH current employees - please log in and apply Here\nPATH is a global nonprofit dedicated to achieving health equity. With more than 40 years of experience forging multisector partnerships and with expertise in science, economics, technology, advocacy, and dozens of other specialties, PATH develops and scales up innovative solutions to the world’s most pressing health challenges.\nAbout AI for Health\nPATH’s Artificial Intelligence (AI) Initiative is our flagship technical team working across divisions to deliver best-in-class evaluation and implementation of AI in health, spanning model evaluation to product development and service innovation. We aim to use AI to address the world’s largest health inequities.\nWe’re looking for a research engineer to build and run evaluation pipelines that PATH will use to test whether different AI models and products can provide safe and effective mental health/wellbeing support for those most in need. This will include developing simulated users, grounded in data from South Africa, Kenya, Ghana, and the UK, and automated (LLM) judges to score simulated conversations against behaviours defined by local clinicians and lived experience experts. You will implement, maintain, and execute these pipelines in collaboration with leading AI evaluation labs. You’ll also contribute to tool development and support research across PATH’s AI portfolio, and, where time allows, lead research projects of your own.\nIf you’re a computer scientist and skilled engineer, with experience doing cutting-edge AI research, who wants your work to change how AI is built and used for (mental) health, then this is the role for you!\nResponsibilities:\nBuild and Run Benchmarking Pipelines\nContribute your expertise to deliver efficient and accurate AI evaluation design in global (mental) health.\nRun AI evaluations at scale: create and sample simulated users to hold single- and multi-session conversations with AI models and products, scoring transcripts with automated judges, and gathering results for analysis and publication.\nWork closely with our technical partners (e.g., Transluce, Digital Umuganda) to adapt and co-develop tooling for user simulation, LLM-judging, validation etc. to the countries, languages, models, and products we aim to evaluate.\nKeep our results traceable, reproducible, and (research) publication ready.\nDevelop Tools\nHelp build and maintain tools across our work, such as tooling for user simulation or for integrating local expert input to improve evaluation accuracy.\nWrite well-tested, documented code for open release, and prepare our tooling for long-term stewardship by partner organizations.\nShare knowledge and expertise with our partners and other stakeholders in the countries where we work so that they can learn how to use our tools to perform their own evaluations.\nSupport Research across the Portfolio\nSupport PATH’s AI for Health team to deliver research by contributing ideas, methods, engineering support, and technical expertise.\nWhere time allows, lead discrete research projects of your own, and publish the results.\nThis is a full-time post based in London. You’ll report to PATH’s Deputy Director for AI for Health and work closely with our technical partners. This role includes occasional international travel (around 5% of time).\nRequired Skills and Experience\nBSc or MSc in computer science, software engineering, or a related technical field, or equivalent practical experience.\nStrong Python skills, with a record of writing well-tested, maintainable code (version control, code review, automated testing, continuous integration).\nProven experience evaluating artificial intelligence models, e.g., an evaluation pipeline, or similar large-scale contributions to research.\nExperience with cloud infrastructure, containers, and data pipelines (e.g., AWS, GCP, or Azure; Docker).\nAbility to work independently with external technical partners, and to explain technical work clearly to clinical, research, and policy colleagues.\nAbility to handle sensitive data, including mental health content, with care.\nPreferred Skills & Experience\nUnderstanding of the current AI safety literature, and an interest in topics relevant to alignment with positive health outcomes.\nExperience building or running healthcare-specific AI evaluations or benchmarks.\nExperience automating interaction with web or mobile apps (e.g., with Playwright for end-to-end testing).\nExperience with multilingual NLP.\nExperience contributing to or maintaining open-source software.\nExperience with frontend deployments.\nWe know great candidates won’t always meet every listed qualification. Research shows that some groups, on average, are more likely to self-select out if they feel they don’t meet all requirements. If you’re excited about the role and think you’d be a good fit, we encourage you to apply.\nTo be selected, you must have legal authorization to work in the United Kingdom.","description_format":"text","description_chars":4947,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Health Care","Vaccines","Nonprofits & Foundations","Infectious Disease Therapeutics"],"lifecycle":[{"event":"open","at":"2026-10-08T21:39:29Z"}],"visa":[],"liveness":{"score":60,"band":"ok","label":"Likely open","p_open":1,"p_active":0.602,"p_room":1,"age_days":0,"expected_fill_days":21,"reasons":["conf:3","stale_co","win:early"],"computed_at":"2026-10-09T06:01:00Z"},"pay":null,"html_url":"https://alion.io/job/path-research-engineer-ai-digital-data","json_url":"https://alion.io/job/path-research-engineer-ai-digital-data.json","meta":{"generated_at":"2026-10-10T01:57:11Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":3456,"day_limit":5000,"remaining_today":1544,"minute_limit":60,"resets_at":"2026-10-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5613},"rest":"https://alion.io/mcp/rest/get_company?id=5613"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpath-research-engineer-ai-digital-data"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpath-research-engineer-ai-digital-data"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpath-research-engineer-ai-digital-data"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/path-research-engineer-ai-digital-data\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpath-research-engineer-ai-digital-data"}]}