{"id":3616483,"url":"https://alion.io/job/acuity-analytics-senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics","title":"Senior Applied AI Engineer (GenAI & LLM Evaluation) - Acuity Analytics","company":{"id":1989419,"name":"Acuity Analytics","domain":"acuityanalytics.com","url":"https://alion.io/company/acuityanalytics","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"JazzHR","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United Kingdom"],"countries":["GB"],"hiring_countries":["GB"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-02T16:40:58Z","employer_posted_date":"2026-11-02","last_verified_at":"2026-11-05T00:47:32Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"About Us\nAscent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.\nAbout the role\nWe're looking for a Senior AI & Data Engineer (GenAI & LLM Evaluation) to help build and improve AI-powered data products.\nWorking alongside Data Scientists, Engineers, and Delivery teams, you'll develop scalable data pipelines, build GenAI evaluation frameworks, and deploy production-ready AI solutions. This is a hands-on role where you'll own solutions from design through to deployment while working on cutting-edge Generative AI technologies.\nIf you enjoy solving real-world problems and building practical AI solutions that make an impact, we'd love to hear from you.\nSkills and experience required\nCore skills\n5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.\n\nStrong Python and SQL skills.\n\nHands-on experience with Generative AI and Large Language Models (LLMs).\n\nExperience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.\n\nExperience building and deploying production-ready ML solutions.\n\nStrong understanding of data pipelines, validation, and quality frameworks.\n\nExperience integrating APIs and cloud-based AI services.\n\nSoft skills\nStrong problem-solving and analytical skills.\n\nComfortable owning solutions end-to-end.\n\nExcellent communication and stakeholder management.\n\nExperience working in Agile, cross-functional teams.\n\nConsulting or customer-facing experience is a plus.\n\nWhat you will do\nBuild and maintain scalable data pipelines and workflows.\n\nDevelop evaluation frameworks for GenAI and LLM applications.\n\nCreate and maintain golden datasets for model testing.\n\nEvaluate and benchmark LLM performance.\n\nBuild ML-assisted tools to improve delivery and automation.\n\nDeploy production-ready AI solutions.\n\nWork closely with delivery teams to solve technical challenges.\n\nContinuously improve data quality, automation, and operational efficiency.\n\nWhy join us\nPeople are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive. Check out this page for more details.\nIf you have any questions contact our Talent Acquisition team on ta.admin@acuityanalytics.\nFor more details about Acuity Analytics please see here: Read here.","description_format":"text","description_chars":2769,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-02T16:40:58Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":14,"reasons":["conf:4","velocity","win:early"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/acuity-analytics-senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics","json_url":"https://alion.io/job/acuity-analytics-senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics.json","meta":{"generated_at":"2026-11-05T03:16:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4319,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-06T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1989419},"rest":"https://alion.io/mcp/rest/get_company?id=1989419"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Facuity-analytics-senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Facuity-analytics-senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Facuity-analytics-senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/acuity-analytics-senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Facuity-analytics-senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3616483}},{"tool":"search_jobs","arguments":{"company":"acuityanalytics.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3616483},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}