{"id":4248689,"url":"https://alion.io/job/maki-ai-research-scientist","title":"AI Research Scientist","company":{"id":679502,"name":"Maki","domain":"makipeople.com","url":"https://alion.io/company/makipeople","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Paris, France","London, United Kingdom"],"countries":["FR","GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"EU AI Act","optional":false},{"name":"Fine-tuning","optional":false},{"name":"LoRA","optional":false},{"name":"Machine Learning","optional":false},{"name":"NLP","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"PEFT","optional":true}],"status":"live","first_seen_at":"2026-11-13T10:07:06Z","employer_posted_date":"2026-11-13","last_verified_at":"2026-11-14T01:42:58Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About the Science and AI Team\nThe Science and AI team is at the heart of Maki People. It builds the science and AI behind our platform, from job analysis and assessments to AI interviews and predicting performance. Led by our Head of Science, Aiden Loe, and working closely with our COO, Paul-Louis Caylar, the team brings together business psychologists, psychometricians and AI scientists. Together, they make sure every hiring decision on our platform is accurate, consistent and fair.\nAs Maki grows, the Science and AI team’s job is to show, with evidence, that our approach leads to better hiring decisions.\nAbout the Role\nThe AI Research Scientist works at the intersection of AI, psychometrics and research, ensuring that Maki’s automated scoring systems are scientifically robust, fair, and continuously improving.\n1. Evaluating and testing LLMs for scoring\nAssess the accuracy and reliability of LLMs used for automated scoring, such as structured grids, job-specific skills and multilingual proficiency (written and spoken).\n\nBenchmark closed- and open-source models across assessment types and languages.\n\nTest robustness to prompt variation, input noise and adversarial behaviour such as prompt injection.\n\nExplore prompt engineering and model optimisation, and recommend which models and prompts go into production.\n\n2. Building our own scoring models\nMove our scoring onto self-hosted open-weight models, and fine-tune them on expert-rated data where they can beat frontier models.\n\nCheck every model switch keeps accuracy, reliability and fairness at least as good as today's.\n\n3. Comparing AI with human judgement, and calibrating psychometric models\nDesign studies that compare AI scores with expert ratings, against both individual experts and expert averages, to establish agreement and validity.\n\nDevelop hybrid scoring pipelines with engineering that combine human oversight with AI scoring.\n\nEvaluate and calibrate psychometric models for validity and comparability across populations and test forms.\n\n4. Bias and fairness analysis\nDetect and analyse bias in AI-generated and psychometric scores across demographic groups, including subgroup analysis.\n\nApply mitigation techniques such as reweighting and calibration without losing model performance.\n\nContribute to fairness dashboards and compliance documentation that support transparent model governance.\n\n5. Predictive analytics and performance insights\nModel the relationship between candidate scores and job performance and retention, using large assessment and performance datasets.\n\nDevelop and test models that estimate success probabilities or identify behavioural and linguistic predictors of performance.\n\nWork with data science, implementation and customer success teams to turn findings into recommendations for clients and colleagues.\n\n6. Research output\nPublish reports, papers and conference presentations, internal and external.\n\nExplain technical findings clearly to non-technical colleagues and clients.\n\nAs one of Maki People's early employees, you'll help shape the team's future. \nOur Ideal Candidate\nRequired\nPhD or MSc in machine learning, computational linguistics, data science or psychology.\n\nA track record of publications, such as peer-reviewed papers or conference papers.\n\nHands-on experience evaluating LLMs: designing benchmarks, measuring agreement with human raters, and testing consistency and robustness of model output.\n\nExperience testing AI-driven decisions for fairness and bias.\n\nProficiency in Python or R, with experience in statistical analysis.\n\nClear communication of results to scientific and business audiences.\n\nPreferred\nExperience with NLP techniques for automated scoring.\n\nExperience fine-tuning language models, for example with LoRA.\n\nExperience working with cloud databases and large datasets.\n\nWorking knowledge of psychometric concepts such as reliability, validity and IRT, and how they apply to assessment design and validation.\n\nWorking knowledge of ethical AI, data governance and compliance, such as the EU AI Act.\n\nExperience working with engineering, product and content teams.\n\nApplication Process\nStage 1 - Screening assessment (25 min)\n\nStage 2 - Power skill assessment with our AI agent (15 min)\n\nStage 3 - Hiring manager interview (45 min)\n\nStage 4 - Executive interview (45 min)\n\nStage 5 - Deep-dive technical interview (60 min)\n\nStage 6 - Interview with Co-founder (30 min)","description_format":"text","description_chars":4419,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"France","iso":"FR","kind":"country"},{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["HR & Recruiting AI","Recruiting Software & ATS"],"lifecycle":[{"event":"open","at":"2026-11-13T13:29:10Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":27,"reasons":["conf:3","win:early"],"computed_at":"2026-11-14T04:56:08Z"},"pay":null,"html_url":"https://alion.io/job/maki-ai-research-scientist","json_url":"https://alion.io/job/maki-ai-research-scientist.json","meta":{"generated_at":"2026-11-14T04:56:08Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8127,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":679502},"rest":"https://alion.io/mcp/rest/get_company?id=679502"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmaki-ai-research-scientist"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmaki-ai-research-scientist"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmaki-ai-research-scientist"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/maki-ai-research-scientist\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmaki-ai-research-scientist"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4248689}},{"tool":"search_jobs","arguments":{"company":"makipeople.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4248689},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}