{"id":9598,"url":"https://alion.io/job/prolific-human-data-quality-engineer-founding-team-","title":"Human Data Quality Engineer (Founding Team)","company":{"id":30,"name":"Prolific","domain":"prolific.com","url":"https://alion.io/company/prolific","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":79,"open_postings":16,"ghost_share":0,"stale_share":0.625,"repost_share":0,"time_to_fill_p50_days":64,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United Kingdom"],"countries":["GB"],"hiring_countries":["GB"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":70000,"max_usd":144000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":9},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Edge AI","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"Red Teaming","optional":false},{"name":"RLHF","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-07-21T13:15:02Z","employer_posted_date":"2026-07-21","last_verified_at":"2026-10-17T22:09:20Z","board_verified":true,"closed_at":null,"days_open":88,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":88},"description":"Human Data Quality Engineer (Founding Team) \nProlific\nProlific isn’t just enabling AI innovation - we’re redefining it. While foundational AI technologies are becoming commoditized, Prolific’s human data infrastructure provides the high-quality, diverse data required to train the next generation of AI models. Through our platform, we empower researchers and companies to access a global, ethically curated participant base, ensuring cutting-edge AI research and training grounded in inclusivity and precision.\nThe Role\nAs one of the founding members of Prolific's newly formed AI Data Services team, you'll help build the quality systems behind some of the world's most advanced AI models. Data quality is a strategic priority for Prolific, so this is a high-visibility role with direct exposure to senior stakeholders. This isn't a traditional QA role. We are not looking for someone to review data against a predefined checklist. We are looking for an innovative thinker that can leverage their expertise to define what good means where no definition exists yet.\nActing as a strategic thought partner, you’ll work at the intersection of human data, machine learning, evaluation across frontier use-cases that define what high-quality human data looks like for the next generation of advanced AI. This means that much of the work involves novel problems with no established answer, so you’ll be comfortable working through ambiguity.. . \nYour primary focus is working directly with clients and alongside frontier AI labs, translating what their models need into robust human data and evaluation strategies. Rather than checking quality at the end of a project, you'll engineer quality into every stage of the lifecycle, from study design and participant strategy through to evaluation, launch readiness and client delivery.You will also work alongside our product engineering, and supply teams to define and build the quality infrastructure that will enable us to deliver high quality human data at scale.\nMuch of the work you'll tackle won't have an existing playbook. You'll help create it.\nWhat You’ll Be Doing\nDesign the quality frameworks that underpin complex human data programmes, from evaluation rubrics through to launch readiness.\nWork with clients as a strategic thought partner, challenging annotation schemas and data requirements when they won't produce the signal the model needs. \nAdvise on project design and how the choice of schema can impact data quality.\nBuild quality upstream across the operational workflow, from recruitment, screening, and training through to writing guidelines and running calibration sessions. \nBuild scalable quality systems, measurement frameworks and automated checks using Python and SQL.\nPartner with product and engineering to build the quality infrastructure that delivers high-quality human data at scale.\nInvestigate data quality and integrity issues, identifying root causes and turning insights into scalable improvements.\nArchitect and build dashboards, monitoring and reporting that provide clear visibility into quality and operational performance.\nRaise the quality capability across the company, upskilling operations and acting as a thought mentor to junior analysts.\nHelp define how Prolific approaches quality across new AI domains, shaping best practice as the team grows.\nWhat You’ll Bring to the Role\n5+ years of experience in building quality, evaluation or annotation systems within AI, machine learning, LLMs or human data environments.\nStrong Python and SQL skills, with a passion for using data to solve complex quality problems.\nA solid understanding of machine learning pipelines and how human data impacts model performance.\nStrong analytical and statistical thinking, with experience designing scalable quality frameworks.\nThe confidence and credibility to interact with stakeholders at frontier labs and act as a partner.\nThe ability to leverage your experience and expertise to influence and guide stakeholders at every level, both client side and internally. in\nThe ability to turn your own data analysis and quality methodology into requirements that product and engineering can build into systems.\nThe ability to explain yout data analysis and findings clearly to non-technical stakeholders, so they can act on them. \nA proactive, builder's mindset -you enjoy creating new systems, navigating ambiguity and improving how things work.Even Better if you have:\n\nExperience with LLM evaluation, RLHF, AI safety or red teaming.\nExperience translating vague model or evaluation goals into clear annotation specifications. \nExperience working with human annotation programmes or human data operations.\nFamiliarity with calibration, inter-rater agreement, drift detection or other evaluation methodologies.\nWhy Prolific is a great place to work\nWe've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioral data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.\nWe believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviors into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation - one that reflects the breath and the best of humanity.\nWorking for us will place you at the forefront of AI innovation, providing access to our unique human data platform and opportunities for groundbreaking research.\nJoin us to enjoy a competitive salary, benefits, and remote working within our impactful, mission-driven culture. At Prolific, our compensation packages for eligible roles include base salary, equity, and benefits. Many roles also include the opportunity to earn a cash variable element, such as a bonus or commission. Each job posting shows a salary range that reflects the minimum and maximum target for new hires, based on the role’s location as well as your skills, experience, and relevant education or training. Your recruiter will also be happy to share the specific salary range for your preferred location during the hiring process.\nLinks to More Information\nWebsite \nYoutube \nBenefits \nExternal Handbook \nPrivacy Statement\nBy submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal information.","description_format":"text","description_chars":6798,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","LLM & Generative AI","Market Research","AI Research Labs"],"lifecycle":[{"event":"open","at":"2026-07-21T13:15:02Z"}],"visa":[],"liveness":{"score":24,"band":"cold","label":"Long shot","p_open":1,"p_active":0.549,"p_room":0.44,"age_days":87,"expected_fill_days":64,"reasons":["conf:3","stale_co","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/prolific-human-data-quality-engineer-founding-team-","json_url":"https://alion.io/job/prolific-human-data-quality-engineer-founding-team-.json","meta":{"generated_at":"2026-10-18T00:29:57Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":920,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":30},"rest":"https://alion.io/mcp/rest/get_company?id=30"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fprolific-human-data-quality-engineer-founding-team-"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fprolific-human-data-quality-engineer-founding-team-"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fprolific-human-data-quality-engineer-founding-team-"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/prolific-human-data-quality-engineer-founding-team-\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fprolific-human-data-quality-engineer-founding-team-"}]}