{"id":64601,"url":"https://alion.io/job/transluce-ai-behavior-researcher-human-impacts","title":"AI Behavior Researcher - Human Impacts","company":{"id":18851,"name":"Transluce","domain":"transluce.org","url":"https://alion.io/company/transluce","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Gem","truth_index":{"grade":"C","score":62,"open_postings":11,"ghost_share":0.636,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-19T05:45:15Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":250000,"max":450000,"currency":"USD","period":"year","gross":null,"usd_annual":450000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"LLM","optional":false},{"name":"Python","optional":false}],"status":"live","first_seen_at":"2026-04-29T00:30:22Z","employer_posted_date":"2026-08-18","last_verified_at":"2026-10-19T16:54:12Z","board_verified":true,"closed_at":null,"days_open":173,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":173},"description":"Salary range: $250,000 - $450,000/year + benefits\nDescription: Transluce is a fast-moving nonprofit research lab building the public tech stack for AI evaluation and oversight. We are pioneering research into the behaviors of AI chatbots and their effect on user wellbeing, and we’re improving outcomes for millions of sensitive AI interactions with vulnerable users.\nAbout the role: As an AI Behavior Researcher, you will lead projects to design and develop automated evaluations of frontier AI systems that are technically sophisticated, scientifically valid, and concretely impactful. This includes expanding on our existing evaluation pipelines to conduct novel analyses of AI behaviors that affect the autonomy and wellbeing of specific user groups (e.g., children or users located in countries beyond the United States).\nAs an early member of a highly collaborative team, you will learn and grow quickly, and work directly with frontier labs to improve AI evaluations design, with regulators to improve independent oversight of AI, and with domain experts and affected populations to enhance the realism and relevance of our evaluations.\nCore responsibilities:\nDevelop novel, valid automated evaluations of AI’s impacts on users, including their mental health and decision making.\nWrite code to implement and run automated evaluations, such as user simulators or LLM-as-a-judge pipelines.\nDesign methods to improve the ecological validity and realism of automated evaluations for specific populations, such as customizing existing user simulation methods to capture the vocabulary used by children.\nWrite and revise judge rubrics to evaluate model behaviors related to user wellbeing and decision making, systematizing abstract, socially situated concepts into clear measurement criteria.\nCollaborate with scientists and research engineers to productionize best practices in AI behavioral evaluation.\nMinimum qualifications:\nExpertise on quantitative generative AI evaluation and measurement. Good intuition about how to systematize and operationalize complex social concepts.\nRelevant experience designing and validating automated AI evaluation methods, such as LLM-as-a-judge systems or multi-turn benchmarks.\nProficiency in Python to implement analysis and evaluation tooling.\nMeticulous, good experimental design, epistemic self-awareness and transparency.\nAbility to balance between the needs of AI researchers and domain experts, as well as between researchers and senior decision makers.\nStrong communication skills, low ego, openness to giving and receiving feedback.\nPreferred qualifications (not required):\nExperience running automated evaluations at scale or in a production context.\nExperience conducting controlled human subjects experiments to validate automated evaluation methods.\nExperience in customer-facing, consulting, or forward-deployed roles translating ambiguous stakeholder needs into concrete deliverables.\nExperience or training in human-centered design or HCI research methods, including working with domain experts or impacted communities.\nExperience or demonstrated interest in studying AI’s psychological or social impacts, such as for crisis support, manipulation or sycophancy, political persuasion, or displacing human relationships.\nExperience designing multilingual generative AI evaluations.\nExperience and comfort using AI coding agents at work.\nWe are hiring at all levels of experience and would encourage those enthusiastic about the role who do not meet all of the qualifications to apply. We are located in San Francisco and excited to work together in-person. We are open to sponsoring international visas.","description_format":"text","description_chars":3657,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Nonprofits & Foundations"],"lifecycle":[{"event":"open","at":"2026-04-29T00:30:22Z"}],"visa":[],"liveness":{"score":5,"band":"cold","label":"Long shot","p_open":1,"p_active":0.185,"p_room":0.28,"age_days":173,"expected_fill_days":59,"reasons":["conf:0","stale_co","ghost","win:tail","crowd:"],"computed_at":"2026-10-19T05:45:15Z"},"pay":{"stated_usd_annual":450000,"is_top_pay":true},"html_url":"https://alion.io/job/transluce-ai-behavior-researcher-human-impacts","json_url":"https://alion.io/job/transluce-ai-behavior-researcher-human-impacts.json","meta":{"generated_at":"2026-10-19T18:22:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14263,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":18851},"rest":"https://alion.io/mcp/rest/get_company?id=18851"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftransluce-ai-behavior-researcher-human-impacts"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftransluce-ai-behavior-researcher-human-impacts"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftransluce-ai-behavior-researcher-human-impacts"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/transluce-ai-behavior-researcher-human-impacts\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftransluce-ai-behavior-researcher-human-impacts"}]}