{"id":86796,"url":"https://alion.io/job/cartesia-researcher-evals","title":"Researcher, Evals","company":{"id":1846,"name":"Cartesia","domain":"cartesia.ai","url":"https://alion.io/company/cartesia","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":88,"open_postings":21,"ghost_share":0,"stale_share":0.286,"repost_share":0,"time_to_fill_p50_days":110,"computed_at":"2026-10-27T05:46:45Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":220000,"max":350000,"currency":"USD","period":"year","gross":null,"usd_annual":350000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":true,"relocation_package":false,"has_equity":true,"technologies":[{"name":"Databricks","optional":false},{"name":"Multimodal AI","optional":false}],"status":"live","first_seen_at":"2025-10-21T00:05:34Z","employer_posted_date":"2025-10-21","last_verified_at":"2026-10-27T15:18:53Z","board_verified":true,"closed_at":null,"days_open":371,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":371},"description":"About Cartesia\nOur mission is to architect AI that learns from and interacts with the world like humans do.\nWe're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models. Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship cutting edge models and experiences.\nWe're funded by leading investors at Index Ventures and Lightspeed Venture Partners, along with Factory, Conviction, A Star, General Catalyst, SV Angel, Databricks and others. We're fortunate to have the support of many amazing advisors, and 90+ angels across many industries, including the world's foremost experts in AI.\nAbout the Role\nThe New Horizons Evaluations team is reimagining how we measure progress in interactive machine intelligence. As Evaluations Lead, you will design evaluation frameworks that capture not just what models know - but how they reason, remember, and interact over time. You’ll work at the intersection of research, product, and infrastructure to develop metrics, systems, and studies that define what “intelligence” means in the next generation of AI. This role is ideal for someone who combines scientific rigor with technical execution, and who’s deeply curious about how people use - and want to use - intelligent systems. Your work will shape how Cartesia builds and evaluates frontier models, ensuring that progress isn’t measured solely by static benchmarks, but by deeper qualities like understanding, naturalness, and adaptability in real-world interaction.\nYour Impact\nIdentify and define key model capabilities and behaviors that matter for next-generation model evals\n\nDevelop and implement new evaluation pipelines with robust statistical analysis and clear reporting\n\nPartner closely with model training and research teams to embed evaluation systems directly into model development loops\n\nPrototype new user studies and behavioral experiments to ground evaluations in real-world use.\n\nWhat You Bring\nExperience designing or implementing evaluation frameworks for generative models (audio, text, or multimodal)\n\nStrong technical and analytical skills, ability to take open-ended research ideas and translate them into production-ready systems\n\nCreativity in defining novel quantitative metrics for subjective or behavioral qualities\n\nExcitement for building evaluation systems that bridge research and real-world use\n\nCuriosity and rigor in equal measure; motivation driven by discovering how to measure meaningful progress in intelligent behavior\n\nNice-To-Haves\nUnderstanding of model alignment concepts and evaluation approaches\n\nNote: Cartesia participates in E-Verify and will provide the federal government with Form I-9 information to confirm employment eligibility after hire.\nMore Details\nIn-office policy: We’re an in-person team based out of offices in San Francisco, London and Bangalore. We love being in the office, hanging out together, and learning from each other every day.\nVisa sponsorship: We provide visa sponsorship support and assess each circumstance on a case-by-case basis. However, visa sponsorship is dependent on many factors, including the role you are applying for, and the location you are going to be based, and so we can't always guarantee success. Your Recruiter will work with you to understand your visa sponsorship needs from the first call.\nWe ship fast. All of our work is novel and cutting edge, and execution speed is paramount. We have a high bar, and we don’t sacrifice quality or design along the way.\nWe support each other. We have an open & inclusive culture that’s focused on giving everyone the resources they need to succeed.\nOur Benefits (US Employees Only)\nCompensation Competitive base salary alongside attractive equity package.\nHealth Insurance Fully covered medical insurance along with dental and vision for you and your family.\nParental Leave 9 weeks paternity & 12 weeks maternity leave\n401(k)\nCommuter Allowance A monthly stipend to help you get to and from the office.\nFlexible PTO Take as much time as you need to recharge your batteries.\nMeals & Snacks Lunch, dinner and plenty of snacks, provided daily.\nYour own personal Yoshi\nOur Commitment to Equal Opportunity\nCartesia is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, or any other legally protected status.","description_format":"text","description_chars":4639,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Health insurance","Parental leave"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Speech & Audio AI","Foundation Models","AI Research Labs","Generative Audio & Music"],"lifecycle":[{"event":"open","at":"2025-10-21T00:05:34Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 18","filings_12m":18,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":272500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":15}],"liveness":{"score":10,"band":"cold","label":"Long shot","p_open":1,"p_active":0.369,"p_room":0.28,"age_days":371,"expected_fill_days":110,"reasons":["conf:3","velocity","win:tail","crowd:"],"computed_at":"2026-10-27T05:46:45Z"},"pay":{"stated_usd_annual":350000,"is_top_pay":true},"html_url":"https://alion.io/job/cartesia-researcher-evals","json_url":"https://alion.io/job/cartesia-researcher-evals.json","meta":{"generated_at":"2026-10-27T20:09:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11152,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-28T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1846},"rest":"https://alion.io/mcp/rest/get_company?id=1846"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcartesia-researcher-evals"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcartesia-researcher-evals"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcartesia-researcher-evals"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/cartesia-researcher-evals\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcartesia-researcher-evals"}]}