{"id":1322983,"url":"https://alion.io/job/nolla-health-founding-research-engineer","title":"Founding Research Engineer","company":{"id":684271,"name":"Nolla Health","domain":"nollahealth.com","url":"https://alion.io/company/nollahealth","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":180000,"max":240000,"currency":"USD","period":"year","gross":null,"usd_annual":240000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Function Calling","optional":false},{"name":"LLM","optional":false},{"name":"Post-training","optional":false},{"name":"DPO","optional":true},{"name":"GRPO","optional":true},{"name":"Multimodal AI","optional":true},{"name":"RLHF","optional":true}],"status":"live","first_seen_at":"2026-09-26T21:59:13Z","employer_posted_date":"2026-09-26","last_verified_at":"2026-10-22T04:08:05Z","board_verified":true,"closed_at":null,"days_open":25,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":25},"description":"The mission\nNolla is building AI doctors so that top-quality healthcare is accessible to everyone. Nolla Derm is the #1 medical skincare treatment app in the U.S. App Store. We've treated thousands of acne patients in the U.S., scanned 1% of Norway's population for skin cancer, and our in-house clinical models are state of the art on clinical benchmarks. We just launched NollaMD, our urgent care app, and we're building dedicated specialty apps for conditions like women’s health. We’ve raised $6.5M from General Catalyst and other strategic investors.\nThe role\nWe have built our own clinical benchmarks, post-trained on them, and produced models that beat frontier performance on clinical tasks. We are in a unique position of both delivering care to real patients and training the models that deliver it. You’ll work on our evals and harnesses, build the data loop with clinicians that feeds them, and lead where they go next.\nYou'll work directly with the founding team and with our post-training partners, and your work reaches patients immediately. This is a hands-on role: you will write code most days, design studies, and be the author of record on what we publish.\nWhat you'll build\nEvals and benchmarks\nDesign and maintain the benchmarks we use to judge clinical accuracy, safety, and documentation quality\n\nExtend them to our agentic system: tool use, long-horizon tasks that span many visits, memory of a patient's history, uploaded records, labs, and escalation behavior\n\nGraders and harnesses\nBuild the grading stack: deterministic checks, rubric graders, and LLM judges calibrated against clinician ratings\n\nImprove the production harness the product runs on\n\nData loop with clinicians\nTurn real, consented cases into eval cases and training examples, with clinician review, de-identification, and provenance built in\n\nRun the clinician review workflows that produce rubrics, labels, and feedback at scale\n\nResearch\nLead our clinical evaluations from protocol through publication, and publish our benchmarks for the field\n\nCollaborate with post-training on reward design and data curation, and run experiments where it helps\n\nWhat you bring\nYou have built eval infrastructure for LLM systems that other people depended on\n\nYou have opinions about contamination, difficulty calibration, judge bias, and reward hacking\n\nYou can write a paper. Authorship on empirical ML work, ideally with a human comparison or a benchmark release\n\nYou are excited to work with some of the best physicians in the country and turn their judgment into model performance\n\nYou've worked on small teams and built things from zero\n\nBonus points\nClinical AI evaluation experience: rubric-based health benchmarks, simulated-patient studies, agentic clinical benchmarks\n\nPost-training experience (RLHF, DPO, GRPO or similar)\n\nExperience with multimodal models\n\nFamiliarity with eval and environment frameworks such as Inspect, Verifiers, or Harbor\n\nRole logistics, compensation & benefits\nRole Type: Engineering\n\nSalary: $180,000-$240,000, based on experience\n\nJob Type: Full-time\n\nWork Setup: In-person, New York City\n\nEquity: Meaningful equity, commensurate with experience\n\nHealth Insurance: Medical, dental, and vision\n\nHSA/FSA: Eligible\n\nTime Off: Flexible, unlimited vacation\n\nAdditional Perks: Meal stipends, team retreats\n\nWork Hours: Flexible but demanding. We're building something that matters\n\nGrowth: Founding team members step into expanded roles as we scale","description_format":"text","description_chars":3462,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Health insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-09-26T23:30:21Z"}],"visa":[],"liveness":{"score":35,"band":"fade","label":"Fading","p_open":1,"p_active":0.641,"p_room":0.55,"age_days":24,"expected_fill_days":23,"reasons":["conf:2","win:tail"],"computed_at":"2026-10-21T05:46:15Z"},"pay":{"stated_usd_annual":240000,"is_top_pay":true},"html_url":"https://alion.io/job/nolla-health-founding-research-engineer","json_url":"https://alion.io/job/nolla-health-founding-research-engineer.json","meta":{"generated_at":"2026-10-22T05:37:02Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":111,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-23T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":684271},"rest":"https://alion.io/mcp/rest/get_company?id=684271"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnolla-health-founding-research-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnolla-health-founding-research-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnolla-health-founding-research-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nolla-health-founding-research-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnolla-health-founding-research-engineer"}]}