{"id":1323088,"url":"https://alion.io/job/health-note-senior-ai-product-engineer","title":"Senior AI Product Engineer","company":{"id":3780316,"name":"Health Note","domain":"healthnote.com","url":"https://alion.io/company/healthnote-2","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Kula","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":140000,"max_usd":242000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1195},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"Claude","optional":false},{"name":"Cursor","optional":false},{"name":"OpenAI Codex","optional":false},{"name":"Langfuse","optional":true},{"name":"RAG","optional":true}],"status":"live","first_seen_at":"2026-09-25T23:37:21Z","employer_posted_date":"2026-09-25","last_verified_at":"2026-11-04T19:12:42Z","board_verified":true,"closed_at":null,"days_open":39,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":39},"description":"About Health Note\nHealth Note is building AI-powered digital assistants that act like trusted members of the care team. Instead of rigid, disconnected software modules, our assistants gain skills over time - from handling simple reschedules to managing complex intake, referrals, medication refills, and patient access workflows.\nPatients experience a natural, empathetic interaction while providers gain a system that is reliable, transparent, and continually improving. Our goal is to deliver a concierge experience for every patient and a scalable path to automation for every clinic.\nAbout the Role\nWe're looking for a product-minded engineer who can make AI systems measurably better in production. This is a product engineering role first: you'll write production code, build internal and product-facing systems, and use measurement to decide what to improve next.\nAs a Senior AI Product Engineer, you'll build systems that help us understand how Health Note's Access Agent is performing, where it breaks down, and which changes actually improve outcomes. You'll connect agent behavior, customer workflows, prompts, configurations, and outcome data so we can improve the system with confidence.\nSuccess is measured by whether the systems you build make the Access Agent more reliable, measurable, and effective in production.\nThis is not a pure ML research role or a dedicated evals-platform role. You'll build AI product systems, use measurement to decide what to improve next, and create enough feedback structure to make changes safely.\nThis role is ideal for an engineer who likes ambiguous product problems, trusts data over assumptions, and can turn messy real-world behavior into systems for measurement and improvement.\nResponsibilities\nOwn improvements to the Access Agent from investigation through production rollout, measurement, and follow-up.\n\nBuild practical ways to measure agent performance, including evals, dashboards, review workflows, logs, and production metrics.\n\nAnalyze transfer patterns, containment rates, task success, and operational outcomes to identify improvement opportunities.\n\nBuild tooling and workflows that connect prompts, configurations, interventions, customer workflows, and outcomes.\n\nCreate checks that help us catch regressions before and after changes go live.\n\nPartner with Product, Operations, and Engineering to prioritize and validate improvements.\n\nDesign lightweight experiments and measurement approaches for model, STT, prompt, workflow, and configuration changes.\n\nBuild visibility into agent performance through dashboards, analytics, and reporting.\n\nUse AI-assisted development tools and agentic workflows to accelerate experimentation and delivery.\n\nQualifications\n5+ years of software engineering experience building production systems.\n\nExperience shipping Agentic systems into production and measuring whether they worked.\n\nStrong analytical and problem-solving skills with an ability to translate ambiguous problems into measurable outcomes.\n\nAbility to use metrics, logs, qualitative review, or experiments to understand whether product changes worked.\n\nStrong product instincts and ability to connect technical decisions to business outcomes.\n\nDemonstrated ability to independently own initiatives from problem identification through measurable impact.\n\nExperience using modern AI-assisted engineering workflows (e.g., Claude, Cursor, Codex, or similar tools).\n\nNice to Haves\nExperience building eval frameworks for AI products.\n\nFamiliarity with Langfuse, observability platforms, analytics systems, or experimentation tooling.\n\nExperience with RAG, agent orchestration, prompt management, or workflow automation systems.\n\nExperience measuring and improving customer-facing AI experiences.\n\nHealthcare technology or regulated-industry experience.\n\nExperience working in startup environments with significant ambiguity.\n\nWhat Success Looks Like\nWithin your first 90 days, you will:\nOwn a product improvement from problem identification through production rollout and measured impact.\n\nEstablish practical checks for evaluating changes before production deployment.\n\nCreate visibility into key Access Agent performance metrics and breaking points.\n\nShip measurable improvements with documented before-and-after impact.\n\nHelp Health Note build a disciplined, scalable system for continuous AI improvement.\n\nCompensation\nCompensation is based on experience, demonstrated production AI expertise, and location.\nUnited States: Expected base salary of $170,000-$210,000 US D\n\nLatin America (contract): Expected compensation of $9,000-$12,000 USD per month, depending on experience and location\n\nWe evaluate every candidate individually and may adjust compensation based on relevant experience, technical depth, and overall fit.","description_format":"text","description_chars":4791,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Health Care"],"lifecycle":[{"event":"open","at":"2026-09-26T23:37:21Z"}],"visa":[],"liveness":{"score":13,"band":"cold","label":"Long shot","p_open":1,"p_active":0.367,"p_room":0.35,"age_days":39,"expected_fill_days":7,"reasons":["conf:1","win:tail"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/health-note-senior-ai-product-engineer","json_url":"https://alion.io/job/health-note-senior-ai-product-engineer.json","meta":{"generated_at":"2026-11-04T23:29:25Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":652,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3780316},"rest":"https://alion.io/mcp/rest/get_company?id=3780316"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhealth-note-senior-ai-product-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhealth-note-senior-ai-product-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhealth-note-senior-ai-product-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/health-note-senior-ai-product-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhealth-note-senior-ai-product-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1323088}},{"tool":"search_jobs","arguments":{"company":"healthnote.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1323088},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}