{"id":2370730,"url":"https://alion.io/job/taxo-software-engineer-ai-quality-reliability","title":"Software Engineer (AI Quality & Reliability)","company":{"id":4406463,"name":"Taxo","domain":"taxo.ai","url":"https://alion.io/company/taxo-3","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Backend","role_family":"Backend","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":130000,"max":170000,"currency":"USD","period":"year","gross":null,"usd_annual":170000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"Tool Use","optional":false},{"name":"TypeScript","optional":false},{"name":"Voice Agents","optional":false}],"status":"live","first_seen_at":"2026-10-12T14:35:03Z","employer_posted_date":"2026-10-12","last_verified_at":"2026-10-14T08:05:01Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Software Engineer (AI Quality & Reliability)\nLocation: New York City | In-office\nThe Mission\n“Leading healthcare into the agentic era.”\nEvery day, patients call their clinic to schedule an appointment, ask a question, or request a prescription refill. Behind each conversation is a busy healthcare team coordinating people, information, and systems.\nTaxo builds Voice AI agents that take on this administrative work. Our agents connect with EHR and practice management systems to help teams handle patient intake, complex scheduling, and refill requests, with reliable workflows and clear handoffs to people.\nThe Opportunity: Make AI Quality Measurable\nAs our Software Engineer (AI Quality & Reliability), you’ll build the automated evaluation and regression systems that show whether Taxo is ready to release. You’ll turn product acceptance criteria and real failure modes into repeatable tests across voice agents, application workflows, and integrations. This is a software engineering role focused on test infrastructure, independent quality evidence, and reliable releases.\nWhat You’ll Do\nBuild the Evaluation System: Own shared evaluation frameworks, test harnesses, and versioned datasets using synthetic or appropriately authorized, privacy-safe data. Make runs repeatable and results easy to investigate.\n\nTest the Whole Workflow: Build automated end-to-end regression coverage across conversations, tool calls, application behavior, and integration boundaries, including failures, recovery, and human escalation.\n\nMeasure AI Behavior: Evaluate task completion, tool-use correctness, latency, and conversation quality. Combine deterministic checks with calibrated model-assisted scoring and appropriate human review.\n\nMake Releases Reviewable: Produce release-readiness evidence, maintain quality dashboards, and coordinate quality gates with product and engineering. Surface regressions, coverage gaps, and unresolved risks before launch.\n\nTurn Failures into Tests: Reproduce defects, isolate failure patterns, and add durable regression cases. Engineering service owners retain component tests, production instrumentation, on-call response, and fixes; you independently verify the results.\n\nImprove the Test System: Integrate automated checks into CI/CD, reduce flaky tests, and keep test environments and fixtures useful as the product evolves. Partner with domain reviewers on healthcare-specific cases and escalate questions that require clinical judgment.\n\nWho You Are\nThe Test Engineer: Strong software engineering skills in Python or TypeScript and experience building maintainable test automation, reusable fixtures, and CI pipelines.\n\nThe AI Evaluator: Practical experience evaluating LLM-powered applications, agents, or voice systems, including nondeterministic behavior and the limits of automated scoring.\n\nThe Systems Thinker: Experience testing APIs, asynchronous workflows, and distributed systems, with the ability to trace a failure across service boundaries.\n\nThe Investigator: A habit of turning ambiguous failures into reproducible cases, actionable evidence, and reliable regression coverage.\n\nThe Quality Partner: Clear communication about risk and release readiness, with sound judgment around sensitive data and human review.\n\nBonus: Experience with streaming audio, telephony, healthcare workflows, EHR integrations, or reliability testing in privacy-sensitive products.\n\nWhy Taxo\nHealthcare teams should be able to spend more time on patients and less time on administration. Help us build the products and company that make that possible.\nPractical AI Work: Build evaluation systems for real-world AI behavior across healthcare workflows.\n\nImpact That Matters: Help catch failures before they disrupt patients or clinic teams.\n\nTechnical Ownership: Shape shared evaluation and test infrastructure that improves every release.\n\nCompensation\nBase salary: $130,000-$170,000 USD annually\nEquity: 0.10%-0.25%\nBenefits: Health coverage\nHow We Work\nTaxo is a small, fast, high-conviction team. We care deeply about the problem, move with urgency, and take ownership of the work. We collaborate closely, make practical decisions, and keep improving through what we learn from customers.\nIf you want to build the engineering systems that make healthcare AI more dependable, we’d love to hear from you.","description_format":"text","description_chars":4330,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Health Care"],"lifecycle":[{"event":"open","at":"2026-10-12T17:32:34Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":21,"reasons":["conf:3","win:early"],"computed_at":"2026-10-14T06:34:16Z"},"pay":{"stated_usd_annual":170000,"is_top_pay":false},"html_url":"https://alion.io/job/taxo-software-engineer-ai-quality-reliability","json_url":"https://alion.io/job/taxo-software-engineer-ai-quality-reliability.json","meta":{"generated_at":"2026-10-14T10:23:14Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12063,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4406463},"rest":"https://alion.io/mcp/rest/get_company?id=4406463"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftaxo-software-engineer-ai-quality-reliability"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftaxo-software-engineer-ai-quality-reliability"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftaxo-software-engineer-ai-quality-reliability"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/taxo-software-engineer-ai-quality-reliability\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftaxo-software-engineer-ai-quality-reliability"}]}