{"id":2094607,"url":"https://alion.io/job/arbiter-ai-qa-engineer-voice-ai-agents","title":"QA Engineer, Voice AI Agents","company":{"id":3913048,"name":"Arbiter AI","domain":"arbiter.ai","url":"https://alion.io/company/arbiter-ai","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"QA","role_family":"QA","seniority":"middle","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":180000,"max":200000,"currency":"USD","period":"year","gross":null,"usd_annual":200000},"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"AI Agents","optional":false},{"name":"Multimodal AI","optional":false},{"name":"SQL","optional":false},{"name":"HIPAA","optional":true},{"name":"LLM","optional":true},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-10-08T02:01:15Z","employer_posted_date":"2026-10-08","last_verified_at":"2026-10-16T04:16:57Z","board_verified":true,"closed_at":null,"days_open":8,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":8},"description":"Arbiter is the AI-powered care orchestration system that unites healthcare. We are launching our best-in-class, patient-facing Agentic platform to optimize patient outcomes through a unique multimodal approach. We optimize complex healthcare workflows that interface with patients using the latest Agentic AI approaches, and we combine it with a sophisticated platform to serve this Agentic layer at scale.\nBacked by one of the largest seed rounds in health tech history and operators who bring the expertise and distribution to scale nationally, we're building the connected infrastructure healthcare should have had all along.\nOur Culture & Values\nWe are a high-performing group of engineers dedicated to delivering innovative, high-quality solutions to our clients and business partners. We believe in:\nExcellence: Taking immense pride in our craft and the products we build, treating both with utmost respect and care.\n\nImpact-Driven Development: Firmly committed to engineering high-quality, fault-tolerant, and highly scalable systems that evolve seamlessly with business needs, minimizing disruption.\n\nCollaboration Over Ego: Valuing exceptional work and groundbreaking ideas above all else. We seek talented individuals who are accustomed to working in a fast-paced environment and are driven to ship often to achieve significant impact.\n\nContinuous Growth: Fostering an environment of continuous learning, mentorship, and professional development, where you can deepen your expertise and grow your career.\n\nResponsibilities\nAs a QA Engineer reporting to the Head of Product, you will be the person who digs into calls and platform issues. You will review conversations, trace failures through transcripts, logs, and campaign configuration, find the root cause, and work with engineering and deployment teams to fix it. Work cross-functionally with engineers, deployment managers, and clinical and nurse operations staff. This role combines hands-on investigation, structured QA process, and growing automation.\nCall and issue debugging:\nInvestigate reported and detected issues on live campaigns, including dropped calls, wrong agent responses, failed handoffs, incorrect scheduling outcomes, and data mismatches.\n\nTrace problems across call recordings, transcripts, system logs, campaign configuration, and integration data to find the actual root cause.\n\nWrite clear, reproducible bug reports that engineers can act on right away, with severity, member impact, and supporting evidence.\n\nTriage incoming issues, separating agent behavior from configuration errors, data problems, and platform bugs, and route each to the right owner.\n\nCampaign QA:\nRun pre-launch QA on new campaigns and workflow changes: test scripts, edge cases, escalation paths, and handoffs to nurses or live staff.\n\nCarry out ongoing conversation QA on live campaigns against defined quality standards, and flag trends before they turn into customer issues.\n\nCheck that campaigns behave as designed: correct targeting, sequencing, disposition logic, and outcome capture.\n\nProcess and automation:\nHelp build and maintain the QA framework: test cases, scoring rubrics, regression suites, and release checklists.\n\nAutomate repetitive checks where it makes sense, such as transcript analysis, config validation, and outcome reconciliation.\n\nTrack quality metrics and report patterns to deployment, product, and engineering so issues get fixed at the source.\n\nMinimum Qualifications\n3 to 5 years in QA, support engineering, technical operations, or a similar role on a production software platform.\n\nA strong debugging instinct. You like finding out why something broke, and you don't stop at the first plausible answer.\n\nComfort reading logs, querying data with SQL, and working with APIs and JSON or YAML configuration.\n\nExperience writing test plans and bug reports that engineers trust.\n\nClear written communication and precise documentation habits.\n\nGood judgment on severity and prioritization when several issues are live at once.\n\nPreferred Qualifications\nExperience with voice AI, conversational AI, IVR, or contact center platforms.\n\nScripting ability in Python or similar for automating checks and analysis.\n\nExposure to LLM evaluation, prompt testing, or conversation quality scoring.\n\nHealthcare experience, especially payer or provider outreach, and familiarity with HIPAA and PHI handling.\n\nExperience with observability tools or with call analytics tools.\n\nThis role will be remote or onsite in our New York City or Boca Raton office, a fast-paced, collaborative environment where great ideas move quickly from whiteboard to production.\nJob Benefits\nWe offer a comprehensive and competitive benefits package designed to support your well-being and professional growth:\nHighly Competitive Salary & Equity Package: Designed to rival top FAANG compensation, including meaningful equity.\n\nGenerous Paid Time Off (PTO): To ensure a healthy work-life balance.\n\nComprehensive Health, Vision, and Dental Insurance: Robust coverage for you and your family.\n\nLife and Disability Insurance: Providing financial security.\n\nSimple IRA Matching: To support your long-term financial goals.\n\nProfessional Development Budget: Support for conferences, courses, and certifications to fuel your continuous learning.\n\nWellness Programs: Initiatives to support your physical and mental health.\n\nPay Transparency\nThe annual base salary range for this position is $180,000-$200,000. Actual compensation offered to the successful candidate may vary from the posted hiring range based on work experience, skill level, and other factors.","description_format":"text","description_chars":5603,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Dental insurance","Equity","Professional development","Wellness"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Agents"],"lifecycle":[{"event":"open","at":"2026-10-08T16:18:44Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":7,"expected_fill_days":42,"reasons":["conf:3","win:early"],"computed_at":"2026-10-15T05:46:00Z"},"pay":{"stated_usd_annual":200000,"is_top_pay":true},"html_url":"https://alion.io/job/arbiter-ai-qa-engineer-voice-ai-agents","json_url":"https://alion.io/job/arbiter-ai-qa-engineer-voice-ai-agents.json","meta":{"generated_at":"2026-10-16T05:22:56Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2708,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3913048},"rest":"https://alion.io/mcp/rest/get_company?id=3913048"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Farbiter-ai-qa-engineer-voice-ai-agents"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Farbiter-ai-qa-engineer-voice-ai-agents"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Farbiter-ai-qa-engineer-voice-ai-agents"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/arbiter-ai-qa-engineer-voice-ai-agents\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Farbiter-ai-qa-engineer-voice-ai-agents"}]}