{"id":3940194,"url":"https://alion.io/job/hyro-software-architect","title":"Software Architect","company":{"id":2145814,"name":"Hyro","domain":"hyro.ai","url":"https://alion.io/company/hyro-ai","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Comeet","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"staff","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Tel Aviv, Israel"],"countries":["IL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Fine-tuning","optional":false},{"name":"HIPAA","optional":false},{"name":"Knowledge Distillation","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Distillation","optional":false},{"name":"Python","optional":false},{"name":"TypeScript","optional":false},{"name":"Context Engineering","optional":true},{"name":"Function Calling","optional":true},{"name":"LangChain","optional":true},{"name":"Langfuse","optional":true},{"name":"LangGraph","optional":true},{"name":"LiveKit","optional":true},{"name":"Quantization","optional":true},{"name":"RAG","optional":true},{"name":"Structured Outputs","optional":true},{"name":"Text-to-Speech","optional":true},{"name":"Triton","optional":true},{"name":"vLLM","optional":true},{"name":"WebRTC","optional":true},{"name":"WebSockets","optional":true}],"status":"live","first_seen_at":"2026-11-08T12:04:42Z","employer_posted_date":"2026-11-08","last_verified_at":"2026-11-08T13:22:44Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Description\nGrab your cape, become a SuperHyro!\nHyro, the leading Agentic Care Communications platform, enables health systems to safely automate workflows and conversations across their most valuable platforms, services, and channels-including call centers, websites, SMS, mobile apps, and more. Hyro's customers, which include Baptist Health, Hackensack Meridian Health, Tampa General Hospital, and Inova Health System, benefit from AI agents that are fully HIPAA-compliant, fast to deploy, easy to maintain, and simple to scale-generating better conversations, successful patient outcomes, and revenue-driving insights. This is a hands-on role. You’ll write and ship production code, build the prototypes that prove a design before the teams commit to it, and own critical components end to end.\nWhat Are We Looking For?\nWe are seeking an experienced, hands-onArchitect to design and build the generative AI systems behind Hyro’s AI agents, which help patients across the US get answers, schedule appointments, refill prescriptions, and more.\nIn this role, you will shape how Hyro builds AI. You will design LLM-based solutions, data and evaluation pipelines, and low-latency voice experiences, and take them into production at scale. You will mentor senior engineers, elevate the engineering bar, and partner closely with Product and cross-functional teams to turn complex healthcare workflows into reliable, high-accuracy agentic capabilities.\nResponsibilities\nOwn the end-to-end architecture across teams. Write and review design docs, set technical standards, and make the trade-offs between teams explicit.\nDefine the model strategy: small vs. large models, self-hosted vs. API, fine-tuning and distillation, and routing and fallback between providers. Weigh quality, latency, and cost.\nHelp prototypes from Product Growth become platform capabilities without a rewrite. Balance shipping fast with building something that lasts.\nDesign serving infrastructure for small and large models that meets strict latency and availability targets.\nShape the anomaly-detection and classification systems that catch failures in production conversations.\nBuild solutions across different channels, including voice products with minimal latency, high accuracy, and a great user experience.\nLead new AI initiatives by designing complex functionality and integrating with third parties.\nBuild integrations with other systems that speed up development and deployment.\nDesign guardrails, hallucination controls, and explainability for healthcare-grade agents.\nOwn critical systems hands-on, shipping production code, prototyping POCs, and setting high review standards for core agent services.\nRequirements\n5+ years of experience as an architect or principal engineer.\n2+ years of experience building ML or LLM-based applications in production.\nBachelor’s or master’s degree in computer science, data science, or a related field.\nHands-on in Python. Node/TypeScript is a plus. You still write production code and prototypes.\nDeep production experience with LLM systems: context engineering, RAG, tool calling, structured outputs, and agent frameworks (LangGraph or similar).\nProven experience designing evaluation frameworks for non-deterministic systems, and using them to make shipping decisions.\nExperience with real-time, latency-sensitive systems (streaming, WebSockets/ WebRTC, event-driven architectures).\nComfortable switching between quick 0-to-1 builds and hardening platforms at scale.\nStrong interpersonal, leadership, and communication skills with the ability to thrive in a fast-changing environment.\nBonus Points:\nKnowledge of MLOps.\nVoice AI: STT/TTS, speech-to-speech models, LiveKit or similar.\nModel serving and optimization: vLLM/Triton, quantization, GPU efficiency, fine-tuning small models.\nLLM observability tools (Langfuse or similar).\nBenefits & Perks\nUnlimited PTO, paid sick leave\nCompany-wide long weekends every quarter\nHybrid, dog-friendly TLV office\nWork from anywhere for up to 2 weeks per year\nPension, social benefits & Keren Hishtalmut\nMonthly meal allowance\nEqual Opportunities\nHyro is proud to be an equal-opportunity employer. We hire talented people regardless of gender, race, ethnicity, ancestry, age, disability, sexual orientation, gender identity or expression, military or veteran status, cultural background, religious beliefs, or any other characteristic protected by federal, state, or local law.","description_format":"text","description_chars":4435,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Unlimited PTO"],"hiring_locations":[{"name":"Israel","iso":"IL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Medical AI","Contact Center Software"],"lifecycle":[{"event":"open","at":"2026-11-08T13:22:44Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":6,"reasons":["conf:0","win:early"],"computed_at":"2026-11-08T14:01:00Z"},"pay":null,"html_url":"https://alion.io/job/hyro-software-architect","json_url":"https://alion.io/job/hyro-software-architect.json","meta":{"generated_at":"2026-11-08T14:01:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29667,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-09T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2145814},"rest":"https://alion.io/mcp/rest/get_company?id=2145814"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhyro-software-architect"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhyro-software-architect"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhyro-software-architect"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hyro-software-architect\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhyro-software-architect"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3940194}},{"tool":"search_jobs","arguments":{"company":"hyro.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3940194},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}