{"id":1290001,"url":"https://alion.io/job/100ms-software-engineer-architect-ai-agents-healthcare","title":"Software Engineer Architect – AI Agents (Healthcare)","company":{"id":1923312,"name":"100ms","domain":"100ms.live","url":"https://alion.io/company/100ms","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"B","score":75,"open_postings":5,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-03T05:54:40Z"}},"role":"Backend","role_family":"Backend","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":5000000,"max":15000000,"currency":"INR","period":"year","gross":null,"usd_annual":158625},"salary_estimate":null,"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"GCP","optional":false},{"name":"Go","optional":false},{"name":"Google GKE","optional":false},{"name":"HIPAA","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"SOC 2","optional":false},{"name":"Voice Agents","optional":false},{"name":"FHIR","optional":true},{"name":"Fine-tuning","optional":true},{"name":"Hallucination","optional":true},{"name":"HL7","optional":true},{"name":"WebRTC","optional":true}],"status":"live","first_seen_at":"2026-08-21T13:01:00Z","employer_posted_date":"2026-08-21","last_verified_at":"2026-11-03T07:26:11Z","board_verified":true,"closed_at":null,"days_open":73,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":73},"description":"Role Summary\nWe are looking for a Software Engineer Architect to own the technical architecture of our AI agents platform as it scales. In healthcare, accuracy and trust are everything - our systems make phone calls to payers, handle Protected Health Information, and operate inside real clinical workflows, so the architecture underneath them has to be reliable, observable, secure, and fast to evolve.\nThis is a hands-on, deeply technical role, not a pure design-review position.\nYou will define how our services, data, and agent pipelines fit together; make the build-vs-buy and technology choices that shape the next three years of the platform; write code on the hardest problems; and raise the engineering bar across the team.\nYou will work directly with the founders, product, platform/infrastructure, and security teams, and your decisions will be informed by real customer and clinical workflows.\nKey Responsibilities\nOwn the end-to-end architecture of the AI agents platform - services, APIs, data models, async task pipelines, LLM/voice agent orchestration, and integrations with payer systems, EMRs, and telephony.\nDesign for reliability, latency, and safety: define patterns for fault tolerance, idempotency, retries, observability, and graceful degradation across agent workflows that run at scale in production.\nSet the architecture for multi-tenancy, data isolation, and PHI handling in partnership with our Security and Compliance Lead, keeping HIPAA and SOC 2 requirements designed in rather than bolted on.\nMake and document high-leverage technical decisions - build vs. buy, service boundaries, storage and queueing choices, LLM provider and inference strategy - through lightweight design reviews and ADRs.\nStay hands-on: prototype critical paths, write production code on the most ambiguous and highest-risk problems, and unblock teams when they hit hard technical walls.\nPartner with the platform team on how workloads run on our Kubernetes (GKE) infrastructure - autoscaling, deployment topology, cost, and SLOs for agent and voice workloads.\nRaise the engineering bar: mentor senior engineers, drive code and design review culture, and define standards for testing, evaluation, and release safety across teams.\nTranslate product and customer needs into a technical roadmap; work with founders and product to sequence architectural investments against business priorities.\nDe-risk scale: anticipate where the system breaks at 10x call volume, 10x customers, and 10x team size, and lay the groundwork before it does.\nRequirements\n10+ years of professional software engineering experience, including several years designing and operating large-scale, production distributed systems.\nA track record of owning architecture for a product or platform end to end - you have made foundational technical decisions, lived with their consequences, and evolved them.\nDeep expertise in backend systems: service design, RESTful/async APIs, event-driven architectures, task queues, and data modelling across relational and non-relational stores.\nStrong grasp of reliability engineering - observability, fault tolerance, capacity planning, and incident-informed design - for systems with strict correctness and latency requirements.\nHands-on proficiency in at least one of our core languages (Python or Go); comfort reading and reviewing code across the stack, including React-based frontends.\nWorking knowledge of cloud-native infrastructure (GCP/AWS/Azure), Kubernetes, and infrastructure-as-code, and how architectural choices play out operationally.\nExperience building or integrating AI/LLM-backed systems - or clear evidence you can go deep fast on agent orchestration, evaluation, guardrails, and inference trade-offs.\nStrong security instincts: you design with data isolation, encryption, access control, and auditability in mind from day one.\nExcellent written and verbal communication - you can carry a design from whiteboard to ADR to aligned teams, and explain trade-offs to founders and customers alike.\nAbility to tackle complex, ambiguous technical problems and drive them to crisp decisions.\nNice-to-Haves\nExperience with voice AI, telephony (SIP/WebRTC), or real-time systems.\nPrior work in U.S. healthcare or other regulated domains (HIPAA, SOC 2, HITRUST) - familiarity with EMRs, payer integrations, FHIR/HL7.\nExperience with LLM evaluation frameworks, prompt/fine-tuning pipelines, and hallucination/safety controls in production.\nExperience scaling engineering teams and architecture together - platformization, service extraction, developer experience.\nOpen-source contributions, technical writing, or conference talks.\nWhy This Role Matters\nEvery architectural decision here has a direct line to patients getting care faster.\nThe systems you design will determine whether our agents can be trusted with clinical workflows at enterprise scale - and whether a small, sharp team can keep shipping quickly as the platform grows.\nYou will set technical direction at the stage where it compounds the most.\nCulture & Growth\n100ms is an engineering-first startup. Our team includes former entrepreneurs, AI engineering specialists, and healthcare operations professionals, with experience at major technology companies around the world.\nYou can grow as a senior individual contributor or into technical leadership - you set your own trajectory, with direct access to the founders.\nWe believe in-person collaboration builds better systems and stronger culture: employees work from our Bengaluru office at least three days a week - Tuesday, Wednesday, and Friday. Some overlap with U.S. time zones is expected for customer and partner engagement.","description_format":"text","description_chars":5668,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Video Conferencing & Webinars"],"lifecycle":[{"event":"open","at":"2026-09-26T07:42:48Z"}],"visa":[],"liveness":{"score":19,"band":"cold","label":"Long shot","p_open":1,"p_active":0.535,"p_room":0.36,"age_days":73,"expected_fill_days":38,"reasons":["conf:2","win:tail","crowd:"],"computed_at":"2026-11-03T05:54:40Z"},"pay":{"stated_usd_annual":158625,"is_top_pay":false},"html_url":"https://alion.io/job/100ms-software-engineer-architect-ai-agents-healthcare","json_url":"https://alion.io/job/100ms-software-engineer-architect-ai-agents-healthcare.json","meta":{"generated_at":"2026-11-03T07:47:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11180,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-04T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1923312},"rest":"https://alion.io/mcp/rest/get_company?id=1923312"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2F100ms-software-engineer-architect-ai-agents-healthcare"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2F100ms-software-engineer-architect-ai-agents-healthcare"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2F100ms-software-engineer-architect-ai-agents-healthcare"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/100ms-software-engineer-architect-ai-agents-healthcare\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2F100ms-software-engineer-architect-ai-agents-healthcare"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1290001}},{"tool":"search_jobs","arguments":{"company":"100ms.live","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1290001},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}