{"id":2381479,"url":"https://alion.io/job/alaffia-health-ml-ops-engineer","title":"ML Ops Engineer","company":{"id":63154,"name":"Alaffia Health","domain":"alaffiahealth.com","url":"https://alion.io/company/alaffia-health","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Kula","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":146000,"max_usd":279000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1268},"experience_years_min":5,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Fine-tuning","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"MLFlow","optional":false},{"name":"OpenAI","optional":false},{"name":"Python","optional":false},{"name":"Weights & Biases","optional":false},{"name":"HIPAA","optional":true}],"status":"live","first_seen_at":"2026-10-11T19:27:54Z","employer_posted_date":"2026-10-20","last_verified_at":"2026-10-23T01:33:58Z","board_verified":true,"closed_at":null,"days_open":11,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":11},"description":"About Alaffia & Our Mission\nEvery year, U.S. health plans lose billions to improper payments and administrative waste. That wasted spending ultimately trickles down across the healthcare ecosystem, driving up costs for plans, providers, and patients alike. We’re here to change that paradigm.\nAlaffia is a new kind of claims operations partner for health plans. Using expert clinicians and transparent AI, we deliver deeper insights, smarter automation, and consistently better outcomes across the entire lifecycle of claims. With Alaffia, health plans can cut wasted spending more effectively than ever - and provide their members the most affordable care.\nWe’re a high-growth, venture-backed Series B healthtech startup based in NYC and are actively scaling our company. Join us in helping to build a healthcare system that works better for everyone.\n*This position requires current authorization to work in the United States. Unfortunately, we are not in a position to sponsor work visas at this time.\nAbout the Role & What You’ll Be Doing\nAlaffia Health is a healthcare AI startup revolutionizing medical billing and data automation. Our AI-driven platform leverages state-of-the-art generative AI and machine learning technologies to enhance accuracy, efficiency, and compliance in medical billing and auditing\nAs we scale, we're looking for an MLOps Engineer to build the operational backbone behind Alaffia's AI agents. Our agentic systems are already in production reviewing real claims but as both our library of agents and our roster of health-plan customers grow, we need someone to make that growth reliable, measurable, and cost-efficient.\n\nThis is a hybrid role. The core is MLOps: standing up evaluation frameworks, wiring evals into CI, managing model access across cloud providers, tracking experiments, and defining how we operate a growing fleet of agents across many customers. But we also want someone who can go deeper on the models themselves; developing, fine-tuning, and improving the LLMs and ML models that power our agents.\n\nIf you like owning systems end to end from a model experiment in a dev environment all the way to a monitored, evaluated agent running in production, and want a direct hand in shaping how a Series B healthtech builds, ships, and measures AI, this role is for you. You'll work closely with our AI engineers and clinical subject-matter experts.\n\nYour Responsibilities\nDesign, build, and own our agent evaluation framework covering output quality, throughput, and cost, so we can measure every agent objectively and catch regressions early.\n\nIntegrate automated evals into our CI/CD pipeline so changes to our agents are tested and quality-gated before they ship.\n\nManage model access and enablement across cloud providers (AWS Bedrock, Azure OpenAI, and others), including onboarding new models, managing quotas, and benchmarking options for performance and reliability.\n\nBuild experiment tracking, metrics, and observability for the experiments our team runs in dev, so results are reproducible and comparable.\n\nDevelop the systems and processes to manage our agents across a growing roster of customers including versioning, configuration, and deployment as both the number of agents and customers scale.\n\nMonitor agents in production for quality, throughput, cost, and drift, and build the dashboards and alerting to keep them healthy.\n\nDevelop, fine-tune, and evaluate LLMs and machine learning models to improve the accuracy and efficiency of our claim-review agents.\n\nBuild and maintain versioned pipelines for models, prompts, and agent configurations.\n\nTrack and optimize inference cost and unit economics as we scale.\n\nPartner with AI engineers and clinical experts to turn domain expertise into measurable, deployable model behavior.\n\nWhat We’re Looking For\n5+ years of experience in MLOps, ML platforms, or ML infrastructure engineering, ideally with experience supporting LLM-based or agentic systems.\n\nStrong software engineering fundamentals and proficiency in Python.\n\nHands-on experience developing, training, and fine-tuning machine learning models and/or LLMs.\n\nExperience building evaluation or benchmarking frameworks for ML or LLM outputs.\n\nExperience with CI/CD pipelines and integrating automated testing into them.\n\nWorking knowledge of cloud AI platforms such as AWS (Bedrock, SageMaker) and/or Azure (Azure OpenAI, Azure ML).\n\nFamiliarity with experiment-tracking and ML observability tooling (e.g., MLflow, Weights & Biases).\n\nA solid grasp of the operational challenges specific to LLMs - non-determinism, latency, token cost, prompt and model versioning, and why evaluating them is genuinely hard.\n\nA bias toward ownership and the ability to carry a system from experiment to production.\n\nNice to have\nExperience operating multi-tenant production systems or ML services at scale.\n\nExperience in a regulated or healthcare environment, including handling PHI and HIPAA considerations.\n\nExperience with agent frameworks or orchestration.\n\nComfort collaborating with non-engineering domain experts, such as clinicians, to translate their expertise into model behavior.\n\nOur Culture\nAlaffia was born out of our founders’ personal connection to the inefficiency of the U.S. healthcare system. We are deeply mission-driven, with an abiding belief that technology can help create a better future for everyone - and we’re looking for others who share our passion for change to join the team.\nWhat Else Do You Get Working With Us?\nCompetitive Compensation\n\nMedical, Dental, and Vision benefits\n\nFlexible, paid vacation policy\n\nWork in a flat organizational structure - direct access to Leadership","description_format":"text","description_chars":5666,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Fraud Detection","Medical AI","Revenue Cycle & Medical Billing"],"lifecycle":[{"event":"open","at":"2026-10-12T19:27:54Z"}],"visa":[],"liveness":{"score":87,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.871,"p_room":1,"age_days":10,"expected_fill_days":32,"reasons":["conf:0","velocity","win:early"],"computed_at":"2026-10-22T06:10:10Z"},"pay":null,"html_url":"https://alion.io/job/alaffia-health-ml-ops-engineer","json_url":"https://alion.io/job/alaffia-health-ml-ops-engineer.json","meta":{"generated_at":"2026-10-23T03:58:46Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6519,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":63154},"rest":"https://alion.io/mcp/rest/get_company?id=63154"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Falaffia-health-ml-ops-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Falaffia-health-ml-ops-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Falaffia-health-ml-ops-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/alaffia-health-ml-ops-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Falaffia-health-ml-ops-engineer"}]}