{"id":3357289,"url":"https://alion.io/job/ellkay-senior-ml-engineer-mlops-and-ai-evaluation","title":"Senior ML Engineer - MLOps and AI Evaluation","company":{"id":2197825,"name":"ELLKAY","domain":"ellkay.com","url":"https://alion.io/company/ellkay","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"ADP","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":22000,"max_usd":45000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":41},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"LLM","optional":false},{"name":"RAG","optional":false}],"status":"live","first_seen_at":"2026-10-27T17:30:01Z","employer_posted_date":null,"last_verified_at":"2026-10-27T17:30:01Z","board_verified":false,"closed_at":null,"days_open":6,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":6},"description":"ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY's solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies.\n\nToday, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today's data-rich world.\n\nELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.\n\nJob Description\n\n Ellkay is looking for an Senior ML Engineer - MLOps and AI Evaluation to b uild the shared ML operations and evaluation foundation for ELLKAY's classical ML, LLM, and agent services. The engineer will implement reproducible training/deployment pipelines, versioned models and prompts, benchmark execution, synthetic fixtures, release gates, telemetry, and rollback. The role owns the engineering systems that make quality, reliability, and cost visible throughout the AI lifecycle.\n\nEssential Duties & Responsibilities\n\nImplement model, prompt, retrieval-index, and evaluation-dataset versioning with lineage and reproducible release evidence.\nBuild CI/CD evaluation gates for mapping, clinical extraction, recommendations, RAG, and agents. Validate automated judges against SME labels.\nCreate synthetic healthcare fixtures and benchmarks for malformed data, corrections, missing evidence, rare cases, and permission boundaries.\nDeploy serving pipelines and monitor drift, model quality, latency, failure rates, and unit cost. Support shadow testing, canaries, rollback, and fallback.\nPartner with Security and Data Platform on tenant isolation tests, PHI-safe telemetry, approved training rights, and model-vendor data handling.\nOptimize inference resources and cost through profiling, batching, caching, and appropriate model sizing. Own reproducible model-training jobs and dependency tracking.\nPartner with Data Platform and product engineers, clinical/data SMEs, DME/QA, and security teams. \nBuild reusable services for ELLKAY products and preserve source evidence, approved data-use rights, and tenant isolation. \nModel or agent proposals follow established human approval and platform release workflows.\n\nAdditional Information\n\nELLKAY is committed to fostering a collaborative and high-performance work environment that supports innovation, teamwork, and professional growth. Most roles are designed to operate from our office locations to encourage effective collaboration and engagement across teams.\n\nAny alternative work arrangements may be considered at the company's discretion based on role requirements and business needs.\n\nFor more information about our company, please visit www.ELLKAY.com .\n\nELLKAY is a Smoke-Free Workplace.\n\nELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.","description_format":"text","description_chars":3687,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Medical AI","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-27T20:10:15Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":6,"expected_fill_days":35,"reasons":["seen:6","velocity","win:early"],"computed_at":"2026-11-03T05:54:40Z"},"pay":null,"html_url":"https://alion.io/job/ellkay-senior-ml-engineer-mlops-and-ai-evaluation","json_url":"https://alion.io/job/ellkay-senior-ml-engineer-mlops-and-ai-evaluation.json","meta":{"generated_at":"2026-11-03T06:11:56Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8524,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-04T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2197825},"rest":"https://alion.io/mcp/rest/get_company?id=2197825"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fellkay-senior-ml-engineer-mlops-and-ai-evaluation"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fellkay-senior-ml-engineer-mlops-and-ai-evaluation"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fellkay-senior-ml-engineer-mlops-and-ai-evaluation"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ellkay-senior-ml-engineer-mlops-and-ai-evaluation\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fellkay-senior-ml-engineer-mlops-and-ai-evaluation"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3357289}},{"tool":"search_jobs","arguments":{"company":"ellkay.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3357289},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}