{"id":1122208,"url":"https://alion.io/job/impiricus-director-ai-automation-engineering","title":"Director, AI Automation Engineering","company":{"id":679184,"name":"Impiricus","domain":"impiricus.com","url":"https://alion.io/company/impiricus","size_band":"11-50","is_staffing_agency":false,"is_intermediary":false,"ats_vendor":"Greenhouse","truth_index":null},"role":"Leadership","role_family":"Leadership","seniority":"head","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":185000,"max":210000,"currency":"USD","period":"year","gross":null,"usd_annual":210000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Braintrust","optional":false},{"name":"CI/CD","optional":false},{"name":"GitHub Actions","optional":false},{"name":"LangSmith","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-09-22T18:37:09Z","employer_posted_date":"2026-09-22","last_verified_at":"2026-09-24T12:45:24Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Job Title: Director, AI Automation Engineer\nLocation: Remote US\nReports to: SVP, Product | AI\nExemption Status: Full-time, exempt\nWho We Are\nImpiricus is the Agentic Commercialization Platform for Healthcare. We help life sciences teams understand physician intent, coordinate the right clinical and commercial resources, and enable real-time action when HCPs need support. Our AI-powered platform acts as a field force multiplier: extending reach between rep visits, prioritizing the highest-impact path for each physician, and connecting HCPs to coverage, evidence, medical information, patient support, MSLs, field teams, samples, and approved content in the moments that matter.\nFounded by a practicing physician and a senior pharmaceutical executive, Impiricus was built to accelerate patient access to life-saving treatments through ethical, physician-first engagement. More than one million opted-in HCPs trust Impiricus as a preferred channel, including many who are underserved or hard to reach through traditional outreach. Products such as the Intelligently Optimized Network (ION), Pulse, Spark, and Ascend work together so every interaction can move from information to action. Guided by our Physician Advisory Board, we keep engagement clinically meaningful, compliant, and grounded in better patient care.\nJob Summary\n\n The Director, AI Automation Engineer is a player-coach role: own the quality and reliability layer for everything the AI Organization ships, and stay hands-on building the harnesses, eval frameworks, and release gates that make that real.\nThat means automated testing infrastructure, evaluation frameworks, and CI/CD guardrails that let us stage, test, and manage AI agents and tools at scale. Coverage spans internal AI platform work (Sage and the tools built on it) and customer-facing AI across Ascend and DocUpdate.\nThis is the first dedicated hire into a function we expect to grow. The Director sets the bar, does the hardest technical work early, and grows into leading a small automation team as coverage expands. The goal is to keep AI Engineers and builders shipping without loading QA burden onto the core build team.\nPartnership is daily with AI Engineers, AI Solutions Architects, and product teams shipping AI features: establish baseline quality metrics, automate validation, and make standards usable for engineers and non-engineers building in Sage.\n\nKey Responsibilities\nTesting Harness and Infrastructure\nOwn the infrastructure that continuously verifies whether autonomous agents are taking the actions we intend, before and after they reach production.\nStage, test, and lifecycle-manage bots and agent workflows before they reach production.\nEstablish baseline quality metrics and coverage standards for AI initiatives.\nBuild the infrastructure to run automated research chains and agent evals at scale.\nEvaluation Frameworks\nCreate automated evaluation frameworks for LLM outputs: accuracy, safety, bias, and regression.\nImplement RAG evaluation, prompt regression testing, and golden-set benchmarking.\nDefine and enforce quality thresholds that AI Engineers and builders must meet before ship.\nPartner with AI Researchers and Engineers on eval design for new model and agent patterns.\nCI/CD and Release Quality\nBuild the release-gating infrastructure that governs when an agent is trusted to act in production, including staged rollouts and rollback authority.\nDevelop AI automation solutions to ensure that agentic coding delivers highly functioning software while maintaining quality across the product portfolio\nIntegrate testing into GitHub Actions (or equivalent) for AI model and agent releases.\nMaintain existing test suites and keep them current as models, prompts, and tools change.\nCross-Team Quality Partnership\nWork with AI Solutions Architects on eval criteria for workflow automations they build in the field.\nPartner with Principal AI Product on launch-readiness and QA for AI projects across the org.\nSupport product teams (Ascend, DocUpdate, Platform) on AI feature validation without owning their roadmaps.\nDocument standards, runbooks, and patterns so non-engineers building in Sage can self-serve basic testing.\nQualifications & Experience\n5+ years building, evaluating, or governing production AI/ML systems, with direct experience in agentic AI, LLM-based automation, or autonomous system safety\nDirect experience evaluating LLM outputs: RAG eval, prompt regression, safety and accuracy benchmarking.\nExperience building CI/CD pipelines with integrated test gates (GitHub Actions or similar).\nComfortable working across AI platform infrastructure and product-facing AI features.\nOperates independently as a senior IC and communicates quality standards to engineers and non-engineers.\nExperience with agent testing, bot lifecycle management, or AI agent orchestration platforms is a strong plus.\nFamiliarity with LLM observability and eval tooling (LangSmith, Braintrust, custom harnesses, etc.) is a strong plus.\nBackground in healthcare, pharma, or regulated environments where quality gates matter is a strong plus.\nPrior experience standing up a QA or automation function from scratch, with appetite to grow into leading a team.\nProficiency in Python and standard testing frameworks (pytest or equivalent).\nCompensation and Benefits\nThe base salary range for this role is $185,000 - $210,000\nWhere you land within the range will reflect your skills, experience, and location, while keeping team parity in mind and leaving room for future growth.\nImportant Notice\nTo protect candidates, please note that all communication from our team will come directly from an @impiricus.com email address. We do not engage third party recruiters to schedule interviews for this role. If you receive outreach from anyone outside of our domain claiming to represent Impiricus, please disregard and let us know by forwarding the message to \nBenefits:\nImpiricus focuses on taking care of our teammates’ professional and personal growth and well-being.\n Healthcare: Medical, dental, and vision coverage for you and your dependents + on-demand healthcare concierge\n HSA, FSA & DCFSA: Pre-tax savings options for healthcare and dependent care, with monthly employer contributions to HSA (if enrolled in a high-deductible plan)\n Coverage & Protection: 100% paid short- and long-term disability, plus life and AD&D insurance\n Flexible Time Off: Take the time you need with a flexible vacation policy - recharge your batteries your way\nParental Leave: Paid parental leave to spend time with your newborn, adopted, or foster child (available after 6 months)\n Your Work, Your Way: If you’re close to an office, we encourage spending some time in-person to collaborate and connect. If not, remote is always an option.\n 401(k): Save for your future with tax advantages (and company match!)\nImpiricus provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.","description_format":"text","description_chars":7377,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible time off","Flexible vacation policy","Parental leave"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"},{"name":"Georgia","iso":"GE","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-09-22T19:32:49Z"}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":27,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-09-24T05:45:00Z"},"pay":{"stated_usd_annual":210000,"is_top_pay":false},"html_url":"https://alion.io/job/impiricus-director-ai-automation-engineering","json_url":"https://alion.io/job/impiricus-director-ai-automation-engineering.json","meta":{"generated_at":"2026-09-24T13:55:55Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers"}}