{"id":4497423,"url":"https://alion.io/job/harris-computer-staff-ai-engineer-qa","title":"Staff AI Engineer - QA","company":{"id":2223,"name":"Harris Computer","domain":"harriscomputer.com","url":"https://alion.io/company/harris-computer","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":78,"open_postings":40,"ghost_share":0,"stale_share":0.9,"repost_share":0,"time_to_fill_p50_days":30,"computed_at":"2026-11-17T05:47:56Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"Claude","optional":false},{"name":"Explainable AI","optional":false},{"name":"Great Expectations","optional":false},{"name":"LIME","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"SHAP","optional":false},{"name":"Structured Outputs","optional":false}],"status":"live","first_seen_at":"2026-11-17T00:00:00Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-18T00:11:12Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Harris Computer is hiring a Staff AI Engineer to join their, expanding team! We’re seeking a seasoned expert to pioneer the quality and reliability of our cutting-edge AI and machine learning solutions for healthcare. As a Staff AI Engineer focused on Quality Assurance, you will be the technical authority responsible for ensuring our AI systems are robust, fair, accurate, and safe.\nThis is a unique opportunity to define the future of AI quality in a domain where it matters most, mentoring a talented team and establishing the gold standard for testing intelligent systems that impact patient care. This is a full-time, remote position open to candidates in the U.S. or Canada.\nWhat your impact will be:\nBuild the core AI system end-to-end, from the service layer and data pipelines to the evaluation infrastructure, and own its architecture.\nDesign and build the evaluation infrastructure, including dataset management, automated test harnesses, and replay of AI systems against historical workflows.\nBuild and maintain evaluation datasets with clinician-reviewed correct answers, ensuring they evolve as our systems change.\nCreate error metrics weighted by severity, so mistakes with clinical or financial impact are prioritized accordingly.\nBuild production monitoring for accuracy, overrides, and safety issues, with actionable alerts for the engineering team.\nWrite adversarial tests for AI systems, including hidden or malicious instructions in documents and invented content.\nWork with product and clinical leads to define accuracy thresholds and the criteria for expanding or pulling back an AI capability.\nThe candidate must possess a curiosity and willingness to actively adopt and leverage emerging AI tools to improve workflows, solve problems, and drive efficiency along with being comfortable using a range of AI-enabled tools (such as copilots, chat-based AI, and automation solutions) as part of everyday work.\nWhat we’re looking for:\n7 or more years in software or machine learning engineering, with at least 3 years focused on evaluation, testing, or quality for AI systems.\nA track record of designing and building complete systems from scratch, taking them from prototype to production.\nA track record of building and running evaluation systems that teams use in production, not just for one-off analyses.\nAt least 2 years of experience evaluating large language model (LLM) systems in a production environment.\nStrong statistical skills for measuring accuracy, including sampling, confidence intervals, and error analysis.\n1 year + of experience designing evaluation sets for document extraction, classification, or structured output.\nDeep knowledge of explainable AI (XAI) techniques and AI-powered tools (e.g., SHAP, LIME, Claude).\nClear written communication, including design documents, and the ability to explain complex trade-offs to clinicians, engineers, and executives.\nWhat would make you stand out:\nExperience working within the healthcare or another highly regulated industry.\nFamiliarity with AI-specific testing techniques like metamorphic testing, adversarial testing, or data validation with tools like Great Expectations.\nA history of mentoring engineers and influencing technical direction across multiple teams.\nWhat we offer:\nPlenty of opportunities to grow your career\nComprehensive medical, dental, and vision benefits\n3 weeks of vacation plus 5 personal days to recharge\nEmployee stock ownership, RRSP program, 401k matching\nA chance to give back through community involvement\nFlexible work arrangements to suit your lifestyle\nSalary range: 120,000-160,000 depending on experience and qualifications.\nAbout Harris Computer:\nHarris provides mission critical software solutions for the Public Sector, Healthcare, Utilities and Private Sector verticals throughout North America, Europe, Asia and Australia.\nWorking for Harris is the perfect opportunity to fulfill your professional goals as well as achieve your personal dreams!\nOur employees enjoy a casual work environment that offers comfort while providing superior service to our customers. We offer a comprehensive benefit package as well as other additional “Perks”!\nWe empower our employees to make a difference\nWe have an award-winning culture\nWe offer opportunity to learn\nWe are financially strong and we are owned by the largest software company in Canada (CSI)\nWe have fun!","description_format":"text","description_chars":4381,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Flexible schedule"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Billing & Subscription Management","Digital Government","EHR & Clinical Software"],"lifecycle":[{"event":"open","at":"2026-11-18T00:11:12Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":30,"reasons":["conf:2","win:early","comp:brand"],"computed_at":"2026-11-18T02:37:33Z"},"pay":null,"html_url":"https://alion.io/job/harris-computer-staff-ai-engineer-qa","json_url":"https://alion.io/job/harris-computer-staff-ai-engineer-qa.json","meta":{"generated_at":"2026-11-18T02:37:33Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4827,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2223},"rest":"https://alion.io/mcp/rest/get_company?id=2223"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fharris-computer-staff-ai-engineer-qa"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fharris-computer-staff-ai-engineer-qa"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fharris-computer-staff-ai-engineer-qa"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/harris-computer-staff-ai-engineer-qa\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fharris-computer-staff-ai-engineer-qa"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4497423}},{"tool":"search_jobs","arguments":{"company":"harriscomputer.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4497423},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}