QA Lead
First seen by Alion on Oct 13, 2026.
About the project:
A founder-led US healthtech startup — run by clinicians — is building an AI-powered mobile app for caregivers of children with complex medical needs. The app combines structured health tracking, EHR integration via SMART on FHIR, and an LLM-based assistant that remembers a child’s full history. It handles sensitive health data across multiple caregivers and profiles, with a layered permissions model. Public launch is planned for late November, and the quality and release process needs to be production-ready before that happens.
A new team member will be in charge of:
Own the end-to-end QA process — define the release baseline, give go/no-go decisions, and keep a short release record with residual risk documented each cycle.
Rebuild and tier the regression suite: remove duplicates, maintain one authoritative test repository, and trace requirements to tests and defects for high-risk areas like permissions, health data, and integrations.
Own AI feature testing — build and maintain eval datasets, check hallucination, exact-number recall, correct profile attribution, and context isolation between caregivers; define regression triggers for prompt, model, and config changes.
Drive mobile and web test automation — own the Maestro baseline for Flutter iOS/Android, maintain pipeline execution and reliability metrics, and extend web automation where it delivers real value.
Mentor the QA team and embed AI-assisted workflows — from test generation and regression impact analysis to defect investigation — so the whole team runs on them, not just you.
Does this relate to you?
5+ years in QA, with at least 2 years owning the QA process on a product — not just executing tests, but setting strategy, managing releases, and reporting quality metrics.
Solid risk-based test design: permission and role matrices, negative scenarios, state transitions — you know where the real failure modes hide.
Hands-on experience testing LLM or AI features: eval datasets, hallucination checks, non-deterministic output, prompt and model regression — and you can tell a good eval from a bad one.
Practical experience with mobile automation (Maestro, Appium, Detox, or Flutter integration tests), web automation (Playwright or Cypress), and CI pipeline integration.
API testing, Jira, Confluence, and basic SQL — enough to investigate issues end to end without waiting on a developer.
Active daily use of AI tools (Claude or similar) across at least several QA activities — design, test data, automation, bug analysis, reporting — with concrete workflows you can actually walk through, not just a mention of ChatGPT on your CV.
English B2+ — enough to write clear test documentation, communicate risk to stakeholders, and push back when scope changes break the release plan.
Familiarity with healthcare data standards or compliance (FHIR, HIPAA), LLM eval tooling (Langfuse, promptfoo, Ragas, or DeepEval), or Flutter is a strong plus.
How We Support Your Success:
Remote or hybrid? The choice is yours. We offer a highly flexible approach to time off and personal days, empowering you to manage your own work-life balance.
We invest in your proactive mindset. Access dedicated professional training and development opportunities, customized to align with your career goals.
Sharpen your cross-cultural communication with our dedicated in-house English tutor.
Influence our growth and culture. Participate in our Referral Bonus program to get rewarded for bringing top talent to the team, and benefit from our Recognition Reward program, which celebrates and rewards your productivity and contributions as a team member.
We recognize that life happens outside of work. Enjoy special perks to celebrate your birthdays, weddings, and the arrival of new family members.
We handle the logistics so you can focus on ownership. Benefit from dedicated invoicing assistance, tech admin support, and proactive People Partnership.
Please note: Specific financial allowances, insurance options, and localized administrative support vary by country. We will gladly discuss the tailored package available in your specific location during our conversation!
Ready to try your hand? Send your CV without a doubt!