{"id":3233157,"url":"https://alion.io/job/digital-forms-test-lead-ai-validation-integration","title":"Test Lead (AI Validation & Integration)","company":{"id":4041613,"name":"Digital Forms","domain":"digitalforms.io","url":"https://alion.io/company/digitalforms-io","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Recruitee","truth_index":{"grade":"D","score":40,"open_postings":32,"ghost_share":1,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-28T05:59:10Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":"contractor","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland"],"countries":["PL"],"hiring_countries":["PL"],"hiring_countries_total":1,"salary":{"min":18500,"max":30200,"currency":"PLN","period":"month","gross":null,"usd_annual":92316},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"GDPR","optional":false},{"name":"HIPAA","optional":false},{"name":"Java","optional":false},{"name":"Jira","optional":false},{"name":"JUnit","optional":false},{"name":"LLM","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"AWS","optional":true},{"name":"Structured Outputs","optional":true}],"status":"live","first_seen_at":"2026-02-06T11:20:53Z","employer_posted_date":"2026-02-06","last_verified_at":"2026-10-28T14:50:29Z","board_verified":true,"closed_at":null,"days_open":264,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":263},"description":"We are looking for an experienced Test Lead to drive the Quality and Validation strategy for a high-impact solution, in a highly regulated industry, involving AI components and Salesforce integration. In this role, you will own both definition and delivery of the Testing & AI Validation Strategy. You will be responsible for defining how solution outputs are verified for correctness, reliability, and safe operation, bridging the gap between newly developed AI Agents components and the client’s Salesforce environment.\nRequirements\nWhat you’ll do\nStrategy & Planning:\nOwn the QA Strategy: Design, plan and dDevelop the comprehensive Testing and AI Validation Strategy, covering FunctionalUnit, E2E, Integration, Regression, and User Acceptance Testing (UAT).\n\nAddress NFR and align against standards (e.g. GDPR, HIPAA, HITRUST, etc.)\n\nAI Validation Logic: Define validation plans for AI components, specifically determining what constitutes \"correct\" output, setting success thresholds, and establishing evaluation methods (including handling hallucinations and grounding rules).\n\nEnvironment & Data: Create detailed plans for Test Environments (Dev/Test/Prod) and define the Test Data Strategy to ensure sufficient coverage for standard scenarios, edge cases, and ingestion failures.\n\nExecution & Reporting:\nHands-on Testing: Execute functional, regression, exploratory, performance, and load tests.\n\nIntegration Coordination: Coordinate \"Joint End-to-End Validation\" efforts, collaborating with the client team to manage testing of Salesforce integration\n\nPipeline Integration: Integrate testing activities into the CI/CD pipeline for continuous quality assurance\n\nProcess Management: Manage Jira test case structures aligned to user stories and acceptance criteria\n\nMetrics: Provide regular reporting, tracking key QA metrics such as defect ratios\n\nAbout the project, in short. Is it a new project or maintenance?\nThis is a new project for a client that we have already established collaboration with during other projects. We are finalizing the Discovery Phase for this project and moving into Delivery.\nWe are developing a data validation and automation engine that processes structured and unstructured inputs against a complex logic framework. The system utilizes AI models to interpret user-submitted data, identifying discrepancies and missing information before mapping the results to a structured output format. Key components include automated ingestion, rule-based validation logic, and integration with existing enterprise architecture in a highly regulated industry.\nTechnical Requirements (must-have):\nFluent English\n\nQA Strategy: Experience defining end-to-end testing strategies for complex solutions\n\nEnd-to-End Testing: Experience in designing and executing E2E tests for complex, integrated systems using any modern testing technology\n\nAI/ML/LLM Testing Experience: Proven ability to validate AI models\n\nTest Data Management: Experience strategizing and managing test data across multiple environments (Dev/Test/Prod)\n\nTraceability mindset: linking requirements → test cases → evidence → defects → release decisions.\n\nExperience testing NFRs: performance, reliability, auditability, security basics.\n\nStrong understanding of privacy and sensitive data handling in testing (PII/PHI minimization, masking/anonymization)\n\nHands-on automation experience (at least one strong stack): e.g., Python/Java/JS + frameworks (pytest/JUnit/etc.)\n\nQA Metrics: Ability to track and report on specific QA metrics, such as defect ratios\n\nGood communication skills (written and verbal)\n\nJira Proficiency\n\nFull time availability, with overlap during 14:00-18:00 - to ensure seamless collaboration with USA based client\n\nAdditional Requirements (nice-to-have):\nFamiliar with AWS platform\n\nISTQB or similar certifications\n\nPrevious experience in fast-paced consulting or client-facing projects","description_format":"text","description_chars":3896,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Advanced (C1)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence"],"lifecycle":[{"event":"open","at":"2026-10-25T09:22:56Z"}],"visa":[],"liveness":{"score":1,"band":"cold","label":"Long shot","p_open":1,"p_active":0.05,"p_room":0.28,"age_days":263,"expected_fill_days":20,"reasons":["conf:3","stale_co","ghost","win:tail","crowd:"],"computed_at":"2026-10-28T05:59:10Z"},"pay":{"stated_usd_annual":92316,"is_top_pay":false},"html_url":"https://alion.io/job/digital-forms-test-lead-ai-validation-integration","json_url":"https://alion.io/job/digital-forms-test-lead-ai-validation-integration.json","meta":{"generated_at":"2026-10-28T17:12:43Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":23331,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4041613},"rest":"https://alion.io/mcp/rest/get_company?id=4041613"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdigital-forms-test-lead-ai-validation-integration"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdigital-forms-test-lead-ai-validation-integration"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdigital-forms-test-lead-ai-validation-integration"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/digital-forms-test-lead-ai-validation-integration\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdigital-forms-test-lead-ai-validation-integration"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3233157}},{"tool":"search_jobs","arguments":{"company":"digitalforms.io","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3233157},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}