{"id":1279351,"url":"https://alion.io/job/sysmind-ai-automation-test-manager","title":"AI & Automation Test Manager","company":{"id":3800647,"name":"SysMind","domain":"sysmind.com","url":"https://alion.io/company/sysmind","size_band":"5000+","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"QA","role_family":"QA","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":12000,"max_usd":29000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":35},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"ServiceNow","optional":false},{"name":"Agile","optional":true},{"name":"CI/CD","optional":true},{"name":"Scrum","optional":true}],"status":"live","first_seen_at":"2026-08-25T04:58:45Z","employer_posted_date":null,"last_verified_at":"2026-08-25T04:58:45Z","board_verified":false,"closed_at":null,"days_open":78,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":78},"description":"Job Description : \n\nRole : AI & Automation Test Manager | Insurance Domain\n\nLocation : Bangalore\n\nExperience : 810 Years\n\nDomain : Insurance\n\nPrimary Skills : AI & Automation Testing, Test Management, Insurance Domain\n\nRole Overview : \n\nWe are seeking an experienced AI & Automation Test Manager with 810 years of experience in software quality assurance, test management, and the insurance domain. The role will be responsible for establishing the overall quality strategy for AI-enabled solutions, managing end-to-end testing activities, validating AI-generated responses, and ensuring integrations and releases meet defined quality and business standards.\n\nKey Responsibilities : \n\n- Establish and drive the overall test strategy, test approach, quality framework, and testing standards.\n\n- Plan and oversee functional, integration, system, regression, and end-to-end testing across AI and digital capabilities.\n\n- Create and maintain comprehensive test scenarios, test cases, evaluation datasets, test evidence, and quality documentation.\n\n- Lead validation of AI-generated responses for accuracy, consistency, relevance, traceability, and adherence to defined acceptance criteria.\n\n- Define suitable approaches for testing AI-driven functionality and automation workflows.\n\n- Manage the complete defect lifecycle, including defect identification, severity assessment, prioritization, triage, tracking, and closure.\n\n- Plan and coordinate User Acceptance Testing (UAT), Beta testing, release validation, and production readiness activities.\n\n- Validate integrations between the solution and enterprise platforms such as ServiceNow, MyHR, knowledge repositories, and other connected systems.\n\n- Work closely with Product, Engineering, Business, and Delivery teams to identify quality risks and recommend corrective actions.\n\n- Prepare and present test status, quality metrics, defect trends, risk assessments, and release-readiness reports to stakeholders.\n\n- Identify opportunities to improve test processes through automation, AI-assisted testing, reusable frameworks, and quality controls.\n\n- Establish appropriate testing governance and ensure testing activities are aligned with business and regulatory expectations.\n\n- Support continuous improvement of QA practices, testing efficiency, and overall product quality.\n\nMandatory Skills : \n\n- 8 to 10 years of experience in Software Testing / Quality Assurance.\n\n- Strong experience in Test Management and Test Strategy.\n\n- Hands-on experience with AI testing, AI response validation, or AI-enabled application testing.\n\n- Strong experience in test automation and automation strategy.\n\n- Good understanding of functional, integration, regression, system, and end-to-end testing.\n\n- Experience managing defect lifecycle, test planning, UAT, release validation, and quality reporting.\n\n- Strong understanding of insurance domain processes and applications.\n\n- Experience working with multiple stakeholders across Product, Engineering, Delivery, and Business teams.\n\nAI & Automation Testing : \n\nThe candidate should have practical exposure to : \n\n1. Validation of AI-generated responses and outputs.\n\n2. Designing AI evaluation datasets and test scenarios.\n\n3. Testing response accuracy, consistency, relevance, and traceability.\n\n4. Defining acceptance criteria for AI-enabled functionality.\n\n5. Identifying AI-specific quality risks and edge cases.\n\n6. Test automation opportunities for AI and digital workflows.\n\n7. Quality controls for AI-enabled enterprise applications.\n\nIntegration & Enterprise Testing : \n\nExperience testing integrations with enterprise platforms is preferred, particularly : \n\n1. ServiceNow\n\n2. MyHR / HR platforms\n\n3. Knowledge management systems\n\n4. APIs and connected enterprise applications\n\n5. Future or third-party integrated platforms\n\nTest Management Responsibilities : \n\n- Own test planning and execution governance.\n\n- Establish entry and exit criteria.\n\n- Monitor test coverage, execution progress, defects, risks, and dependencies.\n\n- Coordinate QA teams and business users during UAT and Beta testing.\n\n- Ensure appropriate test evidence is available for audit and release decisions.\n\n- Provide clear recommendations regarding go/no-go decisions.\n\nPreferred Skills : \n\n- Experience with AI/GenAI testing methodologies.\n\n- Exposure to automated testing frameworks and CI/CD pipelines.\n\n- Experience with API and integration testing.\n\n- Knowledge of Agile/Scrum delivery models.\n\n- Experience with test management and defect tracking tools.\n\n- Strong analytical, communication, stakeholder-management, and problem-solving skills.\n\nInsurance Domain Experience : \n\nCandidates should have relevant experience working with insurance business processes, applications, or digital platforms and understand the importance of quality, compliance, data accuracy, and controlled releases within an insurance environment.\n\nKey Skills : \n\nAI Testing | AI Response Validation | Test Automation | Test Management | Test Strategy | QA | Functional Testing | Integration Testing | Regression Testing | End-to-End Testing | UAT | Beta Testing | Defect Management | ServiceNow | Insurance Domain | Quality Assurance | Release Management | AI Evaluation | Test Governance\nSkills\nSoftware Quality Assurance, Testing, Automation Testing, AI/ML Testing, Test Strategy, Test Case Writing, Functional Testing, Regression Testing, Integration Testing","description_format":"text","description_chars":5414,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Cybersecurity","Professional Services"],"lifecycle":[{"event":"open","at":"2026-09-26T02:00:24Z"}],"visa":[],"liveness":{"score":4,"band":"cold","label":"Long shot","p_open":0.4,"p_active":0.369,"p_room":0.28,"age_days":78,"expected_fill_days":28,"reasons":["seen:78","agency","win:tail","crowd:"],"computed_at":"2026-11-11T05:49:22Z"},"pay":null,"html_url":"https://alion.io/job/sysmind-ai-automation-test-manager","json_url":"https://alion.io/job/sysmind-ai-automation-test-manager.json","meta":{"generated_at":"2026-11-11T12:03:14Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":21297,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3800647},"rest":"https://alion.io/mcp/rest/get_company?id=3800647"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsysmind-ai-automation-test-manager"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsysmind-ai-automation-test-manager"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsysmind-ai-automation-test-manager"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sysmind-ai-automation-test-manager\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsysmind-ai-automation-test-manager"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1279351}},{"tool":"search_jobs","arguments":{"company":"sysmind.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1279351},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}