AI & Automation Test Manager

Job Description :

Role : AI & Automation Test Manager | Insurance Domain

Location : Bangalore

Experience : 810 Years

Domain : Insurance

Primary Skills : AI & Automation Testing, Test Management, Insurance Domain

Role Overview :

We are seeking an experienced AI & Automation Test Manager with 810 years of experience in software quality assurance, test management, and the insurance domain. The role will be responsible for establishing the overall quality strategy for AI-enabled solutions, managing end-to-end testing activities, validating AI-generated responses, and ensuring integrations and releases meet defined quality and business standards.

Key Responsibilities :

- Establish and drive the overall test strategy, test approach, quality framework, and testing standards.

- Plan and oversee functional, integration, system, regression, and end-to-end testing across AI and digital capabilities.

- Create and maintain comprehensive test scenarios, test cases, evaluation datasets, test evidence, and quality documentation.

- Lead validation of AI-generated responses for accuracy, consistency, relevance, traceability, and adherence to defined acceptance criteria.

- Define suitable approaches for testing AI-driven functionality and automation workflows.

- Manage the complete defect lifecycle, including defect identification, severity assessment, prioritization, triage, tracking, and closure.

- Plan and coordinate User Acceptance Testing (UAT), Beta testing, release validation, and production readiness activities.

- Validate integrations between the solution and enterprise platforms such as ServiceNow, MyHR, knowledge repositories, and other connected systems.

- Work closely with Product, Engineering, Business, and Delivery teams to identify quality risks and recommend corrective actions.

- Prepare and present test status, quality metrics, defect trends, risk assessments, and release-readiness reports to stakeholders.

- Identify opportunities to improve test processes through automation, AI-assisted testing, reusable frameworks, and quality controls.

- Establish appropriate testing governance and ensure testing activities are aligned with business and regulatory expectations.

- Support continuous improvement of QA practices, testing efficiency, and overall product quality.

Mandatory Skills :

- 8 to 10 years of experience in Software Testing / Quality Assurance.

- Strong experience in Test Management and Test Strategy.

- Hands-on experience with AI testing, AI response validation, or AI-enabled application testing.

- Strong experience in test automation and automation strategy.

- Good understanding of functional, integration, regression, system, and end-to-end testing.

- Experience managing defect lifecycle, test planning, UAT, release validation, and quality reporting.

- Strong understanding of insurance domain processes and applications.

- Experience working with multiple stakeholders across Product, Engineering, Delivery, and Business teams.

AI & Automation Testing :

The candidate should have practical exposure to :

1. Validation of AI-generated responses and outputs.

2. Designing AI evaluation datasets and test scenarios.

3. Testing response accuracy, consistency, relevance, and traceability.

4. Defining acceptance criteria for AI-enabled functionality.

5. Identifying AI-specific quality risks and edge cases.

6. Test automation opportunities for AI and digital workflows.

7. Quality controls for AI-enabled enterprise applications.

Integration & Enterprise Testing :

Experience testing integrations with enterprise platforms is preferred, particularly :

1. ServiceNow

2. MyHR / HR platforms

3. Knowledge management systems

4. APIs and connected enterprise applications

5. Future or third-party integrated platforms

Test Management Responsibilities :

- Own test planning and execution governance.

- Establish entry and exit criteria.

- Monitor test coverage, execution progress, defects, risks, and dependencies.

- Coordinate QA teams and business users during UAT and Beta testing.

- Ensure appropriate test evidence is available for audit and release decisions.

- Provide clear recommendations regarding go/no-go decisions.

Preferred Skills :

- Experience with AI/GenAI testing methodologies.

- Exposure to automated testing frameworks and CI/CD pipelines.

- Experience with API and integration testing.

- Knowledge of Agile/Scrum delivery models.

- Experience with test management and defect tracking tools.

- Strong analytical, communication, stakeholder-management, and problem-solving skills.

Insurance Domain Experience :

Candidates should have relevant experience working with insurance business processes, applications, or digital platforms and understand the importance of quality, compliance, data accuracy, and controlled releases within an insurance environment.

Key Skills :

AI Testing | AI Response Validation | Test Automation | Test Management | Test Strategy | QA | Functional Testing | Integration Testing | Regression Testing | End-to-End Testing | UAT | Beta Testing | Defect Management | ServiceNow | Insurance Domain | Quality Assurance | Release Management | AI Evaluation | Test Governance

Skills

Software Quality Assurance, Testing, Automation Testing, AI/ML Testing, Test Strategy, Test Case Writing, Functional Testing, Regression Testing, Integration Testing