2,326,972open jobs
146,595companies
277,438added this week
Browse all
Location
In office (Pune)
Seniority
Staff · 5+ years exp

First seen by Alion on Nov 16, 2026.

Overview
Company
Impact
Profile match
Our mission Make lending fast, simple & trustworthy AdvaRisk is focused on digitizing the current mortgage based lending process to make the decisioning fast, simple & trustworthy.

Key Roles & Responsibilities:

  • Own and drive the end-to-end test automation strategy, defining the roadmap, frameworks, tooling and standards for UI, API, backend and integration testing.
  • Lead, mentor and manage the QA team, owning delivery, prioritization, test coverage and quality outcomes.
  • Work closely with engineering, product, data science/ML and client service teams to clarify requirements and define acceptance criteria.
  • Create and maintain test plans, test scenarios, test data, traceability and release-level quality reports.
  • Triage defects, assess business and customer impact, and coordinate defect prioritization with relevant teams.
  • Test AI/ML model integrations end to end, including request/response contracts, preprocessing and post-processing, timeout/retry behavior, failure handling and fallback paths.
  • Build model-focused test suites using representative and edge-case datasets; assess output correctness against agreed reference labels or acceptance criteria, and track metrics such as precision/recall where applicable.
  • Validate LLM-enabled workflows for groundedness, consistency, hallucination risks, prompt/input sensitivity and regression when prompts, models or versions change; use defined evaluation criteria rather than subjective checks alone.
  • Check model-service latency, throughput, rate limits, availability, version compatibility and behavior under malformed, incomplete or unexpected inputs.
  • Perform end-to-end, system integration and regression testing across UI, backend services, APIs, databases and third party/model services.
  • Establish performance baselines and report findings with actionable recommendations for capacity and scalability improvements.
  • Plan and execute performance, load, stress, spike and endurance tests; analyze throughput, latency, concurrency, resource utilization and bottlenecks.
  • Work with developers to reproduce issues, verify fixes and prevent regressions throughout the release cycle.
  • Own test-suite execution in non-production environments and integrate automated checks into CI/CD pipelines where appropriate.


Required Skills:

  • Strong experience testing web applications across UI, backend services, APIs, databases and end-to-end workflows.
  • Strong QA fundamentals with substantial hands-on automation experience using Python; able to design, build, maintain and scale automation frameworks rather than only execute existing scripts.
  • People leadership experience, including leading, mentoring and driving the output of a team of 3 or more QA engineers.
  • Strong API testing and debugging skills, including REST APIs, response/schema validation, authentication, error handling and service-to-service integration.
  • Experience with performance-testing tools such as JMeter, Locust, k6 or equivalent, and ability to interpret results and identify bottlenecks.
  • Working knowledge of AI/ML model evaluation and integration testing; able to define test datasets, expected outcomes, thresholds and regression checks in collaboration with data science/ML engineers.
  • Familiarity with testing LLM-based features, including prompt/version regression, groundedness and response-quality evaluation, structured-output validation and safe failure handling.
  • Comfortable validating data and service behavior using SQL, logs, metrics and traces; familiarity with CI/CD-based automated test execution is an advantage.
  • Good understanding of front-end technologies and browser-based testing, including JavaScript, HTML and CSS.
  • Hands-on experience building and maintaining automation frameworks using tools such as Pytest, Robot Framework, Selenium, Cypress or equivalent; experience with API automation is essential.
  • Experience working in Agile/Scrum teams and participating in sprint planning, refinement, reviews and release readiness.
  • A strong quality mindset and a track record of promoting automation-first, risk-based testing and continuous quality improvement.
  • Clear communication skills and the ability to work across engineering, product, QA and AI/ML teams to define and deliver quality outcomes.


Behavioral Expectations:

  • Be excited by and have a positive outlook to navigate ambiguity.
  • Passion for results and excellence.
  • Team player.
  • Must be able to get the job done by working collaboratively with others.
  • Inquisitive and analytical mind; out-of-the-box thinking.
  • Prioritize among competing opportunities, balancing consumer needs with business and product priorities, and clearly articulate the rationale behind product decisions.
  • Straightforward and professional.
  • Good communicator.
  • Maintain high energy and motivate the team.
  • A do-it-yourself orientation, consistent with the company's "roll-up-the-sleeves" culture.
  • Proactive.

Skills

API, Automation, Cypress, Python, REST, Selenium, pytest

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,326,972 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

QA
Similar stack
Same company
Pune
Hybrid · Full-Time · 6+ years exp · Master's Degree · Chennai
Python
JavaScript
TypeScript
C#
Frontend
GraphQL
Angular
React.js
JQuery
Mobile
JUnit
DevOps
Rest API
Azure
CI/CD
Jenkins
AWS
Bamboo
Buildkite
Bitbucket
GitHub
TCP/IP
Management
Jira
Agile
Scrum
Kanban
QA
TestNG
Selenium
JMeter
Cypress
Playwright
Gatling
Postman
Rest-Assured
SoapUI
Apply
In office · 10+ years exp · Bengaluru · Chennai
Python
Java
AI/ML
Anomaly Detection
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Self-Healing
MPLS
QA
Selenium
Pytest
Robot Framework
Apply
Automation Test Lead 11 hours ago
In office · Full-Time · Pune
JavaScript
TypeScript
DevOps
CI/CD
Management
Agile
QA
Selenium
Cucumber
Playwright
Postman
Rest-Assured
Apply
In office · Pune
Java
Apply
Project Lead - QA 1 day ago
In office · 10+ years exp · Pune
TypeScript
SQL
C#
C#
.NET
AI/ML
Copilot
Claude
Prompt Engineering
AI Agents
DevOps
Azure DevOps
Azure
CI/CD
Git
GitHub
Management
Jira
Agile
Scrum
QA
Playwright
Appium
BrowserStack
Rest-Assured
Applitools
Apply
In office · Internship · Bachelor's Degree
Python
JavaScript
TypeScript
C#
C#
.NET
AI/ML
LangChain
Embeddings
Prompt Engineering
AI Agents
RAG
Frontend
Angular
DevOps
Rest API
CI/CD
Git
Management
Agile
Apply
Engineering Manager 3 hours ago
In office · Full-Time · Bachelor's Degree · Lagos · Abuja
Python
Go
JavaScript
Ruby
C#
Ruby
Ruby on Rails
Frontend
React.js
Mobile
React Native
DevOps
Terraform
Azure DevOps
GitHub Actions
Azure
CI/CD
AWS
Kubernetes
Configuration Management
Apply
In office · Full-Time · 6+ years exp · Adelaide
SQL
PowerShell
C#
COBOL
C#
.NET
DevOps
Azure DevOps
Azure
CI/CD
Windows Server
Git
Management
Agile
Waterfall
Apply
Sr. Business Analyst 3 hours ago
$107k – $132k per year · Hybrid · 6+ years exp · Bachelor's Degree · Vacaville
SQL
Management
Agile
Scrum
Apply
$135k – $180k per year · Equity · In office · 8+ years exp · Bachelor's Degree
Python
MATLAB
MATLAB
Simulink
Apply
In office · Full-Time · Pune
Python
JavaScript
SQL
AI/ML
LLM
Hallucination
DevOps
Rest API
CI/CD
Management
Agile
Scrum
QA
Selenium
JMeter
Cypress
Pytest
Robot Framework
k6
Locust
Apply
In office · 5+ years exp · Pune
Python
JavaScript
SQL
AI/ML
LLM
Hallucination
DevOps
Rest API
CI/CD
Management
Agile
Scrum
QA
Selenium
JMeter
Cypress
Pytest
Robot Framework
k6
Locust
Apply
Sr. Software Engineer 25 days ago
≈ $16k – $36k per year (Estimated) · In office · 5+ years exp · Pune
Python
SQL
Python
Django
Django REST Framework
Databases
MySQL
PostgreSQL
DevOps
Rest API
Git
Management
Agile
Scrum
Apply
≈ $20k – $51k per year (Estimated) · In office · 5+ years exp · Pune
Python
SQL
Python
Django
Django REST Framework
Databases
MySQL
PostgreSQL
DevOps
Rest API
Git
Kubernetes
Management
Agile
Scrum
Apply
Senior Data Scientist 2 months ago
≈ $19k – $41k per year (Estimated) · In office · 3+ years exp · Pune
Python
Databases
Weaviate
Milvus
Pinecone
AI/ML
LangChain
Qwen
DeepSeek
LlamaIndex
LoRA
vLLM
Gemma
Fine-tuning
RLHF
Quantization
Prompt Engineering
Knowledge Distillation
AI Agents
NLP
Ollama
PEFT
QLoRA
Llama
Falcon
Mistral
Transformers
TensorFlow
PyTorch
LLM
RAG
Hallucination
Hugging Face
DPO
Agentic Workflows
Multi-Agent Systems
Model Distillation
Machine Learning
DevOps
Docker
Kubernetes
Apply
≈ $17k – $51k per year (Estimated) · Hybrid · Full-Time · 15+ years exp · Bachelor's Degree · Pune
DevOps
CI/CD
Self-Healing
Cybersecurity
Shift-Left Security
Management
Agile
QA
Selenium
JMeter
Postman
Apply
In office · Full-Time · 9+ years exp · Pune
JavaScript
TypeScript
Node JS
DevOps
Rest API
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Apply
Staff QA Engineer 1 day ago
In office · Full-Time · 7+ years exp · Pune
Python
Verilog
C++
SystemVerilog
VHDL
DevOps
CI/CD
Git
Chips/EDA
JTAG Debuggers
Apply
Hybrid · Full-Time · Pune
SQL
DevOps
Azure DevOps
Azure
Management
Agile
Scrum
Apply
Project Engineer 1 day ago
In office · Full-Time · 4+ years exp · Bachelor's Degree · Pune
Energy
IEC 61850
Apply
See all jobs
This is one of many
2,326,972 more open roles from verified company boards, updated every day.