{"id":4256236,"url":"https://alion.io/job/provenir-quality-assurance-engineer-2","title":"Quality Assurance Engineer","company":{"id":686190,"name":"Provenir","domain":"provenir.com","url":"https://alion.io/company/provenir","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"QA","role_family":"QA","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"Amazon Neptune","optional":false},{"name":"CI/CD","optional":false},{"name":"GitHub Actions","optional":false},{"name":"GitLab CI","optional":false},{"name":"Jenkins","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Machine Learning","optional":false},{"name":"Neo4j","optional":false},{"name":"Playwright","optional":false},{"name":"Postman","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Ruby","optional":false},{"name":"Selenium","optional":false},{"name":"Shift-Left Security","optional":false},{"name":"SQL","optional":false},{"name":"Swagger","optional":false},{"name":"Unix","optional":false},{"name":"Ansible","optional":true},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"Docker","optional":true},{"name":"GCP","optional":true},{"name":"Hallucination","optional":true},{"name":"Kubernetes","optional":true},{"name":"LangChain","optional":true},{"name":"LangGraph","optional":true},{"name":"Model Context Protocol","optional":true},{"name":"Spark","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-11-13T14:09:01Z","employer_posted_date":"2026-11-13","last_verified_at":"2026-11-14T09:25:06Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Who We Are\nProvenir is the unified Decision Intelligence Platform that gives enterprises full control over end- to-end customer decisioning - to manage risk, drive growth, and transform business outcomes. By consolidating data, AI models, intelligence, agents and governance into a single decisioning environment, Provenir empowers business teams to configure and evolve strategy directly, while maintaining enterprise-grade reliability and regulatory compliance. Trusted by 120+ institutions in 60+ countries, Provenir processes over 4 billion decisions annually - turning architectural coherence into sustained risk performance and measurable value. Ready to solve meaningful challenges, work with enterprise customers, and help shape the future of AI-powered decisioning? Join us.\nThe QA Engineer will be responsible for assuring the quality of our products, creating automated tests, and managing builds and continuous integration. You will automate tests for microservices and their related front ends, and manage infrastructure across development and production cloud environments.\nThis role goes beyond conventional application testing. Our platform combines graph data stores, graph analytics, machine learning models, and agentic AI workflows - systems whose outputs are probabilistic, whose correctness is contextual, and whose decisions carry regulatory weight. You will help define what “passing” means for components that don’t return the same answer twice, and build the harnesses that hold them to it.\nWhat You’ll Do\nCore Test Automation\nBuild and maintain end-to-end and component test suites using modern browser automation with auto-waiting, trace-based debugging, and parallel execution as the default\n\nShape coverage around the test pyramid rather than the UI - API and contract tests as the primary safety net, with UI reserved for genuine user journeys\n\nEmbed quality gates directly in CI/CD pipelines - sharded parallel runs, risk-based test selection, and pass/fail criteria that block promotion without manual sign-off\n\nProvision ephemeral, containerised test environments on demand through infrastructure-as-code, with synthetic and masked test data generated per run instead of maintained by hand\n\nTreat test reliability as a product: track flake rates, quarantine and fix unstable tests, and hold suites to explicit stability and runtime SLAs\n\nUse AI-assisted tooling for test authoring, coverage gap analysis, and locator resilience - while owning the judgement call on what the generated tests are actually worth\n\nWork shift-left alongside engineers - contributing test coverage with the feature, not after it - and partner on triage to drive issues to root cause\n\nGraph Data and Analytics\nDesign and automate validation for graph database layers - schema integrity, relationship correctness, and query behaviour across Cypher, Gremlin, or SPARQL\n\nBuild regression coverage for graph analytics outputs: pathfinding, centrality, community detection, and link analysis used in fraud-ring identification and network risk scoring\n\nValidate graph ingestion and transformation pipelines for data completeness, deduplication, and referential accuracy at scale\n\nAI/ML and Agentic Systems\nDevelop evaluation harnesses for ML model behaviour - accuracy thresholds, drift detection, bias and fairness checks, and explainability outputs required for regulatory review\n\nBuild automated test suites for agentic workflows: tool-calling correctness, multi-step orchestration, context handling, failure recovery, and guardrail enforcement\n\nDesign assertion strategies for non-deterministic outputs, including golden-set comparison, semantic similarity scoring, and LLM-as-judge evaluation\n\nEstablish prompt and model regression testing so behavioural changes are caught before release\n\nValidate feature pipelines and training/serving consistency in partnership with data science teams\n\nProcess and Platform\nIncorporate best practices into dev/test/deploy processes and recommend improvements\n\nSupport application onboarding to the defined target operating model to achieve build and release automation\n\nDocument, track, and escalate issues as appropriate\n\nWhat’s Required\nEducation: A Bachelor’s Degree in Computer Science or a related field.\nExperience: Proven track record of extensive hands-on experience in automated testing of web applications and services, including designing, developing, and executing automated tests in Python using a modern browser automation framework (Playwright, Selenium WebDriver, or equivalent).\nQualifications, Strengths and Skills\nDemonstrated understanding of maintainable test architecture - Page Object Model or equivalent patterns - for end-to-end testing\n\nExtensive hands-on experience on Python scripting\n\nExperience testing web services and REST APIs (Postman, Swagger)\n\nWorking knowledge of graph databases - Neo4j, Amazon Neptune, TigerGraph, JanusGraph or similar - including writing and validating graph queries\n\nExposure to testing AI/ML-backed features, and a clear grasp of why probabilistic systems need different assertions than deterministic ones\n\nScripting experience beyond Python: Unix shell, Ruby, or similar\n\nContinuous integration and pipeline-based delivery (Jenkins, GitHub Actions, GitLab CI, or similar)\n\nExperience with SQL\n\nExperience recommending process improvements\n\nNice to Have\nHands-on experience with agentic frameworks - LangChain, LangGraph, Model Context Protocol (MCP), or comparable orchestration tooling\n\nFamiliarity with LLM evaluation tooling and practices: golden datasets, rubric-based scoring, hallucination and jailbreak testing, red-teaming\n\nGraph analytics libraries such as Neo4j GDS, Apache Spark GraphX, or NetworkX\n\nObservability-driven testing - synthetic monitoring, canary analysis, and validation through traces, logs and metrics\n\nDocker, Kubernetes, Terraform, Ansible; microservices, container deployment and service orchestration\n\nCloud APIs (AWS, Azure, GCP)\n\nJIRA for issue tracking and escalation\n\nOur employees are our top priority; we offer comprehensive health and wellness plans. You will enjoy paid time off and company holidays, flexible and remote-friendly opportunities, and maternity/paternity leave.\nAt Provenir, we recognize that diversity and inclusion make our teams stronger. We are committed to equal employment opportunity and welcome everyone regardless of race, colour, ancestry, religion, national origin, age, sex, gender identity, sexual orientation, disability, marital status, domestic partner status, citizenship, or veteran status or medical condition. We encourage people from all backgrounds to apply.","description_format":"text","description_chars":6640,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"},{"name":"Bengaluru","iso":null,"kind":"city"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Fraud Detection","Decision Intelligence"],"lifecycle":[{"event":"open","at":"2026-11-13T14:15:36Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":67,"reasons":["conf:3","win:early"],"computed_at":"2026-11-14T05:58:10Z"},"pay":null,"html_url":"https://alion.io/job/provenir-quality-assurance-engineer-2","json_url":"https://alion.io/job/provenir-quality-assurance-engineer-2.json","meta":{"generated_at":"2026-11-14T12:53:20Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12802,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":686190},"rest":"https://alion.io/mcp/rest/get_company?id=686190"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fprovenir-quality-assurance-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fprovenir-quality-assurance-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fprovenir-quality-assurance-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/provenir-quality-assurance-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fprovenir-quality-assurance-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4256236}},{"tool":"search_jobs","arguments":{"company":"provenir.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4256236},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}