{"id":2454313,"url":"https://alion.io/job/accrete-ai-platform-senior-engineer-qa","title":"AI Platform Senior Engineer, QA","company":{"id":27720,"name":"Accrete","domain":"accrete.ai","url":"https://alion.io/company/accrete","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Breezy","truth_index":null},"role":"QA","role_family":"QA","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Mumbai, India"],"countries":["IN"],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":{"min":1000000,"max":null,"currency":"INR","period":"year","gross":null,"usd_annual":10472},"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Hallucination","optional":false},{"name":"JavaScript","optional":false},{"name":"k6","optional":false},{"name":"LLM","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"Playwright","optional":false},{"name":"Postman","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"TypeScript","optional":false},{"name":"Agile","optional":true},{"name":"AutoGen","optional":true},{"name":"CrewAI","optional":true},{"name":"Docker","optional":true},{"name":"GitHub Actions","optional":true},{"name":"GitLab","optional":true},{"name":"Jenkins","optional":true},{"name":"Kubernetes","optional":true},{"name":"LangChain","optional":true},{"name":"NLP","optional":true},{"name":"RAG","optional":true},{"name":"Scrum","optional":true}],"status":"live","first_seen_at":"2026-10-08T13:28:04Z","employer_posted_date":"2026-10-08","last_verified_at":"2026-10-14T08:29:08Z","board_verified":true,"closed_at":null,"days_open":5,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":5},"description":"About Accrete\nAccrete is an agentic managed services company: an AI workforce that does high-stakes, judgement-heavy work for government and enterprise clients - at the economics of software, not labor.\nAt the core is Accrete’s Knowledge Engine, a dynamic context graph that captures an organization’s tacit knowledge, resolves data across silos, and builds a living, auditable ground truth. Expert agents reason against that ground truth to act on complex, high-stakes decisions - not just answer questions about them.\nFrom national security to commercial operations, Accrete delivers the work on one platform, with unlimited expert agents and expert judgement.\nAbout the Role:\nWe are seeking an AI Platform Senior Engineer, QA - Agentic AI & Automation to lead quality assurance for our agent-driven platforms and AI models. This role focuses on validating intelligent agents, non-deterministic AI outputs, and cross-product workflows using advanced automation and AI evaluation techniques.\nYou will play a key role in building our Enterprise AI Trust & Validation Framework, ensuring reliability, transparency, and scalability of AI systems.\nKey Responsibilities\nAgentic AI & System Testing\nTest multi-agent workflows, orchestration layers, and cross-domain intelligence systems\nValidate AI-generated narratives, themes, and analytical outputs.\nPerform groundedness, coherence, hallucination, and stability testing.\nTest conversational AI and chat-based agent systems.\nEvaluate consistency across multiple runs and detect output drift.\n\nAutomation & Framework Development\nDesign and maintain automation frameworks using Python, JavaScript/TypeScript, Pytest, and Playwright.\nBuild E2E automation for UI, APIs, and agent pipelines.\nDevelop reusable test utilities for AI validation and regression testing.\nIntegrate automation with CI/CD pipelines.\n\nAI Model & Evaluation Testing\nValidate in-house AI/ML models and inference pipelines.\nImplement LLM-as-Judge and semantic similarity-based validation.\nPerform statistical and comparative testing for model outputs.\nSupport testing of models deployed on AWS.\n\nAPI & Performance Engineering\nPerform API testing using Postman and automated scripts.\nDesign and execute load and stress testing.\nMonitor system performance under AI-heavy workloads.\nIdentify bottlenecks and scalability risks.\n\nQuality Strategy & Collaboration\nAnalyze business requirements, user stories, and AI specifications.\nDesign test strategies for agentic and AI-driven systems.\nWork closely with Engineering, Product, and Data Science teams.\nTrack defects, quality metrics, and release readiness.\nDrive continuous improvement in QA processes\nRequired Qualifications\n6-8+ years of experience in QA, Automation, or Quality Engineering.\nStrong proficiency in Python, JavaScript/TypeScript, Pytest, and Playwright.\nExperience testing AI systems, chatbots, or LLM-based platforms.\nStrong understanding of non-deterministic system testing.\nExperience with API testing (Postman, REST frameworks).\nHands-on experience with performance testing. (K6 familiarity is a plus).\nExperience working in Agile/Scrum environments.\nStrong analytical and debugging skills.\nExcellent communication and documentation abilities.\n\nPreferred Qualifications\nExperience with agent frameworks (LangChain, AutoGen, CrewAI, etc.).\nKnowledge of RAG systems and vector databases.\nExposure to MLOps and AI observability tools.\nExperience with cloud platforms (AWS preferred).\nFamiliarity with statistical validation and NLP evaluation.\nCI/CD experience (GitHub Actions, Jenkins, GitLab).\nFamiliarity with containerization technologies such as Docker/Kubernetes\n\nCore Competencies\nAI Quality Engineering\nAgent Workflow Validation\nAutomation Architecture\nModel Evaluation & Monitoring\nPerformance Engineering\nRisk Assessment\nCross-team Collaboration\nOwnership Mindset\n\nCareer Growth\nThis role offers growth into positions such as:\nPrincipal AI QA Engineer\nAI Systems Quality Architect\nQA Engineering Lead\nAI QA Engineering Manager\nCultural Fit & Values\nAt Accrete, success goes beyond technical expertise. We value:\nOwnership & Accountability: Drive initiatives to completion with high standards and proactive problem-solving.\nTransparency & Communication: Share information openly and give and receive constructive feedback.\nStrategic Thinking & Problem-Solving: Analyze challenges critically and develop effective, scalable solutions.\nCollaboration & Professionalism: Work effectively across teams and contribute to a culture of mutual respect.\nPassion for AI & Innovation: Stay curious, continuously learn, and push the boundaries of AI.\nGoing Beyond the Job Description: Look for opportunities to create impact beyond your immediate responsibilities.These principles shape our culture, performance expectations, and growth opportunities.\n\nCompany Benefits\nCompetitive Compensation: Aligned with experience and market standards.\nMediclaim: ₹10 lakh coverage for you and your family.\nFlexible PTO & Hybrid Work: Take time off when needed and enjoy remote flexibility in accordance with company guidelines.\nGrowth & Development: Access to professional learning opportunities and career advancement support.\nOnsite Perks: Catered lunches and snacks.\n Team Bonding: Company-sponsored social events and team activities.\nAccrete is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.","description_format":"text","description_chars":5618,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Growth opportunities","Hybrid work"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Agents","Defense AI","Knowledge Graphs"],"lifecycle":[{"event":"open","at":"2026-10-13T15:38:56Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":5,"expected_fill_days":34,"reasons":["conf:3","win:early"],"computed_at":"2026-10-14T06:34:16Z"},"pay":{"stated_usd_annual":10472,"is_top_pay":false},"html_url":"https://alion.io/job/accrete-ai-platform-senior-engineer-qa","json_url":"https://alion.io/job/accrete-ai-platform-senior-engineer-qa.json","meta":{"generated_at":"2026-10-14T11:11:56Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13371,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":27720},"rest":"https://alion.io/mcp/rest/get_company?id=27720"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Faccrete-ai-platform-senior-engineer-qa"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Faccrete-ai-platform-senior-engineer-qa"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Faccrete-ai-platform-senior-engineer-qa"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/accrete-ai-platform-senior-engineer-qa\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Faccrete-ai-platform-senior-engineer-qa"}]}