{"id":1191632,"url":"https://alion.io/job/nexaminds-principal-backend-qa-engineer-ai-2","title":"Principal Backend QA Engineer (AI)","company":{"id":2681241,"name":"Nexaminds","domain":"nexaminds.ai","url":"https://alion.io/company/nexaminds","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":null},"role":"QA","role_family":"QA","seniority":"lead","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["CA","MX"],"hiring_countries_total":2,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"AI Agents","optional":false},{"name":"LLM","optional":false},{"name":"Postman","optional":false},{"name":"Shift-Left","optional":false},{"name":"Shift-Left Security","optional":false},{"name":"Google ADK","optional":true},{"name":"Model Context Protocol","optional":true},{"name":"Swagger","optional":true}],"status":"closed","first_seen_at":"2026-09-04T20:09:12Z","employer_posted_date":"2026-09-08","last_verified_at":"2026-09-29T01:08:59Z","board_verified":false,"closed_at":"2026-09-29T01:08:59Z","days_open":24,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":24},"description":"Unlock Your Future with Nexaminds!\nAt Nexaminds, we're on a mission to redefine industries with AI. We're passionate about the limitless potential of artificial intelligence to transform businesses, streamline processes, and drive growth.\nJoin us on our visionary journey. We're leading the way in AI solutions, and we're committed to innovation, collaboration, and ethical practices. Become a part of our team and shape the future powered by intelligent machines. If you're driven by ambition, success, fun, and learning, Nexaminds is where you belong.\nNexaminds is looking for a Senior Backend QA Engineer with strong API automation expertise and a focus on AI System Validation. In this role, you will be responsible for designing automated test frameworks, analyzing upstream service architectures, and validating non-deterministic systems (such as AI agents and chatbots). The ideal candidate excels at structuring high-quality test plans from complex requirements, utilizing modern automation frameworks, and leveraging AI techniques (like LLM as a Judge and scoring evaluations) to test applications beyond traditional deterministic methods.\nLocation: CANADA\nQualifications we are looking for:\nAPI & Backend Automation: Strong hands-on experience in API test automation using Karate Framework and manual API testing with Postman.\nAI & Non-Deterministic Testing: Understanding of testing non-deterministic systems, including response scoring techniques, AI agent/chatbot validation, or evaluation concepts like LLM as a Judge.\nTechnical Code Analysis: Ability to read and analyze source code to understand backend architectures, microservices, service dependencies, and upstream impacts.\nStructured Test Planning: Proven skill in reviewing requirement documents to create concise, precise test plans and automation frameworks without relying on rigid language-specific constraints.\n Local Environment Setup: Hands-on experience configuring local dev environments for early-stage (shift-left) test execution. \nA proactive approach to learning emerging AI technologies and building dynamic testing solutions where standard deterministic QA falls short.\nClear, structured, and direct technical communication.\nNice to have:\nHands-on experience with the Agent Development Kit (ADK) or MCP applications.\nBackground in contract testing or microservices architecture validation.\nPrior experience working in complex enterprise environments (e.g., retail or large-scale backend systems).\nJob duties:\nAPI Testing & Automation: Analyze OpenAPI/Swagger specs to design comprehensive test plans, execute manual testing via Postman, and build robust automated test suites using the Karate Framework.\n AI System & Agent Validation: Test and evaluate non-deterministic AI outputs, internal AI agents (built with ADK), and MCP applications using evaluation metrics and scoring techniques.\nArchitecture & Upstream Analysis: Inspect source code and upstream services to identify critical dependencies, evaluate technical system impacts, and manage test data across pre-production and production environments.\nShift-Left & Local Testing: Configure and launch local development environments to conduct early-stage testing on backend APIs and microservices before deployment.\nAI-Integrated Test Frameworks: Design scalable test automation strategies that dynamically integrate AI capabilities to validate scenarios standard testing tools cannot handle.\nWhat you can expect from us\nHere at Nexaminds, we're not your typical workplace. We're all about creating a friendly and trusting environment where you can thrive. Why does this matter? Well, trust and openness lead to better quality, innovation, commitment to getting the job done, efficiency, and cost-effectiveness.\nStock options \nRemote work options \nFlexible working hours \nBenefits above the law\nBut it's not just about the work; it's about the people too. You'll be collaborating with some seriously awesome IT pros.\nYou'll have access to mentorship and tons of opportunities to learn and level up.\nReady to embark on this journey with us? If you're feeling the excitement, go ahead and apply!","description_format":"text","description_chars":4136,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Stock options"],"hiring_locations":[{"name":"Canada","iso":"CA","kind":"country"},{"name":"Mexico","iso":"MX","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Professional Services","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-09-24T16:59:15Z"},{"event":"close","at":"2026-09-29T01:08:59Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/nexaminds-principal-backend-qa-engineer-ai-2","json_url":"https://alion.io/job/nexaminds-principal-backend-qa-engineer-ai-2.json","meta":{"generated_at":"2026-10-19T21:25:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":476,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2681241},"rest":"https://alion.io/mcp/rest/get_company?id=2681241"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnexaminds-principal-backend-qa-engineer-ai-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnexaminds-principal-backend-qa-engineer-ai-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnexaminds-principal-backend-qa-engineer-ai-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nexaminds-principal-backend-qa-engineer-ai-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnexaminds-principal-backend-qa-engineer-ai-2"}]}