{"id":3713895,"url":"https://alion.io/job/tribalscale-agentic-qa-engineer","title":"Agentic QA Engineer","company":{"id":689537,"name":"TribalScale","domain":"tribalscale.com","url":"https://alion.io/company/tribalscale-2","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":null},"role":"QA","role_family":"QA","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Toronto, Canada"],"countries":["CA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"Git","optional":false},{"name":"JavaScript","optional":false},{"name":"LLM","optional":false},{"name":"Node JS","optional":false},{"name":"Python","optional":false},{"name":"React Native","optional":false},{"name":"TypeScript","optional":false},{"name":"CrewAI","optional":true},{"name":"Cypress","optional":true},{"name":"LangChain","optional":true},{"name":"LangGraph","optional":true},{"name":"Playwright","optional":true},{"name":"Pytest","optional":true},{"name":"React.js","optional":true},{"name":"Selenium","optional":true}],"status":"live","first_seen_at":"2026-11-03T22:18:56Z","employer_posted_date":"2026-11-03","last_verified_at":"2026-11-07T03:44:07Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"Shape the Future with TribalScale\nTribalScale is a digital innovation firm that helps organizations adapt and thrive in a rapidly changing world. We partner with clients to build transformative digital products, modernize technology platforms, and apply emerging technologies-including artificial intelligence-to meaningful business challenges.\nOur teams work closely with clients from strategy through execution. We value curiosity, ownership, practical innovation, and people who are comfortable turning ambiguity into action.\nOur Digital Expertise\nTransformation Experts: We transform traditional business models into agile, AI-powered ecosystems.\nStrategic Visionaries: We navigate the uncharted waters of technological evolution.\nProduct Virtuosos: We orchestrate the creation of world-class digital solutions.\nCode Optimizers: We leverage AI to refine and perfect digital systems.\nOur Technological Toolkit\n Mobile & Web Development: (iOS, Android, React Native, React, Node.js)\n Voice-Activated Platforms: (Amazon Alexa, Google Home)\n Connected Ecosystems: (Cars and Homes)\n Streaming Platforms: (Roku, Fire TV, Android TV, tvOS)\nThe TribalScale Professional\nYou thrive in challenging environments where innovation is key. Your passion for technology is matched only by your drive to redefine its limits. You seek more than a job; you seek a calling-a chance to make a lasting impact on the digital landscape.\nAgentic QA Engineer\nJob title: Agentic QA Engineer\nCompany: TribalScale\nLocation: [To be confirmed]\nEmployment type: [To be confirmed]\nAbout TribalScale\nTribalScale is an innovation company focused on helping organizations build and scale digital products and AI-powered solutions. The team works at the intersection of emerging technologies, product development, and engineering to bring innovative solutions into production.\nAbout the Role\nTribalScale is looking for an Agentic QA Engineer who combines strong software testing and quality engineering expertise with hands-on experience in AI-powered applications and agentic systems.\nThis role is similar to a Forward Deployed Engineer (FDE) or Agentic Engineer, with a particular focus on software quality, test automation, and validating AI-driven workflows. You will help ensure that AI agents and LLM-powered applications perform reliably in real-world environments by designing testing strategies, building automated evaluation frameworks, and identifying edge cases and failure modes.\nThe ideal candidate is a hands-on engineer who can write code, debug complex systems, and apply software testing principles to applications where outputs may be dynamic, nondeterministic, and dependent on multi-step agent interactions.\nKey Responsibilities\nDesign and implement testing strategies for AI agents, LLM-powered applications, and agentic workflows.\nBuild automated test frameworks for functional, integration, regression, and end-to-end testing.\nDevelop evaluation pipelines to measure agent accuracy, reliability, task completion, and consistency.\nTest agent tool usage, API integrations, multi-step reasoning workflows, and interactions with external systems.\nIdentify, reproduce, and troubleshoot failures such as hallucinations, incorrect tool calls, unexpected outputs, and workflow breakdowns.\nEstablish quality metrics, evaluation datasets, test scenarios, and benchmarks for AI-driven applications.\nIntegrate automated testing and quality checks into CI/CD pipelines.\nCollaborate with AI engineers, software developers, product teams, and client-facing engineering teams to improve system reliability.\nInvestigate production issues and use findings to improve agent behavior, test coverage, and application performance.\nEvaluate edge cases, failure recovery, security considerations, and resilience in AI-powered systems.\nRequired Qualifications\nProfessional experience in Software QA, Quality Engineering, SDET, Test Automation, or Software Engineering with a strong testing focus.\nProficiency in Python, JavaScript, TypeScript, or another relevant programming language.\nExperience building automated tests and testing frameworks.\nStrong understanding of API, integration, regression, and end-to-end testing.\nExperience debugging applications and investigating complex technical issues.\nFamiliarity with Git, CI/CD pipelines, and modern software development practices.\nStrong analytical thinking and the ability to design test cases for complex, real-world scenarios.\nPreferred Qualifications\nExperience testing LLM-based applications, AI agents, or generative AI products.\nFamiliarity with agentic frameworks such as LangGraph, LangChain, CrewAI, or similar technologies.\nExperience with LLM evaluation, prompt testing, model benchmarking, or AI observability.\nFamiliarity with tools such as Pytest, Playwright, Cypress, or Selenium.\nUnderstanding of hallucinations, nondeterministic outputs, prompt injection, and agent tool-use failures.\nExperience with cloud platforms, APIs, distributed systems, and production deployments.\nPrevious experience in Agentic Engineering, Forward Deployed Engineering, Applied AI Engineering, or AI product development.\nIdeal Candidate\nThe ideal candidate combines the engineering mindset of an FDE or Agentic Engineer with the quality-focused approach of an experienced QA Automation Engineer or SDET.\nCandidates with strong programming and automation skills who have tested AI-powered applications are especially relevant. We are also open to Agentic Engineers or FDEs who have meaningful experience building testing frameworks, validating complex workflows, and improving software reliability.\nCore focus: AI agent reliability, software testing, test automation, and production-ready AI systems.\nWhy Choose TribalScale\nAt TribalScale, collaboration is at the heart of our innovative approach. We don't simply work for clients; we form partnerships, building transformative solutions that redefine what's possible. Our team, once at the forefront of the mobile revolution, now leads the charge in AI-driven innovation.\nWe empower each team member to be a catalyst for change, adhering to our principles of meritocracy, empowerment, and transparency. Diversity isn't just celebrated-it's fundamental to our strength. Our mission to \"Right the Future\" is a call to action to make a significant impact in the world of innovation.\nDiversity: Our Collective Strength\nTribalScale proudly stands as a beacon of equal opportunity in employment and workplace culture. We are steadfastly committed to equal employment opportunity, transcending the boundaries of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, able-bodiedness, or gender identity.\nWe not only welcome but actively encourage applications from individuals of all abilities, ages, citizenships, marital statuses, and gender identities. Your unique perspective is the key to our collective innovation.\nShould you require any accommodations, we implore you to inform us. Our commitment to inclusivity knows no bounds, and we stand ready to adapt our processes to ensure your comfort and success.","description_format":"text","description_chars":7124,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Mobile App Development Services","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-11-04T00:14:48Z"}],"visa":[{"country":"CA","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"Approved LMIA in the last two years","filings_12m":0,"filings_prev_12m":1,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":null,"cap_exempt":false,"checked_at":"2026-11-06T22:34:35+00:00","sources":["ESDC: employers issued a positive LMIA"],"filings_for_role_12m":0}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":2,"expected_fill_days":30,"reasons":["conf:0","velocity","win:early"],"computed_at":"2026-11-06T05:58:05Z"},"pay":null,"html_url":"https://alion.io/job/tribalscale-agentic-qa-engineer","json_url":"https://alion.io/job/tribalscale-agentic-qa-engineer.json","meta":{"generated_at":"2026-11-07T04:19:36Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10563,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":689537},"rest":"https://alion.io/mcp/rest/get_company?id=689537"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftribalscale-agentic-qa-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftribalscale-agentic-qa-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftribalscale-agentic-qa-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tribalscale-agentic-qa-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftribalscale-agentic-qa-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3713895}},{"tool":"search_jobs","arguments":{"company":"tribalscale.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3713895},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}