{"id":464069,"url":"https://alion.io/job/rootstrap-ssr-qa-engineer","title":"Ssr QA Engineer","company":{"id":178906,"name":"Rootstrap","domain":"rootstrap.com","url":"https://alion.io/company/rootstrap","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"PeopleForce","truth_index":null},"role":"QA","role_family":"QA","seniority":"middle","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["Uruguay"],"countries":["UY"],"hiring_countries":["UY"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Claude","optional":false},{"name":"LLM","optional":false},{"name":"Playwright","optional":false},{"name":"RAG","optional":false},{"name":"Arize Phoenix","optional":true},{"name":"Braintrust","optional":true},{"name":"CI/CD","optional":true},{"name":"LangSmith","optional":true},{"name":"Promptfoo","optional":true}],"status":"closed","first_seen_at":"2026-09-06T11:54:43Z","employer_posted_date":"2026-09-18","last_verified_at":"2026-10-29T01:12:23Z","board_verified":false,"closed_at":"2026-10-29T01:12:23Z","days_open":52,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":52},"description":"Driven by our enthusiasm for meeting new talents and fostering connections within the community and as part of our profile mapping program, we are now exploring diverse roles, including Semi Senior QA Engineer to expand the QA area. It’s important to note that, in this instance, the role does not involve immediate hiring but rather serves as a part of a pipeline for future recruitments.\nWe're looking for aQA Engineer with experience testing AI-powered applications. The ideal candidate has hands-on experience evaluating non-deterministic AI systems (LLMs, AI agents, and RAG applications) and building or maintaining evaluation frameworks (eval engineering) to measure quality, detect regressions, and improve AI system performance.\nWhat are the main responsibilities of this role?\nCreate detailed, comprehensive, and well-structured test plans and test cases.\n\nReview client needs and technical specifications with the development team to provide timely and meaningful feedback.\n\nEstimate, prioritize, plan, and coordinate testing activities.\n\nIdentify, record, document thoroughly, and track bugs.\n\nDesign, develop, and execute automation scripts (including Playwright-based automation).\n\nPerform thorough regression testing when bugs are resolved.\n\nTrack quality assurance metrics and reports.\n\nDesign and maintain evaluation suites (evals) to validate AI-powered features and detect regressions in model behavior.\n\nTest non-deterministic AI systems, including LLM-based features, AI agents, and RAG applications, using qualitative and quantitative evaluation methods.\n\nAnalyze AI outputs, identify failure patterns (hallucinations, instruction-following issues, grounding, etc.), and collaborate with engineers to improve system quality.\n\nStay up to date with new testing tools, AI evaluation techniques, and quality assurance strategies while driving continuous improvement.\n\nInvestigate the causes of software defects and collaborate with the development team to implement preventive solutions.\n\nCollaborate on internal initiatives.\n\nWhich skills and experience do we envision for this role?\nBackground in Software Engineering, Computer Science, or a related field.\n\n3+ years of experience as a QA Engineer.\n\nAdvanced English skills.\n\nHands-on experience with mobile testing (required).\n\nExperience with test automation, preferably using Playwright.\n\nExperience using AI tools (e.g., Claude or similar) to optimize testing processes, including test case creation, bug reporting, edge case identification, and automation support.\n\nExperience testing AI-powered applications or LLM-based systems.\n\nUnderstanding of the challenges of testing non-deterministic systems and validating AI-generated outputs.\n\nExperience with evaluation engineering, including building or maintaining evals, benchmark datasets, or automated AI quality evaluations.\n\nNice to have:\nKnowledge of CI/CD pipelines and automated test integration.\n\nExperience testing AI agents, RAG applications, or conversational AI systems.\n\nFamiliarity with AI evaluation frameworks or LLM observability tools such as LangSmith, Braintrust, Arize Phoenix, Promptfoo, OpenEvals, or similar.\n\nJoin our team and enjoy:\nAccess to Certifications, and a Mentorship Program for your professional growth.\n\nLearning Bonus.\n\nOpportunities to organize cross-functional initiatives and receive 360 Feedback to improve your skills continuously.\n\nThe flexibility to work remotely or from our offices in Montevideo, Buenos Aires, and Medellín, with a flexible time schedule and Workation program.\n\nGym benefits, psychological counseling, and weekly lunch reimbursements with special foods in the offices.\n\nAn Onboarding kit and access to cutting-edge technologies and tools to make your work easier.\n\nAfter offices, Prizes, and special occasions gifts to celebrate your achievements.\n\nPeople Care referent to support your well-being and personal development.\n\nWe value your well-being and happiness. We grow together!\nHow we work:\nWe offer a flexible and diverse work environment that fosters multicultural talent\n\nWe value autonomy and creativity, We want people to bring ideas to the table and to think as leaders.\n\nWe put our focus on real human connections\n\nWe have a commitment to excellence\n\nAt Rootstrap, we help companies launch, grow, and scale their digital products and services. With over 160 global team members, we’ve built solutions for industry leaders like MasterClass, Universal, and Google, as well as for innovative startups and inspired pioneers. Our team takes pride in making an impact that goes beyond the code, earning regular recognition as a Fastest Growing Company and Best B2B Service Provider.\nWe embrace an AI-first mindset, continuously exploring how artificial intelligence can enhance the way we build products, solve problems, and deliver value. Across all stages of the development process, we encourage our teams to actively leverage AI to boost productivity and drive innovation.\nWith offices in Uruguay, Argentina, and Colombia, we offer the flexibility to work remotely. Discover more about life at Rootstrap at https://www.rootstrap.com/careers.\nAll of our candidate searches are covered under Uruguayan Law 19691 (the purpose of this law is to promote the inclusion of people with disabilities).\nAs part of our Security and Compliance process, all seniority levels and roles must follow the company’s information security policies and secure development practices, and promptly report any suspected security incidents or vulnerabilities.","description_format":"text","description_chars":5531,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Advanced (C1)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Uruguay","iso":"UY","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Mobile App Development Services","Web Development Services","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-09-06T11:54:43Z"},{"event":"close","at":"2026-10-29T01:12:23Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/rootstrap-ssr-qa-engineer","json_url":"https://alion.io/job/rootstrap-ssr-qa-engineer.json","meta":{"generated_at":"2026-10-30T11:06:09Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15969,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":178906},"rest":"https://alion.io/mcp/rest/get_company?id=178906"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Frootstrap-ssr-qa-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Frootstrap-ssr-qa-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Frootstrap-ssr-qa-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/rootstrap-ssr-qa-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Frootstrap-ssr-qa-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":464069}},{"tool":"search_jobs","arguments":{"company":"rootstrap.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":464069},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}