{"id":2628945,"url":"https://alion.io/job/solvd-qa-engineer-ai-feature-testing","title":"QA Engineer (AI & Feature Testing)","company":{"id":9288,"name":"Solvd","domain":"solvd.com","url":"https://alion.io/company/solvd","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":86,"open_postings":20,"ghost_share":0,"stale_share":0.55,"repost_share":0,"time_to_fill_p50_days":45,"computed_at":"2026-10-15T05:46:00Z"}},"role":"QA","role_family":"QA","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["AR","BR","PL","UA"],"hiring_countries_total":4,"salary":null,"salary_estimate":{"min_usd":36000,"max_usd":103000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":1081},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Confluence","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Jira","optional":false},{"name":"LLM","optional":false},{"name":"Playwright","optional":false},{"name":"Charles Proxy","optional":true}],"status":"live","first_seen_at":"2026-10-15T13:47:54Z","employer_posted_date":"2026-10-15","last_verified_at":"2026-10-15T19:29:22Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.\nFollowing the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery -from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.\nWe are looking for a Senior QA Engineer to join a team building and validating AI-powered and traditional features for a leading personal finance platform. You’ll own quality across web, mobile, and API - with a particular focus on testing AI/LLM-integrated components where standard deterministic methods don’t apply.\nThis role requires someone who understands the fundamental difference between testing software that has a right answer and evaluating AI outputs that have a probability distribution - and who has done both in production.\nWhat you’ll do\nPlan, design, and execute test cases for AI-powered components and traditional features, applying the appropriate methodology - eval-based or deterministic - based on the target behavior.\n\nAnalyze traditional functional requirements as well as AI model behavior specifications, prompt outputs, and edge-case scenarios.\n\nTurn business requirements, user flows, and business process procedures into comprehensive test plans, test cases, and test scripts.\n\nPerform manual feature testing across platforms and verify bug fixes.\n\nCreate clear, detailed defect reports and document unexpected AI model responses, hallucinations, and performance regressions.\n\nAssist in developing QA practices for emerging technologies including AI frameworks, and disseminate best practices across the team.\n\nBecome a subject matter expert in core systems, interfaces, business processes, and reporting tools.\n\nPartner closely with functional teams, engineers, and IT in a global environment with aligned LATAM working hours.\n\nRequired skills & experience\n5-7 years of experience in software testing across web, mobile, and API.\n\nHands-on experience with Playwright in a production testing environment - this is a primary requirement for this role.\n\nHands-on AI feature testing experience - validating AI/LLM-integrated products for accuracy, relevance, robustness against adversarial prompts, edge cases, and safety/toxicity.\n\nClear understanding of eval vs. deterministic testing - the difference between pass/fail based on exact input/output and evaluating probabilistic AI outputs using human-in-the-loop evaluations, score metrics, benchmark datasets, and semantic evaluation.\n\nStrong understanding of web and mobile application development lifecycles including iOS and Android specifics.\n\nProven experience in integration, regression, performance/load, and UAT.\n\nHands-on knowledge of browser DevTools and log monitoring.\n\nAdvanced proficiency in Jira and Confluence.\n\nExperience with test management systems.\n\nPreferred qualifications\nExperience with HTML proxy tools such as Charles Proxy or Fiddler.\n\nHands-on knowledge of Xcode logs and ADB logs.\n\nExperience in the financial services or fintech domain.\n\nBachelor’s degree in Computer Science or equivalent.\n\nWhen you join Solvd, you'll…\nShape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.\n\nBe part of a global team with equal opportunities for collaboration across continents and cultures.\n\nThrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.\n\nReady to make an impact?\nIf you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.\nSolvd is an equal opportunity employer.","description_format":"text","description_chars":4158,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[{"name":"Argentina","iso":"AR","kind":"country"},{"name":"Brazil","iso":"BR","kind":"country"},{"name":"Poland","iso":"PL","kind":"country"},{"name":"Ukraine","iso":"UA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Software Testing & QA","AI Consulting & Integration","Data Engineering & Migration Services"],"lifecycle":[{"event":"open","at":"2026-10-15T15:40:04Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":45,"reasons":["conf:3","win:early"],"computed_at":"2026-10-15T22:45:49Z"},"pay":null,"html_url":"https://alion.io/job/solvd-qa-engineer-ai-feature-testing","json_url":"https://alion.io/job/solvd-qa-engineer-ai-feature-testing.json","meta":{"generated_at":"2026-10-15T22:45:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":34526,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":9288},"rest":"https://alion.io/mcp/rest/get_company?id=9288"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsolvd-qa-engineer-ai-feature-testing"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsolvd-qa-engineer-ai-feature-testing"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsolvd-qa-engineer-ai-feature-testing"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/solvd-qa-engineer-ai-feature-testing\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsolvd-qa-engineer-ai-feature-testing"}]}