{"id":118148,"url":"https://alion.io/job/filevine-qa-analyst-lois-for-word","title":"QA Analyst - LOIS for Word","company":{"id":1213,"name":"Filevine","domain":"filevine.com","url":"https://alion.io/company/filevine","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"B","score":74,"open_postings":115,"ghost_share":0.357,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":98,"computed_at":"2026-11-10T06:52:35Z"}},"role":"QA","role_family":"QA","seniority":"junior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":58000,"max_usd":131000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":24},"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"LLM","optional":true}],"status":"live","first_seen_at":"2026-06-01T23:32:00Z","employer_posted_date":"2026-06-01","last_verified_at":"2026-11-10T09:03:49Z","board_verified":true,"closed_at":null,"days_open":161,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":161},"description":"Role Summary:\nThis role owns quality for LOIS for Word, Filevine's AI-powered legal drafting product. You'll help build and own the QA function: the test strategy, the process, and the automation. You'll work at the intersection of legal AI and product quality, evaluating everything from AI output accuracy to UI behavior across the product. A big part of this role is moving quality upstream, so it's built into how features are planned and shipped from the start.\nThe ideal candidate has 2+ years of QA experience, brings a sharp eye for both functional bugs and AI quality issues, is comfortable building from scratch in ambiguity, and gets genuinely uncomfortable shipping something they haven't tried to break.\nWhat You'll Do:\nDefine and own the test strategy, process, and QA playbook for the product\n\nMove QA upstream by partnering with product and engineering early, so test plans are ready before features ship\n\nEvaluate AI output quality across dimensions like accuracy, citation reliability, and appropriately scoped reasoning\n\nDesign and maintain evaluation sets that account for non-deterministic output and catch regressions over time\n\nTest how AI-generated edits apply to documents, including accuracy and formatting fidelity across document structures\n\nBuild automated guardrails integrated into CI/CD that cover critical flows\n\nWrite structured, reproducible bug reports\n\nPartner with legal domain experts to understand how different customer types use the product, and translate that into test coverage\n\nApproach QA with a product and design mindset. If something works but could be better, we want to hear it\n\nCompare behavior across product surfaces and document discrepancies\n\nWhat You'll Need:\n2+ years of QA experience, including ownership of test strategy for a product or major feature area\n\nTrack record of building QA process and automation from scratch in a fast-moving environment\n\nComfort operating in high ambiguity, where features ship quickly and you figure out how to test them fast\n\nStrong analytical and problem-solving skills, with attention to both functional correctness and AI output quality\n\nAbility to reason about non-deterministic systems and define what \"correct\" means when there's no single right answer\n\nExcellent written communication, with the ability to write clear, concise, actionable bug reports backed by evidence\n\nExperience with bug tracking tools and test management workflows\n\nNice To Have:\nExperience testing AI or LLM-based products, especially for output accuracy and eval design\n\nCI/CD experience setting up pipelines and release gates for automated tests\n\nA design or UX sensibility, with an eye for where product workflows could be smoother\n\nPrior experience in legal technology or comfort reading legal contracts\n\nProgramming experience beyond test automation","description_format":"text","description_chars":2826,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Legal Software"],"lifecycle":[{"event":"open","at":"2026-06-01T23:32:00Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 2","filings_12m":2,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":82500,"route":null,"cap_exempt":false,"checked_at":"2026-11-09T07:32:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":27,"band":"fade","label":"Fading","p_open":1,"p_active":0.757,"p_room":0.36,"age_days":161,"expected_fill_days":98,"reasons":["conf:3","velocity","win:tail","crowd:junior,brand"],"computed_at":"2026-11-10T06:52:35Z"},"pay":null,"html_url":"https://alion.io/job/filevine-qa-analyst-lois-for-word","json_url":"https://alion.io/job/filevine-qa-analyst-lois-for-word.json","meta":{"generated_at":"2026-11-10T09:27:21Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":22006,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1213},"rest":"https://alion.io/mcp/rest/get_company?id=1213"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffilevine-qa-analyst-lois-for-word"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffilevine-qa-analyst-lois-for-word"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffilevine-qa-analyst-lois-for-word"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/filevine-qa-analyst-lois-for-word\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffilevine-qa-analyst-lois-for-word"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":118148}},{"tool":"search_jobs","arguments":{"company":"filevine.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":118148},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}