{"id":2101838,"url":"https://alion.io/job/evolver-agency-sr-qa-lead","title":"Senior Quality Assurance Engineering Lead","company":{"id":155158,"name":"Evolver","domain":"evolver.agency","url":"https://alion.io/company/evolver","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":70,"open_postings":18,"ghost_share":0.5,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-17T05:46:00Z"}},"role":"QA","role_family":"QA","seniority":"lead","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Palo Alto, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":119000,"max_usd":253000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":139},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"LLM","optional":false},{"name":"Playwright","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Selenium","optional":false}],"status":"live","first_seen_at":"2026-10-08T18:26:26Z","employer_posted_date":"2026-10-12","last_verified_at":"2026-10-17T16:22:32Z","board_verified":true,"closed_at":null,"days_open":8,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":8},"description":"About Us \nWe are an innovative AI startup with a team of 100+ people focused on transforming core enterprise functions in Fortune 500 companies. Our platform combines a rich understanding of a company’s current state with deep domain expertise to execute these functions with accuracy and consistency through deterministic code, statistical methods, and guided ML and LLM execution. It handles processes end-to-end, engaging humans when needed to maximize efficiency and quality. \nJoin us at the forefront of AI innovation, where your expertise will directly shape the future of enterprise operations. \nRole Overview \nWe are looking for a hands-on Senior Quality Assurance Engineering Lead to lead our QA team and ensure the quality of processes and outputs across our enterprise platform. You will set the team’s priorities, define our quality strategy, build scalable test automation, and establish standards for validating end-to-end processes and the accuracy, completeness, and consistency of their outputs. \nWorking closely with engineering, product managers, and domain experts, you will validate how the platform uses company state and domain knowledge across deterministic code and guided LLM execution. This role combines team leadership, practical test engineering, and mentorship to ensure our solutions are reliable, secure, and ready for production. \nKey Responsibilities \nProcess and Output Quality: Own the quality strategy across the development lifecycle, working with product managers and domain experts to define test plans, acceptance criteria, and release standards. Validate that enterprise processes use the correct company state and domain rules to produce accurate, complete, and consistent outputs. \nDevelop evaluation frameworks and datasets to validate business logic, accuracy, grounding, retrieval relevance, and consistency. Test the handoffs between deterministic code and guided LLM execution, including state updates, failure recovery, and human review paths. \nQA Team Leadership: Lead and mentor the QA team, set priorities, coordinate testing activities, and develop the team’s capabilities to ensure the quality of processes and outputs. \nTest Automation and Continuous Delivery: Build and maintain Python-based automation for APIs, services, user interfaces, and end-to-end workflows, integrating tests and quality gates into CI/CD pipelines. \nReliability and Continuous Improvement: Lead validation of Azure-based applications for scalability, performance, resilience, data integrity, and security. Partner with engineering to resolve defects, prevent regressions, and use quality metrics to improve processes and outputs. \nQualifications \nExperience \n6+ years of experience in quality assurance or quality engineering, including substantial hands-on test automation experience. \n2+ years of experience leading QA teams, setting testing priorities, establishing quality standards, and mentoring engineers. \nExperience validating end-to-end business processes and assessing the accuracy, completeness, and consistency of their outputs. \nHands-on experience evaluating AI/ML or Generative AI applications, preferably platforms that combine deterministic business logic, company data, and guided LLM execution. \nExperience testing cloud-native applications, preferably on Azure. \nEducation \nBachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience. \nTechnical Skills \nExperience validating business rules, company-state representations, state transitions, and data consistency across deterministic and LLM-supported processing. \nExperience with API testing, integration testing, end-to-end automation, and browser testing tools such as Playwright or Selenium. \nStrong proficiency in Python and automated testing frameworks such as pytest or equivalent tools. \nExperience creating evaluation datasets, scoring rubrics, regression benchmarks, and repeatable evaluation workflows. \nExperience with performance testing, observability, and debugging distributed applications. \nFamiliarity with Azure services, including Azure Functions, Azure Databases, and Azure AI Foundry. \nSoft Skills \nStrong team leadership skills, with the ability to set clear expectations, coach engineers, and build shared accountability for quality. \nExcellent communication skills, including the ability to explain quality risks and release tradeoffs clearly. \nStrong analytical judgment and a practical approach to problem-solving. \nAbility to balance release speed with reliability and prioritize testing according to business impact. \nComfort working in a dynamic startup environment with evolving requirements. \nBenefits \nCompetitive Compensation: Tailored to your experience and skill set. \nFlexible Work Arrangements: A hybrid working model that supports work-life balance. \nCareer Growth: Opportunities for professional development and expanded technical leadership. \n Innovative Culture: Work on transformative technologies and help establish the quality standards behind impactful AI solutions.","description_format":"text","description_chars":5075,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Hybrid work","Professional development"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Decision Intelligence","Financial AI"],"lifecycle":[{"event":"open","at":"2026-10-08T18:50:15Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 4 · green card filings: 1","filings_12m":4,"filings_prev_12m":1,"green_card_filings_12m":1,"median_offered_wage_usd":159500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":0}],"liveness":{"score":57,"band":"ok","label":"Likely open","p_open":1,"p_active":0.574,"p_room":1,"age_days":8,"expected_fill_days":30,"reasons":["conf:2","stale_co","win:early"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/evolver-agency-sr-qa-lead","json_url":"https://alion.io/job/evolver-agency-sr-qa-lead.json","meta":{"generated_at":"2026-10-17T17:51:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":378,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":155158},"rest":"https://alion.io/mcp/rest/get_company?id=155158"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fevolver-agency-sr-qa-lead"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fevolver-agency-sr-qa-lead"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fevolver-agency-sr-qa-lead"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/evolver-agency-sr-qa-lead\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fevolver-agency-sr-qa-lead"}]}