{"id":138285,"url":"https://alion.io/job/wolters-kluwer-lead-software-test-automation-engineer-test-architect-agentic-ai","title":"Lead Software Test Automation Engineer | Test Architect - Agentic AI","company":{"id":2555,"name":"Wolters Kluwer","domain":"wolterskluwer.com","url":"https://alion.io/company/wolters-kluwer","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":81,"open_postings":76,"ghost_share":0.039,"stale_share":0.645,"repost_share":0.066,"time_to_fill_p50_days":33,"computed_at":"2026-10-29T05:49:05Z"}},"role":"QA","role_family":"QA","seniority":"lead","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Tampa, United States","Minneapolis, United States","Austin, United States","Houston, United States","United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":71000,"max_usd":155000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":167},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"C#","optional":false},{"name":"CI/CD","optional":false},{"name":"Cypress","optional":false},{"name":"GitHub","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Hallucination","optional":false},{"name":"JavaScript","optional":false},{"name":"Jenkins","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"Playwright","optional":false},{"name":"Postman","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Rest-Assured","optional":false},{"name":"Selenium","optional":false},{"name":"Shift-Left Security","optional":false},{"name":"Supertest","optional":false},{"name":"TypeScript","optional":false}],"status":"live","first_seen_at":"2026-08-26T00:00:00Z","employer_posted_date":"2026-08-26","last_verified_at":"2026-10-29T01:15:38Z","board_verified":true,"closed_at":null,"days_open":64,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":64},"description":"We are seeking aLead Test Automation Architect to define and lead an enterprise-gradetest automation strategy across UI, API, data, and platform layers-while evolving our quality engineering capabilities to support Agentic AI / LLM-based systems (probabilistic outputs, confidence-based validation, hallucination detection, and model evaluation). This role will architect scalable automation frameworks, drive engineering excellence, and accelerate delivery through highly productive, maintainable automation programs.\nKey Responsibilities\nAutomation Strategy & Architecture\nDefine and own the test automation architecture and multi-layer strategy (UI/API/contract/integration/e2e), aligned to product risk and release cadence.\n\nEstablish automation standards, patterns, and reference implementations (framework structure, page-object/screenplay usage, test data patterns, reporting).\n\nDrive shift-left testing practices (contract testing, component testing, pre-merge validation) and reduce reliance on fragile end-to-end tests.\n\nAgentic AI / LLM Test Model Alignment\nDesign and implement testing approaches fornon-deterministic AI outputs, including:\nconfidence/threshold-based assertions\n\nsemantic similarity checks and rubric-based validation\n\ngoldens/benchmark datasets and evaluation harnesses\n\nhallucination and groundedness testing strategies\n\nregression detection across model/prompt/version changes\n\nDefine AI test coverage across accuracy, robustness, bias/safety (as applicable), performance, and reliability.\n\nPartner with ML/AI, Product, and Engineering to establishacceptance criteria for AI capabilities and measurable quality gates.\n\nHigh-Productivity Automation Programs\nBuild and scalehigh-throughput automation projects that are reliable, fast, and easy to extend.\n\nImprove test execution time, reduce flaky tests, and optimize CI/CD pipelines (parallelization, test selection, retries with guardrails).\n\nCreate actionable, engineering-friendly quality dashboards (pass/fail trends, flake rate, coverage, defect escape metrics).\n\nTooling, CI/CD, and Quality Gates\nIntegrate automation into CI/CD with quality gates (PR checks, nightly suites, release readiness criteria).\n\nStandardizeobservability for testing: logs, tracing hooks, screenshots/video, artifacts, and test run diagnostics.\n\nDefine practices fortest environments, data management, service virtualization, and dependency control.\n\nTechnical Leadership & Mentorship\nServe as the QE technical authority: coach engineers on automation design, code quality, and best practices.\n\nLead design reviews for test architecture and automation PRs; enforce coding standards and maintainability.\n\nInfluence roadmap and delivery by translating risk into clear testing priorities.\n\nRequired Qualifications\n8-12+ years in Quality Engineering / Test Automation witharchitect-level ownership of frameworks and strategy.\n\nProven experience designing scalable automation across:\nAPI testing (contract + integration)\n\nUI automation with stable locator strategies (test IDs, accessibility roles)\n\nTest data strategy and environment reliability\n\nStrong programming skills in at least one modern language (e.g., Java, Python, TypeScript/JavaScript, C#).\n\nExpertise with automation tools/frameworks (examples):\nUI: Playwright / Cypress / Selenium\n\nAPI: REST-assured / SuperTest / Postman/Newman / pytest\n\nCI: GitHub Actions / Jenkins / Azure DevOps\n\nDemonstrated ability to reduce flakiness and improve execution speed throughengineering solutions.\n\nPreferred Qualifications (Strongly Desired)\nExperience testingLLM/Agentic AI features or other probabilistic systems, including:\nevaluation harnesses, benchmark datasets, semantic scoring, and drift detection\n\nprompt/version regression strategies and structured evaluation reports\n\nFamiliarity with modern quality approaches:test pyramid,contract testing,consumer-driven contracts,risk-based testing, shift-left.\n\nKnowledge of security/performance testing integration (baseline understanding; hands-on is a plus).\n\nExperience building reusable automation libraries for multiple teams/products.\n\nOur Interview Practices\nTo maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you-not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.\nApplicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.\nCompensation:\n$89,600.00 - $157,000.00 USDThis role is eligible for Bonus.Compensation range listed is based on primary location of the position. Actual base salary offer is influenced by a wide array of factors including but not limited to skills, experience and actual hiring location. Your recruiter can share more information about the specific offer for the job location during the hiring process.\nAdditional Information:\nWolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request.","description_format":"text","description_chars":5671,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Parental leave"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-08-26T00:00:00Z"}],"visa":[],"liveness":{"score":17,"band":"cold","label":"Long shot","p_open":1,"p_active":0.484,"p_room":0.36,"age_days":64,"expected_fill_days":33,"reasons":["conf:4","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/wolters-kluwer-lead-software-test-automation-engineer-test-architect-agentic-ai","json_url":"https://alion.io/job/wolters-kluwer-lead-software-test-automation-engineer-test-architect-agentic-ai.json","meta":{"generated_at":"2026-10-29T08:14:43Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12615,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2555},"rest":"https://alion.io/mcp/rest/get_company?id=2555"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fwolters-kluwer-lead-software-test-automation-engineer-test-architect-agentic-ai"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fwolters-kluwer-lead-software-test-automation-engineer-test-architect-agentic-ai"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fwolters-kluwer-lead-software-test-automation-engineer-test-architect-agentic-ai"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/wolters-kluwer-lead-software-test-automation-engineer-test-architect-agentic-ai\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fwolters-kluwer-lead-software-test-automation-engineer-test-architect-agentic-ai"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":138285}},{"tool":"search_jobs","arguments":{"company":"wolterskluwer.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":138285},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}