{"id":1591155,"url":"https://alion.io/job/data-wow-qa-automation-engineer-senior","title":"QA Automation Engineer (Senior)","company":{"id":5408,"name":"Data Wow","domain":"datawow.com","url":"https://alion.io/company/datawow","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"A","score":95,"open_postings":4,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":177,"computed_at":"2026-10-12T06:55:09Z"}},"role":"QA","role_family":"QA","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pathum Wan, Thailand"],"countries":["TH"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":12500,"max_usd":35000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":1009},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Cypress","optional":false},{"name":"Hallucination","optional":false},{"name":"Java","optional":false},{"name":"LLM","optional":false},{"name":"Playwright","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Rest-Assured","optional":false},{"name":"SQL","optional":false},{"name":"TypeScript","optional":false},{"name":"Windows","optional":false}],"status":"live","first_seen_at":"2026-10-01T16:13:45Z","employer_posted_date":"2026-10-01","last_verified_at":"2026-10-12T12:06:44Z","board_verified":true,"closed_at":null,"days_open":11,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":11},"description":"Build evaluation suites for LLM and ML features: curated test sets, scoring against reference answers, LLM-as-judge where it is justified, and human review where it is not.\nDefine what \"good enough\" means with the delivery team before launch, in numbers a client can accept, and hold releases to it.\nTest retrieval pipelines end to end, covering chunking and indexing, retrieval quality, grounding of the final answer, and behaviour when the right document is simply not there.\nWrite regression tests that tolerate non-deterministic output, using semantic similarity, structured-output validation, tolerance bands, and repeated sampling rather than exact string matching.\nCover failure modes that matter to clients: hallucination, prompt injection through user or document content, leakage of data across tenants or sessions, refusal and over-refusal, and degradation on Thai-language input.\nTrack cost and latency alongside accuracy, so that a quality improvement that triples token spend is visible before it ships.\nDetect drift after release by comparing production samples against the baseline, and raise it early rather than after the client does.\nDesign and maintain automated test suites for APIs, services, data pipelines, and web applications built for client projects.\nRun tests in CI, keep them fast and stable, and treat a flaky suite as a defect in its own right.\nSet the test strategy at the start of an engagement: what gets automated, what stays manual, what the exit criteria are, and what evidence the client will receive.\nRequirements\n4-5 years in test automation, QA engineering, or software engineering with substantial testing ownership.\nStrong programming ability in Python, or in TypeScript or Java with the willingness to work primarily in Python.\nHands-on experience testing an LLM or ML-based product in production or close to it.\nPractical command of at least one automation framework such as Pytest, Playwright, Cypress, or RestAssured, and experience running suites in CI.\nWorking knowledge of API and data testing, including SQL and validating data through a pipeline.\nThe judgement to decide what deserves automation and what does not, and to say so when a suite is producing noise rather than signal.\nClear written and spoken communication in Thai and English.\nBenefits\nHybrid Working options with Flexible Working Hours.\nYour Choice of Gear: Mac or Windows? You pick your preferred work equipment.\nComprehensive Group Health Insurance.\nMonthly Grab Transportation credits.\nJob-related training courses and certificate fee coverage.\n 10+ days of annual leave.\nFree snacks and drinks available at the office.","description_format":"text","description_chars":2640,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[{"language":"Thai","level":"Upper-Intermediate (B2)","optional":false},{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":["Annual leave","Flexible schedule","Health insurance","Hybrid work"],"hiring_locations":[{"name":"Thailand","iso":"TH","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Computer Vision","AI Consulting & Integration","AI Training Data & Annotation"],"lifecycle":[{"event":"open","at":"2026-10-01T16:13:45Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":10,"expected_fill_days":177,"reasons":["conf:1","win:early"],"computed_at":"2026-10-12T06:55:09Z"},"pay":null,"html_url":"https://alion.io/job/data-wow-qa-automation-engineer-senior","json_url":"https://alion.io/job/data-wow-qa-automation-engineer-senior.json","meta":{"generated_at":"2026-10-12T17:14:19Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27565,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5408},"rest":"https://alion.io/mcp/rest/get_company?id=5408"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdata-wow-qa-automation-engineer-senior"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdata-wow-qa-automation-engineer-senior"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdata-wow-qa-automation-engineer-senior"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/data-wow-qa-automation-engineer-senior\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdata-wow-qa-automation-engineer-senior"}]}