{"id":2808958,"url":"https://alion.io/job/glasslake-qa-engineer","title":"QA Engineer","company":{"id":4445423,"name":"Glasslake","domain":"glasslake.ai","url":"https://alion.io/company/glasslake","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"QA","role_family":"QA","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["São Paulo, Brazil"],"countries":["BR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"Cypress","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"Playwright","optional":false},{"name":"Python","optional":false},{"name":"TypeScript","optional":false},{"name":"Hallucination","optional":true},{"name":"Human-in-the-Loop","optional":true}],"status":"live","first_seen_at":"2026-08-18T18:13:59Z","employer_posted_date":"2026-08-18","last_verified_at":"2026-10-18T12:10:09Z","board_verified":true,"closed_at":null,"days_open":60,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":60},"description":"About Glasslake\nGlasslake is building the operating system for SAP delivery - the infrastructure layer underneath the most complex and expensive IT projects companies run. SAP implementations move billions of dollars and thousands of consultants, but the knowledge generated in these projects is never captured: it lives in people's heads, disappears when the project ends, and gets rebuilt from scratch on every new engagement.\nGlasslake solves this with an agentic orchestration platform that coordinates every phase of SAP transformation, capturing decisions, tests, and context as a byproduct of work already underway - building an organizational memory that accumulates across projects instead of resetting.\nWe're a team based in San Francisco and São Paulo, moving fast and already deployed with some of the largest SAP integrators in the world, including delaware Consulting, KPMG, and NTT Data. The team comes from Stanford, Meta, Two Sigma, Microsoft, and NASA.\nThe Opportunity\nGlasslake generates functional specifications, configuration, and test artifacts for SAP implementations. Our customers are consultants running multi-million dollar programs, and they act on what the platform produces. A confidently wrong output is worse than no output at all: it survives review, reaches a client deliverable, and is discovered at go-live. Preventing that is the job.\nSo this role is two things at once. It is conventional software QA - automated end-to-end coverage, regression suites, CI discipline, release confidence. And it is evaluation engineering for non-deterministic systems: building the harnesses, golden datasets, and scoring criteria that tell us whether an agent's output is actually correct, and whether last week's prompt change quietly made it worse.\nWhat You'll Do\nOwn the automated test suite. Build and maintain end-to-end, integration, and regression coverage across the platform, and keep it fast and trustworthy enough that people actually act on a red build.\n\nBuild the evaluation harness for agent output. Golden datasets, scoring criteria, and regression testing for LLM-generated artifacts - so we can tell a prompt or model change that improved things from one that broke them.\n\nDefine the quality gates. Decide what blocks a release, write the criteria down, and hold the line when there is pressure to ship.\n\nOwn CI reliability. Flaky tests, slow pipelines, and unclear failures are quality problems in their own right, and they are yours.\n\nRun exploratory and release testing on the paths automation does not reach, particularly the customer-facing workflows consultants use under deadline pressure.\n\nTriage and drive defects to closure with reproducible cases, clear severity calls, and follow-through until the fix is verified.\n\nFeed quality signal back into the product. You will see the failure patterns before anyone else; that belongs in the roadmap, not just in a bug tracker.\n\nWhat We're Looking For\nRequired\n3+ years in QA, SDET, or test engineering with real ownership of automated coverage for a production product.\n\nStrong test automation skills in Python and/or TypeScript, including a modern E2E framework (Playwright, Cypress, or equivalent) and API-level testing.\n\nCI/CD fluency. You have built and maintained pipelines, and you have opinions about what belongs in one.\n\nComfort testing systems without deterministic outputs. Either direct experience evaluating LLM or ML output, or a clear, credible approach to how you would do it.\n\nJudgment about severity. You can tell the difference between a cosmetic defect and one that will cost a customer their go-live date, and you prioritize accordingly.\n\nAI native. You use AI tooling in your daily workflow and treat it as a force multiplier rather than a shortcut.\n\nHigh agency in an environment with no playbook. You will be defining the function, not staffing it.\n\nProfessional-to-fluent English.\n\nPrior work at an early-stage company where QA was something you created rather than joined.\n\nNice to have\nExperience evaluating LLM-powered or agentic features in production: eval design, hallucination detection, human-in-the-loop review workflows.\n\nFamiliarity with enterprise software ecosystems - SAP, Salesforce, ERP or CRM more broadly - or willingness to learn the domain deeply.\n\nSAP testing tooling exposure (Tricentis, Worksoft, or comparable), or experience with SAP test cycles and UAT.\n\nPerformance, load, or security testing experience.\n\nYou write code well enough to fix the bug, not just file it.\n\nWhy Join Glasslake Now\nDefine the function. You are building the quality bar for the company, not maintaining someone else's suite.\n\nA genuinely hard testing problem. Non-deterministic output, enterprise-grade consequences, and no established playbook for either.\n\nReal stakes. Your work sits between an agent's output and a multi-million dollar client deliverable.\n\nDirect access to engineering, product, and the founding team.\n\nCompetitive compensation with meaningful equity.","description_format":"text","description_chars":4992,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Advanced (C1)","optional":false}]},"benefits":["Equity"],"hiring_locations":[{"name":"Brazil","iso":"BR","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Corporate Events","AI Agents"],"lifecycle":[{"event":"open","at":"2026-10-18T08:37:49Z"}],"visa":[],"liveness":{"score":13,"band":"cold","label":"Long shot","p_open":1,"p_active":0.476,"p_room":0.28,"age_days":60,"expected_fill_days":24,"reasons":["conf:0","win:tail","crowd:"],"computed_at":"2026-10-18T12:47:47Z"},"pay":null,"html_url":"https://alion.io/job/glasslake-qa-engineer","json_url":"https://alion.io/job/glasslake-qa-engineer.json","meta":{"generated_at":"2026-10-18T12:47:47Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":18933,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4445423},"rest":"https://alion.io/mcp/rest/get_company?id=4445423"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fglasslake-qa-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fglasslake-qa-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fglasslake-qa-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/glasslake-qa-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fglasslake-qa-engineer"}]}