{"id":4106043,"url":"https://alion.io/job/glasslake-senior-ai-engineer-testing","title":"Senior AI Engineer, Testing","company":{"id":4445423,"name":"Glasslake","domain":"glasslake.ai","url":"https://alion.io/company/glasslake","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Computer Use","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-11-11T19:18:23Z","employer_posted_date":"2026-11-11","last_verified_at":"2026-11-11T22:37:06Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Glasslake\nGlasslake is building the operating system for SAP delivery - the infrastructure layer underneath the most complex and expensive IT projects companies run. SAP implementations move billions of dollars and thousands of consultants, but the knowledge generated in these projects is never captured: it lives in people’s heads, disappears when the project ends, and gets rebuilt from scratch on every new engagement.\nGlasslake solves this with an agentic orchestration platform that coordinates every phase of SAP transformation, capturing decisions, tests, and context as a byproduct of work already underway - building an organizational memory that accumulates across projects instead of resetting.\nWe’re a team based in San Francisco and São Paulo, moving fast and already deployed with some of the largest SAP integrators in the world, including Delaware Consulting, KPMG, and NTT Data. The team comes from Stanford, Meta, Two Sigma, Microsoft, and NASA.\nThe Opportunity\nYou’ll own some of the hardest problems in applied AI: making agents reliable, fast, and trustworthy on enterprise systems where being wrong is expensive.\nTesting is one of the most critical and labor-intensive parts of any SAP transformation. Our AI agents plan, execute, and validate tests of business processes inside real customer SAP landscapes, work that has traditionally taken teams of consultants weeks to do by hand.\nMaking agents perform at that level is an open frontier. You’ll take on problems with no off-the-shelf answers, explore them, define what success looks like, and carry the solution all the way to production with real customers.\nWhat You’ll Do\nExplore and define the problem\nFrame the problem. Turn observed agent behaviors into a clear problem statement, backed by evidence and your own experiments.\n\nDefine success. Set the metrics, benchmarks, and evals that measure agent performance.\n\nBuild and own the solution\nShip end to end. Design and ship agent and LLM features, from prompts and orchestration to the infrastructure behind them.\n\nOwn the results. Watch how your work performs in production and keep improving it.\n\nWork with experts and raise the bar\nValidate with experts. Work with SAP domain experts and present findings and decisions clearly.\n\nRaise the bar. Review code and designs, and help shape the team’s AI engineering practices.\n\nWhat We’re Looking For\n6+ years of engineering experience, including building AI agents or LLM features from scratch and shipping them to production with full ownership.\n\nA research-like approach. You set hypotheses, run experiments, and verify results before you build.\n\nEvaluation rigor. Experience measuring agent performance through evals, benchmarks, or regression suites, and acting on what they show.\n\nStrong Python and SQL, with hands-on experience with LLM APIs and agent frameworks.\n\nInfrastructure ownership. Comfortable running the workflow orchestration and cloud services behind your features.\n\nProduction investigation. You query databases and read logs and traces to find out what actually happened.\n\nSelf-direction and clear communication, including with domain experts who aren’t engineers.\n\nAI native. You use AI tooling daily as a force multiplier.\n\nNice to have\nExperience with computer-use or browser-automation agents.\n\nSoftware testing background, such as test automation or QA for complex systems, or familiarity with SAP testing.\n\nFamiliarity with enterprise software ecosystems (SAP, ERP, CRM).\n\nAbility to work in TypeScript when a feature needs it.\n\nEarly-stage startup experience where you owned a problem with no playbook.\n\nExperience mentoring engineers or acting as a technical reference on a team.\n\nWhy Join Glasslake Now\nOwn open-ended agent problems end to end, from the first exploration to results in production.\n\nTime to explore a problem and test ideas before committing to a solution.\n\nYour agents run inside multi-million dollar transformations at the largest SAP integrators in the world, in a category being defined right now.\n\nDirect access to the founding team, customers, and SAP domain experts.","description_format":"text","description_chars":4106,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Corporate Events","AI Agents"],"lifecycle":[{"event":"open","at":"2026-11-11T22:37:06Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["conf:1","win:early"],"computed_at":"2026-11-11T23:54:50Z"},"pay":null,"html_url":"https://alion.io/job/glasslake-senior-ai-engineer-testing","json_url":"https://alion.io/job/glasslake-senior-ai-engineer-testing.json","meta":{"generated_at":"2026-11-11T23:54:50Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":47612,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4445423},"rest":"https://alion.io/mcp/rest/get_company?id=4445423"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fglasslake-senior-ai-engineer-testing"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fglasslake-senior-ai-engineer-testing"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fglasslake-senior-ai-engineer-testing"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/glasslake-senior-ai-engineer-testing\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fglasslake-senior-ai-engineer-testing"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4106043}},{"tool":"search_jobs","arguments":{"company":"glasslake.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4106043},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}