{"id":3290218,"url":"https://alion.io/job/highlevel-software-development-engineer-in-test-iii-ai","title":"Software Development Engineer in Test III - AI","company":{"id":3882884,"name":"HighLevel","domain":"highlevel.co","url":"https://alion.io/company/highlevel-3","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"QA","role_family":"QA","seniority":"middle","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Claude","optional":false},{"name":"Cypress","optional":false},{"name":"GraphQL","optional":false},{"name":"gRPC","optional":false},{"name":"LLM","optional":false},{"name":"OpenAI","optional":false},{"name":"Playwright","optional":false},{"name":"Postman","optional":false},{"name":"RAG","optional":false},{"name":"Rest API","optional":false},{"name":"Selenium","optional":false},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"CI/CD","optional":true},{"name":"GCP","optional":true}],"status":"live","first_seen_at":"2026-09-18T23:25:14Z","employer_posted_date":null,"last_verified_at":"2026-09-18T23:25:14Z","board_verified":false,"closed_at":null,"days_open":40,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":40},"description":"About HighLevel:HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. Today, HighLevel supports SMBs across 150+ countries, fueling community-driven growth rooted in real customer outcomes.\nTo date, businesses operating on HighLevel have generated over $7 billion in ecosystem value, demonstrating the impact of shared infrastructure at scale. By centralizing conversations, automation and intelligence into one system, we help businesses move faster, reduce complexity and execute efficiently.\nBehind the platform, HighLevel powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 million domain names supported, our architecture is built for performance, resilience and long-term scalability.\n\nOur People\nWith over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership. We value initiative, clarity and execution, creating space for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, ideas are celebrated and people come first, no matter where they call home.\n\nOur Impact\nEvery month, HighLevel enables more than 1.5 billion messages, 200 million leads and 20 million conversations for the more than 1 million businesses we support. Behind those numbers are real people building independence, expanding opportunity and creating measurable impact. We’re proud to be a part of that.\nLearn more about us on our YouTube Channel or Blog PostsAbout the Role:We are looking for a Senior Software Development Engineer in Test (SDET 3) with strong expertise in AI tools and testing AI-driven products. This role requires a hands-on individual who can design and execute test strategies for AI systems, automate intelligently, and mentor junior team members. You will work independently, drive tasks to closure, and play a key role in ensuring the quality of our AI initiatives.Requirements:\n5+ years of overall experience in QA/SDET roles\n\nProven experience working with AI tools (e.g., OpenAI, Claude, or similar LLM platforms)\n\nStrong understanding of testing AI/ML products and their unique challenges\n\nHands-on knowledge of RAG pipelines and their testing methodologies\n\nProficiency in automation frameworks (e.g., Playwright, Cypress, Selenium, or similar)\n\nExperience with API testing (Postman, REST, GraphQL, gRPC)\n\nStrong problem-solving skills with the ability to work independently\n\nMentorship and leadership skills in guiding peers or junior engineers\n\nResponsibilities:\nDesign, develop, and maintain automation frameworks and test strategies for AI products\n\nTest and validate AI-powered features (including OpenAI, Claude, and other AI integrations)\n\nEvaluate and improve RAG (Retrieval-Augmented Generation) flows, ensuring accuracy and performance\n\nLeverage AI automation tools to optimize test coverage and efficiency\n\nCollaborate closely with developers, product managers, and AI researchers to ensure high-quality releases\n\nOwn tasks end-to-end, working independently to deliver on commitments.\n\nMentor and guide junior SDETs, fostering a culture of quality and continuous learning\n\nNice to have\nExperience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure)\n\nFamiliarity with MLOps pipelines and monitoring AI systems\n\nExposure to performance and scalability testing of AI workloads\n\nEEO Statement:\nThe company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.\n\nWe encourage you to review our Privacy Policy before submitting your application\n\nOriginally posted on Himalayas","description_format":"text","description_chars":4140,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","CRM Software","Marketing Automation"],"lifecycle":[{"event":"open","at":"2026-10-26T19:11:04Z"}],"visa":[],"liveness":{"score":15,"band":"cold","label":"Long shot","p_open":0.6,"p_active":0.685,"p_room":0.36,"age_days":40,"expected_fill_days":24,"reasons":["seen:40","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/highlevel-software-development-engineer-in-test-iii-ai","json_url":"https://alion.io/job/highlevel-software-development-engineer-in-test-iii-ai.json","meta":{"generated_at":"2026-10-29T12:20:53Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":18471,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3882884},"rest":"https://alion.io/mcp/rest/get_company?id=3882884"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhighlevel-software-development-engineer-in-test-iii-ai"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhighlevel-software-development-engineer-in-test-iii-ai"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhighlevel-software-development-engineer-in-test-iii-ai"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/highlevel-software-development-engineer-in-test-iii-ai\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhighlevel-software-development-engineer-in-test-iii-ai"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3290218}},{"tool":"search_jobs","arguments":{"company":"highlevel.co","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3290218},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}