{"id":119632,"url":"https://alion.io/job/dialpad-sr-software-development-engineer-in-test-agentic","title":"Sr. Software Development Engineer in Test (Agentic)","company":{"id":1485,"name":"Dialpad","domain":"dialpad.com","url":"https://alion.io/company/dialpad","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":78,"open_postings":10,"ghost_share":0,"stale_share":0.9,"repost_share":0,"time_to_fill_p50_days":59,"computed_at":"2026-10-16T05:45:00Z"}},"role":"QA","role_family":"QA","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Vancouver, Canada"],"countries":["CA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":66000,"max_usd":118000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":39},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude","optional":false},{"name":"Edge AI","optional":false},{"name":"ElasticSearch","optional":false},{"name":"GCP","optional":false},{"name":"Gemini","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Go","optional":false},{"name":"Google Cloud Run","optional":false},{"name":"Hallucination","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"JavaScript","optional":false},{"name":"Jenkins","optional":false},{"name":"Kubernetes","optional":false},{"name":"LiveKit","optional":false},{"name":"LLM","optional":false},{"name":"OpenAI","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"React.js","optional":false},{"name":"Redis","optional":false},{"name":"Voice Agents","optional":false}],"status":"live","first_seen_at":"2026-08-24T12:07:49Z","employer_posted_date":"2026-09-29","last_verified_at":"2026-10-16T18:19:27Z","board_verified":true,"closed_at":null,"days_open":53,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":53},"description":"About Dialpad\n Dialpad is the AI platform for customer experience, built to resolve customer problems in real time across voice and digital. Our AI agents learn from your best human agents and improve with every interaction, helping organizations understand their customers, deliver better experiences, increase operational efficiencies, and build a lasting competitive advantage.\nUnlike legacy systems built to route and answer, or standalone agentic bot vendors built to deflect, Dialpad was built to resolve. Our AI agents and human agents operate on a single platform with shared context, allowing Agentic AI to resolve issues, advance deals, and eliminate busywork through automation while seamlessly handing conversations to humans when needed, with full context preserved.\nMarket-leading brands, including Randstad, Motorola Solutions, Netflix, the San Diego Padres, the Colorado Rockies Baseball Club, and Cal Athletics, trust Dialpad. Dialpad is backed by Andreessen Horowitz, GV, ICONIQ Capital, and T-Mobile.\nBeing a Dialer\nAt Dialpad, AI isn’t just a feature; it’s how our teams do their best work every day. We put powerful AI tools in every employee’s hands so they can move faster, think bigger, and achieve more.\nWe believe every conversation matters. And we’ve built the platform that turns those conversations into insight and action, for our customers and ourselves.\nWe look for people who are intensely curious and hold themselves to a high bar. Our ambition is significant, and achieving it requires a team that operates at the highest level. We seek individuals who embody our core traits:Scrappy, Curious, Optimistic, Persistent, and Empathetic.\nYour role\n As a Sr. SDET in Agentic QA, you will own the test automation and quality frameworks that support Dialpad’s AI Voice Agent services. You will develop automated tests for end-to-end product experiences, from frontend UI to backend services to APIs to audio/text interactions. You will test orchestration flows, agent configuration experiences, and guardian safeguards to create robust automated coverage for functionality, performance, reliability, UX, and more. \nIn this role, you will develop substantial amounts of automated test infrastructure and partner deeply with the development team to make our fast-growing AI platform more testable, more stable, and more delightful for customers.\nThis position is based at one of Dialpad’s Canadian offices and reports to a QA Eng Manager in the United States.\nWhat you’ll do\nOwn end-to-end quality for agentic features and workflows, including strategy, development, execution, and release qualification.\nDesign and build automation tooling and frameworks for AI/LLM-driven systems, including prompt flows, agent orchestration, and tool integrations.\nDevelop and maintain evaluation frameworks (evals) to measure response quality, accuracy, and hallucination rates.\nDrive automation coverage (80%+ for critical AI workflows) using deterministic + probabilistic validation approaches.\nIntegrate AI quality checks into CI/CD pipelines with fast feedback cycles (<15 minutes for PR validation).\nBuild tooling for LLM observability and debugging, including prompt tracing and response analysis.\nPartner with Applied AI teams on prompt engineering, model selection, and evaluation strategies.\nDesign and execute performance and load tests for AI services (latency, throughput, cost efficiency).\nIdentify and mitigate risks related to hallucinations, bias, safety, and edge cases.\nDefine and track AI quality KPIs (task success rates, precision/recall, latency, etc.).\nParticipate in design and architecture reviews to ensure systems are testable, observable, and resilient.\nMentor engineers and contribute to raising the bar on AI quality engineering practices.\nWhat you’ll bring\n6+ years of experience in software engineering or SDET roles with an emphasis on software development.\nStrong programming skills in Python (preferred), Java, or JavaScript.\nExperience testing distributed, cloud-native SaaS systems and APIs.\nDemonstrated proficiency in coding with AI agents to accelerate development and improve code quality.\nHands-on exposure to LLMs or AI/ML systems (e.g., OpenAI, Claude, Gemini, or similar platforms).\nUnderstanding of non-deterministic systems and probabilistic testing approaches.\nExperience building test frameworks and scalable automation systems.\nFamiliarity with AI evaluation techniques (benchmarking, golden datasets, human-in-the-loop validation).\nExperience with CI/CD pipelines (e.g., Jenkins, GitHub Actions).\nStrong collaboration skills with the ability to work across distributed teams and time zones.\nBachelor’s degree in Computer Science or equivalent practical experience.\nBackend: Python, Go, Google Cloud Platform, Cloud Run / App Engine, Kubernetes, Datastore, Redis, ElasticSearch.\nFrontend: Vue3, React.\nAI Stack: LLM APIs, LiveKit, prompt orchestration frameworks, evaluation tooling.\nFor exceptional talent based in British Columbia, Canada the target base salary range for this position is posted below. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the target range for new hire salaries for the position. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in British Columbia role postings reflect the base salary only, and do not include bonus, equity, or benefits.\nBritish Columbia, Canada Salary Range\n$150,500—$175,250 CAD\nWhy Join Dialpad\nWork at the center of the AI transformation in business communications\nBuild and ship agentic AI products that are redefining how companies operate\nJoin a team where AI amplifies every employee’s impact\nCompetitive salary, comprehensive benefits, and real opportunities for growth\nWe believe in investing in our people. Dialpad offers competitive benefits and perks, cutting-edge AI tools, and a robust training program that help you reach your full potential. We have designed our offices to be inclusive, offering a vibrant environment to cultivate collaboration and connection. Our exceptional culture, repeatedly recognized as a Great Place to Work, ensures that every employee feels valued and empowered to contribute to our collective success.\nDon’t meet every single requirement? If you’re excited about this role and possess the fundamental traits, drive, and strong ambition we seek, but your experience doesn’t meet every qualification, we encourage you to apply. \n Dialpad is an equal-opportunity employer. We are dedicated to creating a community of inclusion and an environment free from discrimination or harassment.","description_format":"text","description_chars":6887,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"Canada","iso":"CA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Video Conferencing & Webinars","Unified Communications","Conversational AI","Contact Center Software"],"lifecycle":[{"event":"open","at":"2026-08-24T12:07:49Z"}],"visa":[],"liveness":{"score":41,"band":"fade","label":"Fading","p_open":1,"p_active":0.548,"p_room":0.75,"age_days":52,"expected_fill_days":59,"reasons":["conf:0","stale_co","win:late"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/dialpad-sr-software-development-engineer-in-test-agentic","json_url":"https://alion.io/job/dialpad-sr-software-development-engineer-in-test-agentic.json","meta":{"generated_at":"2026-10-16T21:15:51Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2088,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1485},"rest":"https://alion.io/mcp/rest/get_company?id=1485"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdialpad-sr-software-development-engineer-in-test-agentic"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdialpad-sr-software-development-engineer-in-test-agentic"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdialpad-sr-software-development-engineer-in-test-agentic"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/dialpad-sr-software-development-engineer-in-test-agentic\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdialpad-sr-software-development-engineer-in-test-agentic"}]}