Senior Quality Automation Engineer
Confirmed on the employer's own hiring board on Oct 26, 2026. First seen by Alion on Sep 9, 2026.
Does redefining what Quality looks like in the age of AI - on a brand-new AI product - make you tick?
At Re-Leased our vision is to shape the future of Commercial Real Estate and drive better outcomes for people, property and planet. We're now building am:pm - an agentic AI product for commercial real estate operators.
Property managers run their portfolios on a system of record like Re-Leased, but most of the actual work happens outside it - emails, phone calls, follow-ups, to-do lists scattered across tools, with no system behind them. am:pm is the system of action for that work: it captures the work to be done as jobs and tasks, grounded in the communication channels, memories, and documents that surround the portfolio - so the work itself finally has a home. You can read more at ampm.ai.
am:pm is in early access with customers right now. The squad is small, the stack is new, and we're moving fast.
Your Role
We're looking for a senior quality automation engineer to own the quality system for am:pm - based in Napier or remote from another city in New Zealand. The whole squad owns quality; you build the automation, quality controls, and practices that make that possible. This is an automation-led role: engineers write unit and integration tests, and you shape where automated coverage sits across the test pyramid and steward the end-to-end suite, with AI as a core part of how you work - generating tests, triaging failures, creating test data. We're also moving to continuous delivery, and a core part of this role is making that safe - the right level of automated quality controls so changes flow to production with confidence.
And because am:pm is an AI product, quality means testing agentic behaviour: non-deterministic outputs, tool use, statistical rather than binary correctness. Engineers write the evals - just as they write unit and integration tests - and you bring the quality lens: when evals are the right control, and what they need to catch.
This is a small-team, start-up environment inside an established SaaS business - less process, more agency, and a tight feedback loop with real customers.
Your Responsibilities
Drive quality automation across the test pyramid - set where coverage sits so tests run at the layer that's cheapest and most reliable - and steward the end-to-end suite: curate what earns a place in it, and set the standards engineers follow when contributing tests of their own
Support our move to continuous delivery - design the right level of automated quality controls (pipeline gates, smoke checks, release signals) so we can release frequently without slowing the flow of change
Use AI tooling as a first-class part of your workflow - test generation, bug triage, test data creation - and keep raising the bar on how the team uses it
Curate AI-generated tests and findings - decide what to keep, reject, or refine, applying your own testing judgment rather than accepting output wholesale
Shape how we test AI-powered features - advise on when evals are the right quality control and what they should cover, and contribute adversarial and edge-case scenarios; engineers write and own the evals themselves
Partner with engineers on acceptance criteria and coach them on designing test scenarios from a user's perspective - positive paths, negative paths, edge cases
Run exploratory and risk-based testing to find what automation misses, and feed production bugs back into automation at the layer that would have caught them
Analyse quality workflows - triage, release, escape defects - and drive structural improvements, reporting on quality signals so the squad always knows where quality stands
Your Experience
5+ years of QA experience in a SaaS product environment, with automation at the centre of how you work
Track record of designing test automation frameworks from the ground up - architecture, tooling choices, conventions - and building the JavaScript/TypeScript end-to-end suites (e.g. Playwright, Cypress) that run on them
Comfortable working in a production codebase - Git, branches, PRs, code review - and able to read code well enough to locate and understand the surface under test
CI/CD fluent - you understand what runs when and where tests fit, with a clear point of view on the quality controls that make continuous delivery safe: pipeline gates, smoke checks, rollback signals
Actively using AI tools in your workflow today - and opinions on where they're strong and where they aren't
Genuine interest in testing AI products: you've thought about (or worked on) how to test non-deterministic systems, and evals excite you rather than scare you
Strong exploratory testing instincts and sound test-pyramid judgment - you find the bugs automation can't, and you know where automation investment pays off and where it doesn't
Comfortable with ambiguity, change, and making calls with incomplete information - you're drawn to small teams and early-stage product work
A genuine focus on the customer outcome, not just the test count
Bonus
Experience with LLM eval frameworks - golden datasets, judge models, statistical thresholds
Experience with adversarial testing of AI systems - prompt injection, jailbreaks, hostile inputs
API testing chops (REST), performance or accessibility testing experience
Prior start-up or zero-to-one product experience
Our Stack & How We Work
am:pm is built on .NET 8, Vue 3, SQL Server and a growing set of AI services on Microsoft Azure. The squad manages its own DevOps - Terraform for IaC, Azure DevOps for pipelines. We've woven AI tooling deeply into how we work; if you're excited by the idea of testing AI-native software and using AI to test it, you'll fit right in.
Our culture is very important to us too, and we strongly believe in living out our core values:
- People First: One team globally; our people and customers always come first.
- Find a Way: Like a river, we find a way around all obstacles
- Win or Learn: Our journey for improvement never ends; enjoy the ride!
- Aim High: We dare to set big goals and love the challenge of achieving them against the odds.
Why you’ll love working here!
Taking care of you: Including comprehensive health insurance, access to a premium EAP service and an annual wellness allowance to spend on what helps you feel good - whether that’s towards a gym membership, new running shoes, or mindfulness apps.
Support for families: Generous paid parental leave and flexible, family-friendly support designed to help growing families balance work and life with confidence.
Recognition for tenure and milestones: We celebrate time, commitment, and contribution with milestone rewards and additional leave as you grow your career with us.
Flexible working, built for a global team: With customers and teammates across New Zealand, Australia, the United Kingdom, and North America, we work in a hybrid, remote-friendly way with collaborative offices and the flexibility of a balanced approach to WFH/i-office work.
Ready to Level Up?
Join us and help shape the future of real estate at one of the most exciting SaaS companies born from New Zealand.