Test Architect – Regression & Quality Strategy

About the Role:

We are looking for an experienced Test Architect to own the regression testing strategy and quality framework for a complex observability and audit platform operating across multiple enterprise environments.

This is a highly technical quality leadership role focused on defining what successful validation looks like across functional, performance, security, scalability, and infrastructure-related requirements. You will design the automation architecture, establish test coverage and acceptance criteria, and serve as the quality gatekeeper throughout the development lifecycle.

You will work closely with engineering teams delivering logging, tracing, alerting, audit trail, and Infrastructure as Code (IaC) capabilities, ensuring the platform continues to meet defined success metrics as new builds are delivered across sprints.

The ideal candidate brings deep experience designing regression and automation strategies for distributed, data-intensive, infrastructure-heavy systems and is comfortable owning quality sign-off for business-critical technical platforms.

Responsibilities:

• Own and design the end-to-end regression testing strategy and framework across multiple platform components and enterprise environments.
• Translate formal success metrics and technical evaluation criteria into clear, measurable, and automatable acceptance criteria.
• Define comprehensive test coverage for:
  • Log and metric ingestion.
  • Search and query performance.
  • Distributed tracing correctness.
  • Audit trail integrity and immutability.
  • Alert firing, delivery, and routing.
  • Infrastructure as Code (IaC) deployment validation.
  • Load and scalability scenarios.
  • Failure-injection scenarios.
  • Security and compliance-related acceptance criteria.
  • Design the automation architecture and determine the appropriate testing approaches and tooling.
  • Establish regression suites that continuously validate sprint deliverables.
  • Own test environment strategy and test data management across multiple product versions and environments.
  • Define approaches for performance, functional, security, and scalability validation.
  • Validate that Infrastructure as Code deployments are reproducible and meet defined acceptance criteria.
  • Collaborate with engineering teams to ensure testing approaches align with the underlying platform architecture.
  • Track testing progress, risks, defects, and overall quality status throughout the development lifecycle.
  • Provide clear quality reporting and recommendations during sprint reviews and stakeholder discussions.
  • Own quality gates and provide sign-off recommendations ahead of formal acceptance.

Requirements:

• 8+ years of professional experience in Test Architecture, Quality Engineering, QA Automation, or similar technical quality roles.
• Proven experience leading testing strategy for distributed, data-intensive, or infrastructure-heavy systems.
• Deep experience designing comprehensive regression testing frameworks and automation strategies.
• Experience validating more than functional behavior, including performance, scalability, security, and reliability.
• Strong understanding of modern observability concepts and distributed systems.
• Experience working with cloud-based infrastructure and automated deployment environments.
• Strong understanding of software development lifecycles, Agile delivery, and sprint-based development.
• Experience defining formal acceptance criteria and quality gates.
• Strong written and verbal English communication skills.

Must Have:

• 8+ years of experience in Test Architecture, QA Engineering, Quality Engineering, or QA leadership roles.
• Proven ownership of regression testing strategy and automation architecture.
• Deep experience designing regression frameworks covering functional, performance, and security validation.
• Experience testing distributed, data-intensive, infrastructure-heavy, or observability-related systems.
• Working knowledge of OpenTelemetry and modern observability concepts.
• Understanding of log and metrics pipelines.
• Experience validating distributed tracing and/or observability workflows.
• Working knowledge of AWS-based infrastructure sufficient to design meaningful technical test cases.
• Experience validating Infrastructure as Code (IaC) deployments.
• Experience working with Terraform-deployed environments.
• Experience with load, scale, and performance testing.
• Experience defining test strategies across multiple environments and/or product versions.
• Experience defining test environments and test data strategies.
• Experience translating technical success metrics into measurable and automatable acceptance criteria.
• Experience working with formal quality gates and Definition of Done (DoD).
• Comfortable owning quality sign-off and providing acceptance recommendations.

Nice to Have:

• Previous experience testing observability platforms.
• Experience with logging, monitoring, tracing, or telemetry platforms.
• Experience validating audit trail integrity and immutability.
• Experience with failure-injection or resilience testing.
• Experience with compliance-oriented or security-sensitive platforms.
• Experience testing ERP or other complex enterprise platforms.
• Experience working across multiple versions of the same enterprise application.
• Experience defining testing strategies for high-volume data ingestion systems.
• Experience with performance benchmarking and scalability validation.
• Experience working in client-facing technical engagements.