Quality Assurance Engineer

Job Description :

Key Responsibilities :

- Own end-to-end product quality across AI workflows : Test Windsurf and Devin across onboarding flows, chat interactions, multi-file edits, agentic task execution, and autonomous workflows - thinking like a developer and testing like a user.

- Design and execute comprehensive test strategies : Build and run functional, regression, integration, exploratory, and E2E test plans across product surfaces and releases.

- Break down complex flows into testable scenarios : Identify edge cases, race conditions, state recovery failures, and real-world usage patterns that only emerge in production-like behavior.

- Issue reproduction, documentation, and debugging : Reproduce, document, and debug issues across layers - distinguishing between UI defects, orchestration/system issues, and unexpected AI behavior; work with engineering and product to drive resolution.

- Release readiness and quality bar ownership : Partner with engineering and product to define "done," set quality standards, and ensure releases meet the expectations of real developers.

- Build scalable QA processes and automation : Establish QA playbooks, test processes, and automation where it has leverage; help evolve CI/CD and testing practices as the product scales.

Qualifications :

Must-Have :

- 5+ years of QA/Test Engineering experience testing complex product workflows (multi-step user journeys, cross-surface interactions, and E2E behavior).

- Deep expertise in functional, regression, exploratory, integration, and end-to-end testing methodologies.

- Strong developer mindset : comfortable reading/writing code (Python, TypeScript, or similar), navigating codebases, and reasoning about systems.

- User-first testing approach : you test from the perspective of real users, not just against a spec.

- Exceptional attention to detail and strong debugging instincts; able to communicate clearly and precisely in bug reports and triage.

- Familiarity with CI/CD and test automation frameworks; comfort working in fast-moving, release-driven environments.

- Schedule flexibility : overlap with US time zones required; release cycles may require weekend availability.

Strong Plus :

- Experience testing AI-powered products with non-deterministic outputs; ability to evaluate quality when responses vary.

- Experience testing IDE plugins/extensions or developer tools (VS Code extensions, CLIs, code review systems).

- Familiarity with AI coding tools (Windsurf, Copilot, Cursor, Devin, etc.) and informed opinions on what "good" looks like.

- Prior software engineering background with shipped production code.

Skills

Software Quality Assurance, Testing, Test Strategy, Functional Testing, Regression Testing, Integration Testing, Python, Automation Testing