Software Development Engineer in Test

Responsibilities:

• Own quality activities for product features from requirement review and test planning through release validation and production follow-up.
• Design, develop, and maintain Python-based Robot Framework automation for API, UI, integration, and end-to-end product workflows.
• Build and enhance Playwright automation for reliable cross-browser testing of modern web applications.
• Perform functional, exploratory, regression, integration, and release testing for our B2B Commerce platform.
• Create reusable test libraries, data utilities, fixtures, and reporting capabilities that improve automation scalability and maintainability.
• Integrate automated tests into CI/CD pipelines and help establish effective quality gates, failure triage, and release-readiness reporting.
• Collaborate closely with product managers, developers, and team members in the US and India to clarify requirements and deliver the product roadmap.
• Contribute to testing AI-enabled capabilities, including LLM response quality and RAG-based product experiences, where applicable.
• Review defects and production issues, support root-cause analysis, and improve regression coverage to prevent recurrence.
• Maintain a strong focus on technical excellence, reliability, usability, customer impact, and continuous quality improvement.

Requirements:

• You have strong experience testing enterprise-grade web applications and SaaS products across UI, API, and integration layers.
• You have hands-on programming experience in Python and use it to build maintainable, reusable, and reliable test automation.
• You have practical experience developing API and UI automation using Robot Framework.
• You have experience with Playwright for modern web application testing, preferably using Python.
• You understand product requirements, user workflows, acceptance criteria, and business risks, and translate them into effective test coverage.
• You are comfortable combining automation with exploratory, functional, regression, integration, and end-to-end product testing.
• You investigate failures systematically, identify root causes, and communicate defects with clear evidence and business impact.
• You work closely with product management, engineering, and design to prevent defects and improve overall product quality.
• You are comfortable collaborating with globally distributed teams and taking ownership of quality throughout the delivery lifecycle.
• You are interested in learning, growing, and leading by example.
• Engineering graduate with 3-5 years of industry experience in software quality assurance and product testing.
• Strong hands-on programming and scripting experience in Python.
• Experience designing and maintaining automated test suites using Robot Framework.
• Experience automating REST API testing, including request validation, authentication, response schemas, error handling, and data-driven scenarios.
• Experience automating web UI workflows using Playwright and applying stable locator, synchronisation, and test-isolation practices.
• Good understanding of test design techniques, test strategy, risk-based testing, defect lifecycle, and release validation.
• Experience testing end-to-end product workflows across frontend, backend services, databases, and third-party integrations.
• Working knowledge of SQL and relational databases such as PostgreSQL or MySQL for backend data validation.
• Experience with Git, CI/CD pipelines, automated test execution, and test reporting.
• Familiarity with cloud-based or SaaS product environments and testing across multiple deployment environments.
• Ability to debug automation failures, application issues, network/API problems, and environment-specific defects.
• Strong communication skills and the ability to contribute effectively to engineering, product, and release discussions.
• Ability to work in a fast-paced environment with rapidly evolving business requirements.
• A hands-off or 'not my job' attitude is an absolute no-go.

Preferred Experience:

• Experience evaluating applications powered by Large Language Models or Generative AI.
• Understanding of Retrieval-Augmented Generation workflows, including retrieval, context construction, prompt execution, and response validation.
• Exposure to LLM and RAG quality metrics such as answer relevance, faithfulness or groundedness, context precision and recall, answer correctness, hallucination rate, safety, latency, and cost.
• Experience validating prompts, model responses, embeddings, vector search, citations, and AI-agent workflows.
• Startup or B2B SaaS product experience is a strong plus.