Senior SDET

We are looking for experienced quality/test engineers to join our pack and work with us to build and expand the capabilities of our testing platform.

Responsibilities:

• Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipelines.
• Review testing strategies, approaches, and test plans, and provide insight to development teams.
• Architect, design, and build software to automate a variety of testing methods (e. g. API validation, performance/load testing, fuzzing, etc. ).
• Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.
• Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.
• Work as part of a team of highly skilled software professionals.
• Continuously learn and expand your technical horizons.

Requirements:

• Our Technology Stack: Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3 etc. ), LangChain, LLM evaluation frameworks (e. g., Ragas), OpenAPI, Postgres, Linux.
• Excited to work at the intersection of AIML, Big Data, and the Cybersecurity problem space.
• Have 5+ years of experience shipping quality software.
• Love driving high software quality.
• Have experience deploying services on cloud computing platforms (e. g., AWS, Azure, GCP).
• Are an expert using common tools for executing functional, load, and fuzz testing (e. g. Locust, CATS).
• Have worked on distributed systems and microservices architecture (preferred).

Skills

AWS, Azure, Docker, GCP, Kubernetes, Playwright, QA, SDET, Selenium, Software Development Engineer in Test