368,657open jobs
9,442companies
50,883added this week
Browse all
Salary
$20k – $50k per year (Estimated)
Location
Remote/Hybrid (India)
Seniority
Senior · 5+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
Cognition is an applied artificial intelligence lab founded in 2023 that created Devin, an autonomous software engineering agent able to plan, write and debug code across a full repository. The company drew attention for demonstrating long-horizon coding work rather than single-file completion, and it sells Devin to engineering organisations. In 2025 it acquired the Windsurf coding assistant team and product, broadening its developer tooling.

We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer.

Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin is just the first step-our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

About the Role

Key Responsibilities

  • Own end-to-end product quality across AI workflows: Test Windsurf and Devin across onboarding flows, chat interactions, multi-file edits, agentic task execution, and autonomous workflows-thinking like a developer and testing like a user.

  • Design and execute comprehensive test strategies: Build and run functional, regression, integration, exploratory, and E2E test plans across product surfaces and releases.

  • Break down complex flows into testable scenarios: Identify edge cases, race conditions, state recovery failures, and real-world usage patterns that only emerge in production-like behavior.

  • Issue reproduction, documentation, and debugging: Reproduce, document, and debug issues across layers-distinguishing between UI defects, orchestration/system issues, and unexpected AI behavior; work with engineering and product to drive resolution.

  • Release readiness and quality bar ownership: Partner with engineering and product to define “done,” set quality standards, and ensure releases meet the expectations of real developers.

  • Build scalable QA processes and automation: Establish QA playbooks, test processes, and automation where it has leverage; help evolve CI/CD and testing practices as the product scales.

Qualifications

Must-Have

  • 5+ years of QA/Test Engineering experience testing complex product workflows (multi-step user journeys, cross-surface interactions, and E2E behavior).

  • Deep expertise in functional, regression, exploratory, integration, and end-to-end testing methodologies.

  • Strong developer mindset: comfortable reading/writing code (Python, TypeScript, or similar), navigating codebases, and reasoning about systems.

  • User-first testing approach: you test from the perspective of real users, not just against a spec.

  • Exceptional attention to detail and strong debugging instincts; able to communicate clearly and precisely in bug reports and triage.

  • Familiarity with CI/CD and test automation frameworks; comfort working in fast-moving, release-driven environments.

  • Schedule flexibility: overlap with US time zones required; release cycles may require weekend availability.

Strong Plus

  • Experience testing AI-powered products with non-deterministic outputs; ability to evaluate quality when responses vary.

  • Experience testing IDE plugins/extensions or developer tools (VS Code extensions, CLIs, code review systems).

  • Familiarity with AI coding tools (Windsurf, Copilot, Cursor, Devin, etc.) and informed opinions on what “good” looks like.

  • Prior software engineering background with shipped production code.

Equal Opportunity

Cognition is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,657 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
In office • Full-Time • 7+ years exp • Bachelor's Degree • Ho Chi Minh City
JavaScript
Python
AI/ML
Copilot
Cursor
DevOps
Azure DevOps
Jenkins
Azure
GitLab
QA
JMeter
k6
Playwright
Postman
Rest-Assured
Selenium
TestRail
Apply
AI Engineer 1 day ago
$25k – $103k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Gurgaon
Python
SQL
Databases
Databricks
Microsoft Fabric
AI/ML
AI Agents
Embeddings
Gemini
Hallucination
LangChain
LangGraph
LLM
Multimodal AI
Prompt Engineering
PyTorch
RAG
Semantic Search
Spark
TensorFlow
Hugging Face
LLM Guardrails
LLMOps
OpenAI
Semantic Search
DevOps
AWS
Azure
CI/CD
Apply
$47k – $106k per year (Estimated) • In office • Full-Time • Moscow
Python
AI/ML
AutoGen
Chain-of-Thought
Claude
CrewAI
Gemini
LangChain
LangGraph
LLM
Prompt Engineering
RAG
GPT-4
AI Agents
Function Calling
Apply
$28k – $65k per year (Estimated) • In office • Full-Time • 12+ years exp • Bengaluru
Bash
PowerShell
Python
Node JS
JavaScript
Node JS
Commander.js
AI/ML
AI Agents
DevOps
Amazon EC2
Amazon EKS
AWS
Azure
Kubernetes
Amazon ECS
IAM
Cybersecurity
Crowdstrike
Zero Trust
Apply
$55k – $157k per year (Estimated) • Remote • Full-Time • Sydney
C++
Go
Lua
Python
C++
CMake
Databases
ActiveMQ
Aerospike
Apache Kafka
Cassandra
DevOps
Docker
gRPC
Kubernetes
Apply
Security Engineer 25 days ago
$260k – $300k per year • In office • Full-Time • Bachelor's Degree • San Francisco
Go
Python
Rust
AI/ML
Cursor
Windsurf
Devin
Scale AI
DevOps
AWS
Azure
GCP
Kubernetes
Cybersecurity
Threat Modeling
Apply
$260k – $300k per year • In office • Full-Time • San Francisco • New York
AI/ML
Cursor
Windsurf
Devin
Scale AI
DevOps
AWS
Azure
CI/CD
GCP
Kubernetes
Platform Engineering
Terraform
Apply
$158k – $345k per year (Estimated) • In office • Full-Time • PhD • San Francisco
Python
AI/ML
Cursor
LLM
PyTorch
Synthetic Data
Devin
Post-training
Pre-training
Scale AI
Apply
$167k – $365k per year (Estimated) • In office • Full-Time • PhD • San Francisco
AI/ML
Cursor
RLHF
Devin
Post-training
Scale AI
Apply
$157k – $344k per year (Estimated) • In office • Full-Time • PhD • San Francisco
C++
Python
C++
PyTorch C++
AI/ML
Cursor
PyTorch
Devin
Scale AI
Apply
See all jobs
This is one of many
368,657 more open roles from verified company boards, updated every day.