368,634open jobs
9,437companies
50,578added this week
Browse all
Salary
$12k – $130k per year
Location
In office
Employment
Freelance
Overview
Company
Impact
Profile match
Agency AI is a developer platform and enterprise consulting firm specializing in AI agent observability, testing, and deployment, headquartered in San Francisco, California. Founded in 2023 by Alex Reibman, Adam Silverman, and Shawn Qiu, the company developed AgentOps, an industry-standard observability and evaluation tool suite that allows developers to monitor, debug, and optimize multi-agent autonomous workflows in real time across frameworks like AutoGen and CrewAI.

Are you a software developer and programming specialist eager to shape the future of AI? Large-scale language models are evolving from clever chatbots into powerful engines of software innovation. With high-quality training data, tomorrow’s AI can democratize world-class coding education, keep pace with cutting-edge development practices, and streamline programming workflows for developers everywhere. That training data begins with you-we need your expertise to help power the next generation of AI.

We’re looking for software developers and programming specialists who live and breathe software engineering, algorithms, data structures, debugging, software architecture, version control, testing frameworks, and code optimization. You’ll challenge advanced language models on topics like object-oriented programming, functional programming paradigms, API design, concurrency, cloud-native development, and DevOps practices-documenting every failure mode so we can harden model reasoning.

On a typical day, you will converse with the model on coding scenarios and theoretical programming questions, verify code correctness and logical soundness, capture reproducible error traces, and suggest improvements to our prompt engineering and evaluation metrics.

A bachelor’s or master’s degree in computer science, software engineering, or a closely related field is ideal; peer-reviewed publications, software development projects, or contributions to open source signal fit. Clear, metacognitive communication-“showing your work”-is essential.

Ready to turn your software development expertise into the knowledge base for tomorrow’s AI? Apply today and start teaching the model that will teach the world.

We offer a pay range of $6-to- $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.

Employment type: Contract

Workplace type: Remote

Seniority level: Mid-Senior Level

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,634 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$26k – $66k per year (Estimated) • In office • Full-Time • 7+ years exp • Master's Degree • Hyderabad
Python
SQL
TypeScript
Databases
OpenSearch
Snowflake
AI/ML
AI Agents
AWS Bedrock
Claude
Claude Code
Fine-tuning
Hallucination
LangChain
LLM
Model Context Protocol
Multimodal AI
Prompt Engineering
RAG
Synthetic Data
A2A
Amazon SageMaker
DevOps
AWS
CI/CD
Docker
Vector
Analytics
A/B Testing
Apply
$26k – $66k per year (Estimated) • In office • Full-Time • 7+ years exp • Master's Degree • Hyderabad
Python
SQL
TypeScript
Databases
OpenSearch
Snowflake
AI/ML
AI Agents
AWS Bedrock
Claude
Claude Code
Fine-tuning
Hallucination
LangChain
LLM
Model Context Protocol
Multimodal AI
Prompt Engineering
RAG
Synthetic Data
A2A
Amazon SageMaker
DevOps
AWS
CI/CD
Docker
Vector
Analytics
A/B Testing
Apply
AI Engineer 2 days ago
Remote/Hybrid • 8+ years exp
C#
Python
TypeScript
C#
.NET
Databases
ElasticSearch
OpenSearch
AI/ML
AutoGen
AWS Bedrock
Claude
CrewAI
Embeddings
LangGraph
LLM
Model Context Protocol
Prompt Engineering
RAG
Semantic Kernel
Semantic Search
LangChain
Anthropic
LLM Guardrails
OpenAI
OpenAI Agents SDK
Semantic Search
Structured Outputs
AI Agents
Function Calling
DevOps
AWS
Azure
Docker
GCP
Kubernetes
Vector
Apply
In office • Full-Time • 4+ years exp • Bachelor's Degree • Karachi • Islamabad
JavaScript
SQL
C#
C#
ASP.NET Core
Entity Framework Core
Databases
MS SQL
AI/ML
ChatGPT
Copilot
Cursor
Prompt Engineering
Context Engineering
Frontend
Bootstrap
Vue.js
DevOps
Azure
Azure DevOps
Rest API
GitHub
Management
Jira
Apply
$88k – $232k per year (Estimated) • In office • Full-Time • 6+ years exp • Singapore
Java
Python
Databases
Redis
AI/ML
LangChain
Langfuse
LangGraph
Prompt Engineering
RAG
vLLM
AI Agents
Function Calling
DevOps
Kubernetes
OpenShift
Apply
$22k – $60k per year • Remote • Freelance
AI/ML
AI Agents
Apply
Remote • Freelance
JavaScript
Python
AI/ML
Structured Outputs
Frontend
Three.JS
Design
Blender
ZBrush
Apply
$160k – $300k per year • Remote • Freelance • Bachelor's Degree
JavaScript
Python
TypeScript
DevOps
Platform Engineering
Apply
$160k – $300k per year • Remote • Freelance • Bachelor's Degree
Java
DevOps
Platform Engineering
Apply
$12k – $130k per year • In office • Freelance • Bachelor's Degree
PHP
AI/ML
Prompt Engineering
Apply
See all jobs
This is one of many
368,634 more open roles from verified company boards, updated every day.