429,799open jobs
14,642companies
59,404added this week
Browse all
Salary
$16k – $130k per year
Location
In office
Employment
Freelance
Overview
Company
Impact
Profile match
Agency AI is a developer platform and enterprise consulting firm specializing in AI agent observability, testing, and deployment, headquartered in San Francisco, California. Founded in 2023 by Alex Reibman, Adam Silverman, and Shawn Qiu, the company developed AgentOps, an industry-standard observability and evaluation tool suite that allows developers to monitor, debug, and optimize multi-agent autonomous workflows in real time across frameworks like AutoGen and CrewAI.

Are you an experienced Full Stack Engineer eager to shape the future of AI? Large-scale language models are evolving rapidly, moving beyond simple chatbots into powerful engines of research, learning, and applied problem-solving. With high-quality training data, tomorrow’s AI can provide more accurate, practical, and innovative solutions across industries. That training data begins with you-your expertise will help power the next generation of AI.

We’re looking for a highly skilled Full Stack Engineering specialist who can bring technical depth, coding expertise, and architectural insight to training data. You’ll work with cutting-edge AI tools, evaluate and refine code outputs, and provide expert feedback on correctness, efficiency, scalability, and best practices across the stack.

On a typical day, you will review and annotate AI-generated code, assess outputs for logical and structural soundness, identify and document error patterns, and collaborate with our team to refine prompts, evaluation methods, and engineering guidelines.

Proficiency in both frontend and backend technologies is required, including strong experience with languages such as JavaScript/TypeScript, Python, or Java; frameworks such as React, Node.js, or Django; and databases (SQL/NoSQL). Experience in cloud services, CI/CD pipelines, or containerization (Docker/Kubernetes) is a strong plus. Clear communication skills, problem-solving ability, and attention to detail are essential.

Ready to channel your engineering expertise into building the AI tools of tomorrow? Apply today and help train the model that will support developers and organizations worldwide.

We offer a pay range of $8 to $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and stable internet connection; company-sponsored benefits such as health insurance and PTO do not apply.

Job title: Full Stack Engineering Specialist - AI Trainer

Employment type: Contract

Workplace type: Remote

Seniority level: Mid-Senior

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
429,799 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
up to $95k per year • Remote/Hybrid • Full-Time • Bachelor's Degree • Wotton-under-Edge
Python
C++
DevOps
Azure DevOps
Prometheus
Azure
CI/CD
Git
Cortex
Robotics
EtherCAT
CANopen
Apply
$65k – $88k per year • Remote/Hybrid • Full-Time • Bachelor's Degree • Wotton-under-Edge
Python
C++
DevOps
Azure DevOps
Prometheus
Azure
CI/CD
Git
Cortex
Robotics
EtherCAT
CANopen
Apply
$61k – $88k per year • Remote/Hybrid • Bachelor's Degree • Wotton-under-Edge
Python
C++
VHDL
DevOps
Azure DevOps
Azure
CI/CD
Git
Chips/EDA
OSVVM
VUnit
Active-HDL
Apply
up to $95k per year • Remote/Hybrid • Full-Time • Bachelor's Degree • Wotton-under-Edge
Python
C++
VHDL
DevOps
Azure DevOps
Azure
CI/CD
Git
Chips/EDA
OSVVM
VUnit
Active-HDL
Apply
$89k – $187k per year (Estimated) • In office • Full-Time • 4+ years exp • Bachelor's Degree • Washington
JavaScript
Java
Java
Spring Boot
Databases
MySQL
PostgreSQL
RabbitMQ
DevOps
Terraform
Terragrunt
Datadog
CI/CD
Git
AWS
Docker
AWS Lambda
IAM
Apply
$65k – $102k per year (Estimated) • Remote • 3+ years exp
Apply
Apply
$22k – $60k per year • Remote • Freelance
AI/ML
AI Agents
Apply
$12k – $130k per year • In office • Contractor • Bachelor's Degree • Singapore
AI/ML
Prompt Engineering
Apply
$12k – $130k per year • In office • Freelance • Bachelor's Degree • Singapore
Python
SQL
AI/ML
Prompt Engineering
LLM
RAG
OpenAI Evals
Hallucination
OpenAI
LLM Evaluation
LLM Guardrails
Tool Use
QA
Pytest
Apply
See all jobs
This is one of many
429,799 more open roles from verified company boards, updated every day.