Developer & Infrastructure Expert - Remote

YO AI Labs • AI Training Data & Annotation • AI Evaluation & Observability • 6 hours ago
Smart Apply
Similar jobs
1,572,174open jobs
94,754companies
240,812added this week
Browse all
Salary
≈ $192k – $353k per year (Estimated)
Location
In office (New York)
Seniority
Senior

Confirmed on the employer's own hiring board on Oct 13, 2026. First seen by Alion on Oct 13, 2026. YO AI Labs scores A on the Alion truth index.

Overview
Company
Impact
Profile match

YO AI Labs

YO AI Labs is an artificial intelligence platform specializing in AI model training, evaluation, and data annotation services. Headquartered in San Francisco, California, United States, the company connects domain experts and remote specialists across the globe to review, test, and benchmark generative AI model outputs. Through its decentralized workforce solutions and structured evaluation workflows, it enables frontier technology developers to enhance the accuracy, safety, and reliability of next-generation artificial intelligence systems.
yoailabs.com • HQ: San Francisco, United States • AI Evaluation & Observability • AI Training Data & Annotation • 5000+ employees

Developer & Infrastructure Expert

Role Type: Contractor

Location: Remote

Job Overview

We are seeking experienced Developer & Infrastructure Experts to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and workflows and provide practical feedback based on real-world engineering standards.

No prior AI experience is required-your technical expertise and infrastructure knowledge are what matter most.

Key Responsibilities

  • Test and validate AI-assisted workflows across DevOps, cloud, infrastructure, and platform engineering.
  • Evaluate AI-generated commands, configurations, scripts, and deployment workflows for accuracy and reliability.
  • Work with AWS, Azure, GCP, Kubernetes, Docker, Terraform, and CI/CD environments.
  • Review workflows involving GitHub, GitLab, Azure DevOps, and JIRA.
  • Assess AI agents and workplace connectors across tools such as Slack, Google Drive, and Microsoft 365.
  • Identify technical errors, security or reliability concerns, and workflow gaps.
  • Document findings and provide clear, actionable feedback.
  • Recommend improvements based on real-world engineering practices and industry standards.
  • Collaborate remotely with project stakeholders through written evaluations and virtual discussions.

Required Skills

  • Azure DevOps
  • Cloud Infrastructure
  • Site Reliability Engineering (SRE)
  • Platform Engineering
  • AWS / Azure / GCP
  • Kubernetes / Docker
  • Terraform
  • CI/CD
  • GitHub / GitLab / JIRA
  • Observability
  • ChatGPT Work
  • Claude Code
  • Claude Cowork
  • AI Agents
  • Workplace Connectors

Preferred Qualifications

  • Professional experience in software engineering, DevOps, SRE, cloud, platform, or infrastructure engineering.
  • Hands-on experience with major cloud platforms, Kubernetes, Docker, Terraform, CI/CD, and observability tools.
  • Experience with developer workflow and project management platforms such as GitHub, GitLab, Azure DevOps, and JIRA.
  • Experience using AI agents such as ChatGPT, Claude Code, Claude Cowork, or Codex in development or infrastructure workflows.
  • Strong ability to evaluate technical processes and provide actionable feedback.
  • Excellent written and verbal communication skills.
  • Experience with workplace connectors, automation, or AI-powered infrastructure workflows is a plus.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,572,174 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
New York
$215k – $260k per year • In office • Full-Time • 8+ years exp • Cambridge
Python
Go
JavaScript
TypeScript
SQL
C++
Node JS
Node JS
Express
Databases
PostgreSQL
AI/ML
Vertex AI
AI Agents
AWS Bedrock
OpenAI
Anthropic
Hugging Face
Amazon SageMaker
Frontend
Vue.js
GraphQL
Nuxt.js
Mobile
Firebase
DevOps
Rest API
gRPC
Terraform
GCP
Vercel
CircleCI
Azure
CI/CD
Jenkins
Git
AWS
GitLab
Apply
$195k – $250k per year • In office • Full-Time • Cambridge
Python
Go
JavaScript
TypeScript
SQL
C++
Node JS
Node JS
Express
Databases
PostgreSQL
AI/ML
Vertex AI
AI Agents
AWS Bedrock
OpenAI
Anthropic
Hugging Face
Amazon SageMaker
Frontend
Vue.js
GraphQL
Nuxt.js
Mobile
Firebase
DevOps
Rest API
gRPC
Terraform
GCP
Vercel
CircleCI
Azure
CI/CD
Jenkins
Git
AWS
GitLab
Apply
Senior Developer 2 months ago
≈ $138k – $254k per year (Estimated) • In office • TS/SCI • Full-Time • 10+ years exp • Bachelor's Degree • Herndon
Python
Java
C#
AI/ML
Semantic Search
Knowledge Graph
DevOps
OpenShift
CI/CD
Git
Docker
Kubernetes
Management
Agile
Apply
$144k – $194k per year • In office • Full-Time • 5+ years exp • Bachelor's Degree • Broomfield
Python
DevOps
CI/CD
Apply
≈ $146k – $252k per year (Estimated) • Remote (United States) • Full-Time • 5+ years exp • United States
Python
Go
Java
C++
AI/ML
Machine Learning
DevOps
Azure
CI/CD
AWS
Kubernetes
Platform Engineering
IAM
Cybersecurity
HashiCorp Vault
ISO 27001
SOC 2
Zero Trust
PKI
Cryptography
Vault
Apply
Staff-Data Engineer 6 hours ago
≈ $27k – $54k per year (Estimated) • Hybrid • Full-Time • 8+ years exp • Bachelor's Degree • India
Python
Java
Python
Flask
FastAPI
pySpark
Java
Flyway
Databases
PostgreSQL
Databricks
AI/ML
Spark
LLM
Feature Store
DevOps
Terraform
GCP
Azure DevOps
GitHub Actions
Azure
CI/CD
AWS
AWS Fargate
FinOps
Amazon S3
IAM
Amazon ECS
Analytics
Power BI
Design
Canva
Apply
Technical Specialist 6 hours ago
≈ $12k – $28k per year (Estimated) • Hybrid • Full-Time • 8+ years exp • Bengaluru
JavaScript
TypeScript
Node JS
Node JS
Express
Frontend
Redux
Webpack
Yarn
RxJS
Angular
React.js
Vite
npm
Sass
NgRx
Mobile
State Management
DevOps
Rest API
GCP
Azure
CI/CD
Git
AWS
Docker
Kubernetes
Management
Agile
Scrum
QA
Cypress
Jest
Apply
≈ $52k – $137k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Pune
Python
Java
TypeScript
Python
FastAPI
Java
Spring Boot
Databases
PostgreSQL
pgvector
Google BigQuery
BigQuery
AI/ML
LangGraph
LangChain
MLFlow
SHAP
Vertex AI
Embeddings
Scikit-learn
Prompt Engineering
AI Agents
LangSmith
Semantic Kernel
PyTorch
LLM
RAG
Reranking
Hybrid Search
OpenAI
Hugging Face
LLMOps
Human-in-the-Loop
Structured Outputs
Multi-Agent Systems
Machine Learning
DevOps
Terraform
Azure DevOps
OpenTelemetry
Azure
CI/CD
Git
Docker
Kubernetes
Platform Engineering
GitHub
Apply
Senior UI Engineer 6 hours ago
In office • Full-Time • Bengaluru
JavaScript
TypeScript
Frontend
Redux
GraphQL
Next.js
D3.js
Chart.js
React.js
React Query
Sass
Redux Toolkit
DevOps
Rest API
GCP
WebSockets
Azure
CI/CD
Jenkins
Git
AWS
Management
Jira
Agile
QA
Cypress
Jest
Apply
$29k – $43k per year • Remote (EAEU) • Kazan
1C
AI/ML
Copilot
Cursor
ChatGPT
AI Agents
Management
ITSM
Apply
≈ $163k – $300k per year (Estimated) • In office • Phoenix
AI/ML
Claude
ChatGPT
Claude Code
AI Agents
OpenAI Codex
DevOps
Terraform
GCP
Azure DevOps
Azure
CI/CD
AWS
Docker
Kubernetes
Platform Engineering
GitHub
GitLab
Management
Slack
Google Drive
Apply
≈ $190k – $348k per year (Estimated) • In office • San Jose
AI/ML
Claude
ChatGPT
Claude Code
AI Agents
OpenAI Codex
DevOps
Terraform
GCP
Azure DevOps
Azure
CI/CD
AWS
Docker
Kubernetes
Platform Engineering
GitHub
GitLab
Management
Slack
Google Drive
Apply
≈ $168k – $308k per year (Estimated) • In office • Atlanta
AI/ML
Claude
ChatGPT
Claude Code
AI Agents
OpenAI Codex
DevOps
Terraform
GCP
Azure DevOps
Azure
CI/CD
AWS
Docker
Kubernetes
Platform Engineering
GitHub
GitLab
Management
Slack
Google Drive
Apply
≈ $177k – $325k per year (Estimated) • In office • United States
AI/ML
Claude
ChatGPT
Claude Code
AI Agents
OpenAI Codex
DevOps
Terraform
GCP
Azure DevOps
Azure
CI/CD
AWS
Docker
Kubernetes
Platform Engineering
GitHub
GitLab
Management
Slack
Google Drive
Apply
≈ $171k – $314k per year (Estimated) • In office • Philadelphia
AI/ML
Claude
ChatGPT
Claude Code
AI Agents
OpenAI Codex
DevOps
Terraform
GCP
Azure DevOps
Azure
CI/CD
AWS
Docker
Kubernetes
Platform Engineering
GitHub
GitLab
Management
Slack
Google Drive
Apply
≈ $186k – $341k per year (Estimated) • In office • 8+ years exp • Bachelor's Degree • New York
Python
Go
JavaScript
TypeScript
C++
AI/ML
LLM
Apply
$46k – $52k per year • In office • Full-Time • 2+ years exp • High School Diploma • New York
Apply
$46k – $56k per year • In office • Full-Time • 1+ year exp • High School Diploma • New York
Apply
$46k – $62k per year • In office • Full-Time • 3+ years exp • High School Diploma • New York
Apply
$101k – $123k per year • In office • Full-Time • 4+ years exp • Bachelor's Degree • New York
Apply
See all jobs
This is one of many
1,572,174 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles