415,615open jobs
14,704companies
74,833added this week
Browse all
Salary
$140k – $200k per year
Location
Remote
Employment
Freelance
Overview
Company
Impact
Profile match
Agency AI is a developer platform and enterprise consulting firm specializing in AI agent observability, testing, and deployment, headquartered in San Francisco, California. Founded in 2023 by Alex Reibman, Adam Silverman, and Shawn Qiu, the company developed AgentOps, an industry-standard observability and evaluation tool suite that allows developers to monitor, debug, and optimize multi-agent autonomous workflows in real time across frameworks like AutoGen and CrewAI.

Project Overview

We are sorcing experienced technical specialists in Kubernetes to audit tasks used to train and evaluate AI systems. The objective of this project is to ensure that AI training workflows and tasks are technically rigorous, practical, and highly accurate within your specific area of expertise.

Project Deliverables & Scope

  • Task Evaluation:  Assess whether Kubernetes tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.
  • Technical Auditing & Feedback:  Provide clear, actionable feedback on any identified orchestration issues, configuration bugs, or logic errors within the tasks.

Required Expertise

  • Demonstrable professional experience and deep technical knowledge in Kubernetes (including container orchestration, cluster management, and deployment scaling). (Note: Candidates will be considered for one specialty based on their experience; expertise across other domains is not required).
  • Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.

We offer a pay range of $70 - $100 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.

Employment type: Freelance Contract

Workplace type: Remote

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
415,615 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$16k per year • Remote/Hybrid • Novosibirsk
SQL
DevOps
Docker
Git
Gitflow
GitLab
GitLab CI
Kubernetes
Rest API
Management
Confluence
Jira
QA
Postman
Swagger
Apply
$20k – $50k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Hong Kong
Python
SQL
JavaScript
Python
FastAPI
Databases
Databricks
AI/ML
Agentic Workflows
AI Agents
AutoGen
CrewAI
Embeddings
LangChain
LangGraph
Multi-Agent Systems
OpenAI
Prompt Engineering
RAG
Frontend
Next.js
React.js
DevOps
Azure
CI/CD
Docker
Kubernetes
OpenShift
Rest API
Apply
$76k – $180k per year (Estimated) • In office • Full-Time • 7+ years exp • Melbourne
Bash
PowerShell
Python
DevOps
Ansible
AWS
Azure
CI/CD
Git
Kubernetes
Splunk
Terraform
Apply
$52k per year • Remote • Full-Time • 5+ years exp
Go
DevOps
AWS
Azure
Docker
GCP
Kubernetes
Web3
Avalanche
Ethereum
Polygon
Reown
Smart Contracts
Apply
$52k per year • Remote • Full-Time
Go
Kotlin
Rust
Solidity
TypeScript
JavaScript
Databases
Azure Cosmos DB
PostgreSQL
Frontend
Chakra UI
Next.js
React.js
DevOps
Argo Workflows
ArgoCD
Azure
CI/CD
GitHub
GitHub Actions
Grafana
Kubernetes
OpenTelemetry
Web3
Cosmos
Ethereum
Apply
Remote • Freelance
Cybersecurity
CVE
Threat Modeling
Apply
Remote • Freelance
AI/ML
PyTorch
TensorFlow
Apply
Remote • Freelance
DevOps
AWS
AWS Lambda
CloudFormation
Terraform
Apply
Remote • Freelance
AI/ML
CUDA
CUDA Toolkit
Triton
Apply
See all jobs
This is one of many
415,615 more open roles from verified company boards, updated every day.