412,158open jobs
14,541companies
72,770added this week
Browse all
Location
Remote
Employment
Freelance
Overview
Company
Impact
Profile match
Agency AI is a developer platform and enterprise consulting firm specializing in AI agent observability, testing, and deployment, headquartered in San Francisco, California. Founded in 2023 by Alex Reibman, Adam Silverman, and Shawn Qiu, the company developed AgentOps, an industry-standard observability and evaluation tool suite that allows developers to monitor, debug, and optimize multi-agent autonomous workflows in real time across frameworks like AutoGen and CrewAI.

Project Overview  We are sourcing experienced technical specialists in AWS Serverless and Infrastructure as Code to audit tasks used to train and evaluate AI systems. The objective of this project is to ensure that AI training workflows and tasks are technically rigorous, practical, and highly accurate within your specific area of expertise.

Project Deliverables & Scope

  • Task Evaluation:  Assess whether AWS Serverless and IaC tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.

  • Technical Auditing & Feedback:  Provide clear, actionable feedback on any identified deployment pipeline failures, resource configuration bugs, or architecture logic errors within the tasks.

Required Expertise

  • Demonstrable professional experience and deep technical knowledge in AWS Serverless and IaC (including Lambda, cloud provisioning, and frameworks like Terraform or CloudFormation). (Note: Candidates will be considered for one specialty based on their experience; expertise across other domains is not required).

  • Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.

We offer a pay range of $70 - $100 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.

Employment type:  Freelance Contract

Workplace type:  Remote

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
412,158 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$14k – $42k per year (Estimated) • Remote/Hybrid • Full-Time • 3+ years exp • Bachelor's Degree • Hyderabad
Python
SQL
PowerShell
Bash
DevOps
Terraform
Ansible
GCP
Red Hat
Azure DevOps
VMWare
CloudFormation
Azure
CI/CD
Git
AWS
Hyper-V
Apply
$33k – $40k per year (net) • In office • Moscow
Python
PHP
Bash
Databases
PostgreSQL
DevOps
PHP-FPM
Terraform
Ansible
Zabbix
Loki
Prometheus
GitLab CI
CI/CD
Jenkins
Git
Docker
Kubernetes
Nginx
Grafana
CentOS Stream
GitLab
Apply
Senior SRE - Networks 7 hours ago
$102k – $191k per year (Estimated) • Remote/Hybrid • Full-Time • London
Python
DevOps
Splunk
Ansible
GCP
Prometheus
Azure
CI/CD
Jenkins
Git
AWS
Grafana
Fastly
GitHub
Apply
$17k – $43k per year (Estimated) • Remote/Hybrid • Full-Time • Zhukovsky
Databases
PostgreSQL
MinIO
ElasticSearch
DevOps
Terraform
Ansible
Docker Compose
Helm
Jaeger
Istio
Kibana
OpenTelemetry
Fluentd
Prometheus
VictoriaMetrics
Docker
Kubernetes
Nginx
Grafana
Alertmanager
Apply
DevOps-инженер 8 hours ago
$9.5k – $28k per year (Estimated) • Remote • Full-Time • 2+ years exp • Almaty
Python
Bash
Databases
MySQL
PostgreSQL
DevOps
Terraform
Ansible
Loki
Terragrunt
VMWare
Prometheus
Yandex Cloud
GitLab CI
CI/CD
GitOps
ArgoCD
Jenkins
Kubernetes
Cloudflare
Ubuntu
Grafana
KVM
OpenStack
CentOS Stream
GitLab
Amazon S3
Apply
Remote • Freelance
Cybersecurity
CVE
Threat Modeling
Apply
Remote • Freelance
AI/ML
TensorFlow
PyTorch
Apply
Remote • Freelance
AI/ML
CUDA Toolkit
CUDA
Triton
Apply
Remote • Freelance
AI/ML
AWS Trainium
DevOps
AWS
Apply
See all jobs
This is one of many
412,158 more open roles from verified company boards, updated every day.