2,115,188open jobs
134,036companies
243,448added this week
Browse all
Salary
$180k – $240k per year
Location
Remote (United States, China, India, Germany, Japan, France, Russia, United Arab Emirates, United Kingdom, Argentina, Australia, Austria, Belarus, Belgium, Bosnia and Herzegovina, Brazil, Bulgaria, Canada, Colombia, Croatia, Cyprus, Czech Republic, Denmark, Egypt, Finland, Hungary, Indonesia, Ireland, Israel, Italy, Kazakhstan, Kenya, Kyrgyzstan, Malaysia, Mexico, Montenegro, Netherlands, New Zealand, Nigeria, Norway, Pakistan, Philippines, Poland, Romania, Saudi Arabia, Serbia, South Africa, South Korea, Spain, Sweden, Switzerland, Taiwan, Thailand, Turkey, Ukraine, Uzbekistan, Vietnam, Afghanistan, Albania, Algeria, American Samoa, Andorra, Angola, Anguilla, Armenia, Aruba, Azerbaijan, Bahamas, Bahrain, Bangladesh, Barbados, Belize, Benin, Bermuda, Bhutan, Bolivia, Botswana, British Virgin Islands, Brunei Darussalam, Burkina Faso, Burundi, Cambodia, Cameroon, Cape Verde, Cayman Islands, Chad, Chile, Central African Republic, Comoros, Cook Islands, Costa Rica, Cuba, Curaçao, Djibouti, Dominica, Dominican Republic, East Timor, Ecuador, El Salvador, Equatorial Guinea, Eritrea, Estonia, Eswatini, Ethiopia, Falkland Islands, Faroe Islands, Fiji, French Guiana, French Polynesia, Gabon, Gambia, Georgia, Ghana, Greece, Greenland, Grenada, Guadeloupe, Guam, Guatemala, Guinea, Guinea-Bissau, Guyana, Haiti, Honduras, Iceland, Iran, Iraq, Isle of Man, Jamaica, Jordan, Kiribati, Kosovo, Kuwait, Laos, Latvia, Lebanon, Lesotho, Liberia, Libya, Liechtenstein, Lithuania, Luxembourg, Madagascar, Malawi, Maldives, Mali, Malta, Marshall Islands, Martinique, Mauritania, Mauritius, Mayotte, Micronesia, Moldova, Monaco, Mongolia, Montserrat, Morocco, Mozambique, Namibia, Nauru, Nepal, New Caledonia, Nicaragua, Niger, Niue, Norfolk Island, North Korea, North Macedonia, Northern Mariana Islands, Oman, Palau, Panama, Papua New Guinea, Paraguay, Peru, Pitcairn Islands, Portugal, Puerto Rico, Qatar, Réunion, Rwanda, Samoa, San Marino, Senegal, Seychelles, Sierra Leone, Sint Maarten, Slovakia, Slovenia, Solomon Islands, Somalia, South Sudan, Sri Lanka, Sudan, Suriname, Syria, Tajikistan, Tanzania, Togo, Tokelau, Tonga, Tunisia, Turkmenistan, Tuvalu, Uganda, Uruguay, Vanuatu, Venezuela, Western Sahara, Yemen, Zambia, Zimbabwe, Singapore, Gibraltar)
Seniority
Senior · 7+ years exp
Employment
Contractor

Confirmed on the employer's own hiring board on Nov 5, 2026. First seen by Alion on Oct 4, 2026.

Overview
Company
Impact
Profile match
Alpheva AI provides expert LLM training data, human feedback, model evaluations, and agent environments grounded in real professional workflows.

Bring senior cloud expertise to AI evaluation projects focused on cloud architecture, reliability, cost, and operational controls.

Review model responses and worked examples for incorrect technical assumptions, missing failure cases, and reliability or security gaps. Assess whether the reasoning meets professional standards for the stated task.

Write reference answers and scoring criteria grounded in cloud architecture, reliability, cost, and operational controls. Explain consequential errors, evidence gaps, and the reasoning behind your corrections.

This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.

Responsibilities

  • Evaluate advanced domain tasks and AI-generated responses for factual accuracy and professional judgment.
  • Apply current standards, methods, and risk considerations from technology & computing.
  • Document errors, edge cases, and the reasoning behind an ideal response.
  • Collaborate asynchronously with Alpheva's research and evaluation teams.

Required Qualifications

  • 7+ years of substantive experience in cloud platform engineering or site reliability.
  • Demonstrated senior-level judgment in cloud architecture, reliability, cost, and operational controls, with substantial responsibility for reviewing or delivering this work.
  • Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,115,188 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

DevOps
Similar stack
Same company
In your city
$150k – $180k per year · Remote (United States) · Public Trust · Full-Time
JavaScript
TypeScript
Frontend
Sass
DevOps
Rest API
Terraform
Azure DevOps
Azure
CI/CD
Git
Docker
Kubernetes
Configuration Management
Bicep
Azure AKS
Cybersecurity
FedRAMP
Microsoft Entra ID
Management
Power Apps
Apply
Remote (Canada) · Full-Time · 5+ years exp · Mississauga
DevOps
Prometheus
Azure
CI/CD
Windows Server
Kubernetes
Grafana
Azure AKS
Incident Management
SLI/SLO/SLA
Windows
TCP/IP
DNS
Apply
$100k – $120k per year · Remote (United States) · Full-Time · 5+ years exp · Phoenix · Salt Lake City · Washington
DevOps
Azure
Windows Server
Windows
TCP/IP
DNS
DHCP
Cybersecurity
Microsoft Entra ID
Active Directory
Management
Service Desk
Apply
Remote (India) · Full-Time · 15+ years exp · Bengaluru
DevOps
Azure
AWS
VPN
VLAN
BGP
OSPF
Apply
Remote (India) · Full-Time · 10+ years exp · Bengaluru
DevOps
Azure
AWS
TCP/IP
DNS
DHCP
VPN
Wi-Fi
BGP
OSPF
Apply
See all jobs
This is one of many
2,115,188 more open roles from verified company boards, updated every day.