2,074,894open jobs
126,999companies
240,992added this week
Browse all
Salary
$360k – $460k per year
Location
Remote (United States, China, India, Germany, Japan, France, Russia, United Arab Emirates, United Kingdom, Argentina, Australia, Austria, Belarus, Belgium, Bosnia and Herzegovina, Brazil, Bulgaria, Canada, Colombia, Croatia, Cyprus, Czech Republic, Denmark, Egypt, Finland, Hungary, Indonesia, Ireland, Israel, Italy, Kazakhstan, Kenya, Kyrgyzstan, Malaysia, Mexico, Montenegro, Netherlands, New Zealand, Nigeria, Norway, Pakistan, Philippines, Poland, Romania, Saudi Arabia, Serbia, South Africa, South Korea, Spain, Sweden, Switzerland, Taiwan, Thailand, Turkey, Ukraine, Uzbekistan, Vietnam, Afghanistan, Albania, Algeria, American Samoa, Andorra, Angola, Anguilla, Armenia, Aruba, Azerbaijan, Bahamas, Bahrain, Bangladesh, Barbados, Belize, Benin, Bermuda, Bhutan, Bolivia, Botswana, British Virgin Islands, Brunei Darussalam, Burkina Faso, Burundi, Cambodia, Cameroon, Cape Verde, Cayman Islands, Chad, Chile, Central African Republic, Comoros, Cook Islands, Costa Rica, Cuba, Curaçao, Djibouti, Dominica, Dominican Republic, East Timor, Ecuador, El Salvador, Equatorial Guinea, Eritrea, Estonia, Eswatini, Ethiopia, Falkland Islands, Faroe Islands, Fiji, French Guiana, French Polynesia, Gabon, Gambia, Georgia, Ghana, Greece, Greenland, Grenada, Guadeloupe, Guam, Guatemala, Guinea, Guinea-Bissau, Guyana, Haiti, Honduras, Iceland, Iran, Iraq, Isle of Man, Jamaica, Jordan, Kiribati, Kosovo, Kuwait, Laos, Latvia, Lebanon, Lesotho, Liberia, Libya, Liechtenstein, Lithuania, Luxembourg, Madagascar, Malawi, Maldives, Mali, Malta, Marshall Islands, Martinique, Mauritania, Mauritius, Mayotte, Micronesia, Moldova, Monaco, Mongolia, Montserrat, Morocco, Mozambique, Namibia, Nauru, Nepal, New Caledonia, Nicaragua, Niger, Niue, Norfolk Island, North Korea, North Macedonia, Northern Mariana Islands, Oman, Palau, Panama, Papua New Guinea, Paraguay, Peru, Pitcairn Islands, Portugal, Puerto Rico, Qatar, Réunion, Rwanda, Samoa, San Marino, Senegal, Seychelles, Sierra Leone, Sint Maarten, Slovakia, Slovenia, Solomon Islands, Somalia, South Sudan, Sri Lanka, Sudan, Suriname, Syria, Tajikistan, Tanzania, Togo, Tokelau, Tonga, Tunisia, Turkmenistan, Tuvalu, Uganda, Uruguay, Vanuatu, Venezuela, Western Sahara, Yemen, Zambia, Zimbabwe, Singapore, Gibraltar)
Seniority
Senior · 7+ years exp
Employment
Contractor

Confirmed on the employer's own hiring board on Nov 2, 2026. First seen by Alion on Oct 4, 2026.

Overview
Company
Impact
Profile match
Alpheva AI provides expert LLM training data, human feedback, model evaluations, and agent environments grounded in real professional workflows.

Bring senior ai/ml expertise to AI evaluation projects focused on model evaluation, data leakage, training assumptions, and ML reliability.

Review model responses and worked examples for incorrect technical assumptions, missing failure cases, and reliability or security gaps. Assess whether the reasoning meets professional standards for the stated task.

Write reference answers and scoring criteria grounded in model evaluation, data leakage, training assumptions, and ML reliability. Explain consequential errors, evidence gaps, and the reasoning behind your corrections.

This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.

Responsibilities

  • Evaluate advanced domain tasks and AI-generated responses for factual accuracy and professional judgment.
  • Apply current standards, methods, and risk considerations from technology & computing.
  • Document errors, edge cases, and the reasoning behind an ideal response.
  • Collaborate asynchronously with Alpheva's research and evaluation teams.

Required Qualifications

  • 7+ years of substantive experience in applied machine learning or ML research.
  • Demonstrated senior-level judgment in model evaluation, data leakage, training assumptions, and ML reliability, with substantial responsibility for reviewing or delivering this work.
  • Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,074,894 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
In your city
Remote (India) · Full-Time · 8+ years exp · Gurgaon
Python
Java
Java
Spring Boot
AI/ML
Vertex AI
Fine-tuning
Scikit-learn
Prompt Engineering
AI Agents
TensorFlow
PyTorch
LLM
RAG
Amazon SageMaker
Multi-Agent Systems
Machine Learning
DevOps
Azure
AWS
Docker
Kubernetes
Apply
ML Engineer 2 hours ago
Remote (likely EAEU) · 4+ years exp · Moscow
Databases
PostgreSQL
AI/ML
LangGraph
LangChain
Hadoop
PyTorch
LLM
RAG
Machine Learning
Apply
$120k – $215k per year · Remote (United States) · 3+ years exp · Master's Degree · Eden Prairie
AI/ML
Prompt Engineering
AI Agents
LLM
RAG
Hallucination
Semantic Search
LLM Guardrails
Machine Learning
Apply
Remote (United States) · Full-Time · 5+ years exp · Chicago
Python
TypeScript
AI/ML
Fine-tuning
Embeddings
Prompt Engineering
Multimodal AI
Function Calling
AI Agents
LLM
RAG
OCR
Human-in-the-Loop
LLM Guardrails
Apply
Remote (United States) · Full-Time · 5+ years exp · Chicago
Python
SQL
AI/ML
Fine-tuning
Embeddings
AI Agents
LLM
RAG
Machine Learning
Apply
See all jobs
This is one of many
2,074,894 more open roles from verified company boards, updated every day.