Software Engineering Expert
Smart Apply
Save
Salary
$340k – $440k per year
Location
Remote (United States, China, India, Germany, Japan, France, Russia, United Arab Emirates, United Kingdom, Argentina, Australia, Austria, Belarus, Belgium, Bosnia and Herzegovina, Brazil, Bulgaria, Canada, Colombia, Croatia, Cyprus, Czech Republic, Denmark, Egypt, Finland, Hungary, Indonesia, Ireland, Israel, Italy, Kazakhstan, Kenya, Kyrgyzstan, Malaysia, Mexico, Montenegro, Netherlands, New Zealand, Nigeria, Norway, Pakistan, Philippines, Poland, Romania, Saudi Arabia, Serbia, South Africa, South Korea, Spain, Sweden, Switzerland, Taiwan, Thailand, Turkey, Ukraine, Uzbekistan, Vietnam, Afghanistan, Albania, Algeria, American Samoa, Andorra, Angola, Anguilla, Armenia, Aruba, Azerbaijan, Bahamas, Bahrain, Bangladesh, Barbados, Belize, Benin, Bermuda, Bhutan, Bolivia, Botswana, British Virgin Islands, Brunei Darussalam, Burkina Faso, Burundi, Cambodia, Cameroon, Cape Verde, Cayman Islands, Chad, Chile, Central African Republic, Comoros, Cook Islands, Costa Rica, Cuba, Curaçao, Djibouti, Dominica, Dominican Republic, East Timor, Ecuador, El Salvador, Equatorial Guinea, Eritrea, Estonia, Eswatini, Ethiopia, Falkland Islands, Faroe Islands, Fiji, French Guiana, French Polynesia, Gabon, Gambia, Georgia, Ghana, Greece, Greenland, Grenada, Guadeloupe, Guam, Guatemala, Guinea, Guinea-Bissau, Guyana, Haiti, Honduras, Iceland, Iran, Iraq, Isle of Man, Jamaica, Jordan, Kiribati, Kosovo, Kuwait, Laos, Latvia, Lebanon, Lesotho, Liberia, Libya, Liechtenstein, Lithuania, Luxembourg, Madagascar, Malawi, Maldives, Mali, Malta, Marshall Islands, Martinique, Mauritania, Mauritius, Mayotte, Micronesia, Moldova, Monaco, Mongolia, Montserrat, Morocco, Mozambique, Namibia, Nauru, Nepal, New Caledonia, Nicaragua, Niger, Niue, Norfolk Island, North Korea, North Macedonia, Northern Mariana Islands, Oman, Palau, Panama, Papua New Guinea, Paraguay, Peru, Pitcairn Islands, Portugal, Puerto Rico, Qatar, Réunion, Rwanda, Samoa, San Marino, Senegal, Seychelles, Sierra Leone, Sint Maarten, Slovakia, Slovenia, Solomon Islands, Somalia, South Sudan, Sri Lanka, Sudan, Suriname, Syria, Tajikistan, Tanzania, Togo, Tokelau, Tonga, Tunisia, Turkmenistan, Tuvalu, Uganda, Uruguay, Vanuatu, Venezuela, Western Sahara, Yemen, Zambia, Zimbabwe, Singapore, Gibraltar)
Seniority
Senior · 7+ years exp
Employment
Contractor
Confirmed on the employer's own hiring board on Nov 2, 2026. First seen by Alion on Oct 4, 2026.
Overview
Company
Impact
Profile match
Alpheva AI provides expert LLM training data, human feedback, model evaluations, and agent environments grounded in real professional workflows.
Bring senior software expertise to AI evaluation projects focused on production code, system design, tests, and failure handling.
Review model responses and worked examples for incorrect technical assumptions, missing failure cases, and reliability or security gaps. Assess whether the reasoning meets professional standards for the stated task.
Write reference answers and scoring criteria grounded in production code, system design, tests, and failure handling. Explain consequential errors, evidence gaps, and the reasoning behind your corrections.
This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.
Responsibilities
- Evaluate advanced domain tasks and AI-generated responses for factual accuracy and professional judgment.
- Apply current standards, methods, and risk considerations from technology & computing.
- Document errors, edge cases, and the reasoning behind an ideal response.
- Collaborate asynchronously with Alpheva's research and evaluation teams.
Required Qualifications
- 7+ years of substantive experience in professional software engineering.
- Demonstrated senior-level judgment in production code, system design, tests, and failure handling, with substantial responsibility for reviewing or delivering this work.
- Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,068,378 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Recommended for you based on this role
Backend
Similar stack
Same company
In your city
Senior Software Engineer - Backend
2 hours ago
Remote (Europe) · 4+ years exp · Bachelor's Degree · Pune
Python
Java
SQL
Java
Spring Boot
Databases
MySQL
PostgreSQL
Druid
ClickHouse
Aerospike
Apache Kafka
Google BigQuery
AI/ML
Copilot
Cursor
Spark
Airflow
Claude Code
AI Agents
LLM Guardrails
Machine Learning
Frontend
GraphQL
Mobile
Clean Architecture
DevOps
Rest API
gRPC
GCP
AWS
Wi-Fi
Management
Agile
Apply
Staff Software Engineer - Backend
2 hours ago
Remote (Europe) · 8+ years exp · Pune
Java
Java
Spring Boot
Spring Cloud
Databases
MySQL
PostgreSQL
Redis
Aerospike
Cassandra
Apache Kafka
AI/ML
Copilot
Cursor
Claude Code
Model Context Protocol
AI Agents
Flink
LLM
RAG
Context Engineering
LLM Guardrails
Agentic Workflows
DevOps
Rest API
gRPC
GCP
Prometheus
CI/CD
AWS
Docker
Kubernetes
Grafana
Wi-Fi
Apply
Staff Software Engineer - UI
2 hours ago
Remote (Europe) · 8+ years exp · Pune
JavaScript
TypeScript
AI/ML
Copilot
Cursor
Claude Code
Model Context Protocol
LLM
Structured Outputs
Frontend
Zustand
Webpack
GraphQL
Tailwind CSS
React.js
Vite
Sass
AG Grid
DevOps
WebSockets
CI/CD
Grafana
Wi-Fi
Robotics
Apollo
Apply
Senior Software Engineer, Backend - LATAM
2 days ago
Remote (LATAM) · Contractor
Java
Kotlin
SQL
AI/ML
Cursor
Claude
DevOps
Splunk
Terraform
Datadog
Apply
Senior Software Engineer
6 hours ago
Remote (United States) · Full-Time
DevOps
CI/CD
Cybersecurity
SOC 2
HIPAA
Management
Agile
Kanban
Apply
This is one of many
2,068,378 more open roles from verified company boards, updated every day.