{"id":4212377,"url":"https://alion.io/job/anyone-ai-platform-engineer-rl-eval-data-100-remote","title":"Platform Engineer, RL & Eval Data | 100% remote","company":{"id":9137,"name":"Anyone AI","domain":"anyoneai.com","url":"https://alion.io/company/anyone-ai","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":176,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":63,"computed_at":"2026-11-12T10:38:37Z"}},"role":"DevOps","role_family":"DevOps","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["AR"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Docker","optional":false},{"name":"E2B","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"Post-training","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"React.js","optional":false},{"name":"TypeScript","optional":false},{"name":"JavaScript","optional":true}],"status":"live","first_seen_at":"2026-11-13T01:06:25Z","employer_posted_date":"2026-11-13","last_verified_at":"2026-11-13T01:28:33Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About the team\nThe Human Data Division builds training and evaluation data for frontier AI labs: RL environments, coding and STEM evaluation tasks, and expert-annotated datasets. We are a small team that moves fast and holds a high quality bar.\nThe role\nWe have built our own evaluation, RL and annotation platforms, and they are already in use. We are looking for a platform engineer to join the platform team as a core member and play a central part in their next stage: keeping them running, making them faster and more reliable, and building the features the team and our clients need next.\nYou will work across all of these systems and get to know them in depth. You will work closely with the people who write our tasks, review our data and work with the labs, and help turn what they need into working software.\nResponsibilities\nMaintain and improve the platforms. Learn the existing codebases in depth and keep them healthy in production: fix bugs, pay down technical debt, improve test coverage and documentation.\n\nBuild new features. Design and ship new capabilities across the stack, from the database and backend to the APIs and internal tools.\n\nScale the systems. Grow the platforms from today's volume to much larger workloads, with predictable performance and cost.\n\nBuild RL environments and their infrastructure. Build environments that agents act in, and the infrastructure that runs them at scale: sandboxes, environment images, rollouts and reward computation.\n\nKeep everything reliable and secure. Monitoring, alerting, incident response, access control, safe handling of untrusted code and protection of client data.\n\nSupport the data teams. Build the tooling that task authors, reviewers and project leads use every day, and help produce fast-turnaround samples when a project needs them.\n\nSkills we are looking for:\nSoftware engineering\nStrong backend engineering in Python: clean, tested, maintainable code.\n\nDesigning and building APIs and the data models behind them.\n\nRelational databases (Postgres or similar): schema design, migrations, query performance.\n\nEnough frontend skill (TypeScript and React) to build and maintain internal tools.\n\nComfort joining a codebase someone else wrote, understanding it quickly and improving it without breaking it.\n\nLarge-scale system design\nDesigning distributed systems that run many long-running jobs at once.\n\nJob orchestration, workflow engines and queues: retries, idempotency, failure recovery.\n\nContainers and container orchestration (Docker, Kubernetes or similar), and at least one major cloud provider.\n\nObservability: logging, metrics, tracing and alerting.\n\nSecurity fundamentals: secrets management, isolation, access control.\n\nRL environments and sandbox infrastructure\nHands-on experience building RL environments for LLM agents: tool interfaces, stateful environments that can be seeded, reset and snapshotted, and reward computed from the final state or the agent's answer.\n\nRunning agent code in isolated sandboxes at scale, with sandbox platforms such as Daytona, E2B or Modal, or with your own isolation layer (gVisor, Firecracker microVMs or similar).\n\nBuilding and caching environment images so that thousands of sandboxes can start quickly and reproducibly.\n\nHigh-throughput rollout collection: many parallel episodes, timeouts, resource limits, and full logs and trajectories for every episode.\n\nFeeding rollouts and rewards into RL post-training pipelines.\n\nEvaluation\nHands-on experience building or running evaluation harnesses or benchmarks for LLMs or LLM agents.\n\nWriting verifiers, graders or reward functions, and knowing how they fail.\n\nUnderstanding of how frontier models are evaluated: pass rates, pass@k, headroom, discrimination, reward hacking, and what makes a task hard for a frontier model.\n\nWorking with LLM provider APIs and tracking model cost and usage.\n\nData annotation and human data\nExperience building annotation, labeling or human-data tooling.\n\nContributor and reviewer workflows, quality control and calibration.\n\nTurning a manual, ad-hoc process into a scaled, measured one.\n\nWays of working\nDaily, careful use of AI coding agents: you move fast with them and review their output with the same rigor as a colleague's.\n\nThrives in ambiguity and ships fast; works independently and takes initiative on a small team.\n\nClear written communication with both engineers and non-engineers.\n\nQualifications\n5+ years in software, data or ML engineering, with recent work in AI/ML data, model evaluation, annotation or developer tooling.\n\nA track record of running and maintaining production systems, not only building them.\n\nFluent English.\n\nNice to have\nContributions to open-source evaluation or RL frameworks.\n\nExperience building tools for a large distributed contributor workforce.","description_format":"text","description_chars":4797,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Advanced (C1)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Argentina","iso":"AR","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Bootcamps","AI Training Data & Annotation"],"lifecycle":[{"event":"open","at":"2026-11-13T01:28:33Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":63,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-13T02:58:04Z"},"pay":null,"html_url":"https://alion.io/job/anyone-ai-platform-engineer-rl-eval-data-100-remote","json_url":"https://alion.io/job/anyone-ai-platform-engineer-rl-eval-data-100-remote.json","meta":{"generated_at":"2026-11-13T02:58:04Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6299,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":9137},"rest":"https://alion.io/mcp/rest/get_company?id=9137"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fanyone-ai-platform-engineer-rl-eval-data-100-remote"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fanyone-ai-platform-engineer-rl-eval-data-100-remote"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fanyone-ai-platform-engineer-rl-eval-data-100-remote"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/anyone-ai-platform-engineer-rl-eval-data-100-remote\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fanyone-ai-platform-engineer-rl-eval-data-100-remote"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4212377}},{"tool":"search_jobs","arguments":{"company":"anyoneai.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4212377},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}