{"id":2730776,"url":"https://alion.io/job/replay-rl-environment-engineer","title":"RL Environment Engineer","company":{"id":28307,"name":"Replay","domain":"replay.ai","url":"https://alion.io/company/replay","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":100,"open_postings":13,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Industrial Engineering","role_family":"Industrial Engineering","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":220000,"max":320000,"currency":"USD","period":"year","gross":null,"usd_annual":320000},"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false}],"status":"live","first_seen_at":"2026-10-16T15:34:02Z","employer_posted_date":"2026-10-16","last_verified_at":"2026-10-18T10:56:21Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"About Replay\nAt its core, Replay was founded to help founders. We started by supporting startups through shutting down, but we've since expanded into unlocking a new revenue stream for all types of businesses.\nIn 2025, we earned a secret: the data every company generates on a daily basis (collaboration, communication, building) is some of the most valuable training data in the world. Public and synthetic can only get frontier models so far, so the next generation of model progression depends on real, proprietary data grounded in how actual businesses operate. We're a primary source of it, partnering directly with the frontier AI labs building what's next.\nWhy join Replay now:\nWe've scaled from $0 to a multi-eight figures run rate in a matter of months\n\nWe've raised from top-tier investors (Floodgate, Afore, Ludlow, Hustle Fund, etc.)\n\nWe're small enough that you'll carry outsized responsibility and grow as fast as the company does\n\nYou'll partner and build for the fastest and most important companies in the world\n\nYou'll be a part of building a massive, category-defining business from the ground floor\n\nThe Role\nReplay is hiring an RL Environment Engineer who has already built production-grade RL\nenvironments and wants to point that craft at real enterprise data to shape our datasets into the training environments frontier AI labs use to make their models better. You'll turn real business workflows and real-world data into realistic, verifiable environments, with the tasks, tools, and graders to match, and work directly with lab researchers to understand which capabilities they want to improve. This is a hands-on engineering role with a high degree of ownership.\nWhat You'll Do\nDesign and build production-grade RL environments grounded in real enterprise workflows, from task spec through to a stable, versioned release\n\nWrite reward functions and programmatic verifiers that score outcomes reliably, and harden them against reward hacking and shortcut solutions\n\nBuild high-fidelity evaluation environments with seeded failure modes that expose subtle regressions, and reliable model and agent harnesses with bounded behaviour and explicit output verification\n\nTurn Replay's de-identified data into realistic state, tools, files and context for an agent, and keep environments reproducible, observable and safe to roll out, with clear evidence of what changed between versions\n\nWork directly with frontier lab researchers to understand the capability gaps they want to close, and design task suites that expose and train against them\n\nMeasure task difficulty and solvability by running frontier models against environments, then tune them until they give a usable training signal\n\nShip quickly, and help set the standards and patterns for how Replay builds tasks and environments\n\nRequired aptitude\n3-5+ years of ML / software engineering experience shipping production systems\n\nPersonally built production-grade RL environments that were used in real training or evaluation, not only prototypes or research demos\n\nAbility to turn ambiguous goals from researchers into well-scoped, working systems\n\nA clear grasp of environment design tradeoffs: task specification, state and tool design, determinism, difficulty calibration and solvability\n\nBuilt evaluation or agentic harnesses, with comfort in evaluation rigor: precision, recall, calibration, imperfect labels and distribution shift\n\nA high-ownership, action-oriented mindset: you take problems from idea to shipped.\n\nStartup experience, a taste for broad ownership and the ability to do well when requirements are evolving\n\nClear written and verbal communication with researchers, engineers, and non-technical partners\n\nBonus\nBackground at or working with a frontier AI lab, or in research-adjacent engineering\n\nExperience in forward-deployed or customer-facing engineering roles\n\nExperience with sensitive enterprise data or other high-trust production systems\n\nPreviously a founder or early employee at a startup\n\nCompensation & Benefits\n$220-320K base salary\n\nMeaningful equity\n\n100% covered medical, dental, and vision\n\nUnlimited PTO\n\nFree gym + workout class memberships (via Wellhub)\n\n$500 desk allowance\n\nUp to $15,000 relocation bonus where applicable\n\nHow We Hire\nIntro Chat (20 min): mutual fit and interests\n\nTechnical Screen (45 min): technical discussion & systems design challenge\n\nTake-home project (4 hours): work through a technical take-home asynchronously with our team\n\nOnsite (~3 hrs): meet the team, have snacks\n\nReferences -> Offer","description_format":"text","description_chars":4538,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Unlimited PTO"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":true,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-16T17:55:20Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":21,"reasons":["conf:3","win:early"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":320000,"is_top_pay":true},"html_url":"https://alion.io/job/replay-rl-environment-engineer","json_url":"https://alion.io/job/replay-rl-environment-engineer.json","meta":{"generated_at":"2026-10-18T11:44:37Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":17470,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":28307},"rest":"https://alion.io/mcp/rest/get_company?id=28307"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Freplay-rl-environment-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Freplay-rl-environment-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Freplay-rl-environment-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/replay-rl-environment-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Freplay-rl-environment-engineer"}]}