{"id":2648556,"url":"https://alion.io/job/besimple-ai-rl-environment-engineer-full-time-part-time-or-contract","title":"RL Environment Engineer (Full-time, Part-time, or Contract)","company":{"id":94308,"name":"Besimple AI","domain":"besimple.ai","url":"https://alion.io/company/besimple-ai","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Work at a Startup","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Mateo, United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":160000,"max":360000,"currency":"USD","period":"year","gross":null,"usd_annual":360000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Reinforcement Learning","optional":false},{"name":"Reinforcement Learning","optional":false},{"name":"Computer Use","optional":true},{"name":"Reward Modeling","optional":true},{"name":"Voice Agents","optional":true}],"status":"live","first_seen_at":"2026-10-15T20:53:37Z","employer_posted_date":"2026-10-15","last_verified_at":"2026-11-05T02:53:47Z","board_verified":true,"closed_at":null,"days_open":20,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":20},"description":"Besimple AI is building datasets, benchmarks, and training environments that help voice models understand people, interact naturally, and complete real tasks.\nWe’re looking for an engineer with experience building reinforcement learning environments to help us create the next generation of conversational-agent training systems. You’ll turn real-world interactions into tasks that agents can practice, receive feedback on, and learn to complete reliably.\nExperience building RL environments is the core requirement. Speech experience is a plus. We welcome backgrounds in language agents, coding, computer use, robotics, games, simulation, and other RL domains.\nWhat you’ll work on\nBuild training environments. Define tasks, observations, actions, state transitions, rewards, and termination conditions. Create environments where agents ask questions, use tools, recover from errors, and reach verifiable outcomes.\n\nDesign rewards and verifiers. Implement checks for task completion and intermediate progress. Find reward-hacking opportunities, ambiguous success criteria, and shortcuts that let agents pass without solving the task.\n\nTurn human interactions into tasks. Work with recorded conversations and human demonstrations to construct scenarios, starting states, alternative continuations, and realistic failure cases.\n\nBuild interactive simulators. Develop user and tool simulators that respond to an agent’s actions, maintain consistent state, and support varied, repeatable interactions.\n\nMake environments reliable at scale. Build rollout interfaces, parallel execution, logging, replay, and debugging tools. Make failures reproducible and environments easy to connect to training pipelines.\n\nValidate what agents learn. Work with researchers to run baseline policies and training experiments, measure learning progress, and test whether improvements transfer to unfamiliar scenarios.\n\nOur initial focus is voice agents: systems that need to listen, speak, call tools, handle interruptions, and finish tasks while interacting with people. You’ll help determine how these behaviors should be represented and measured in an RL environment.\nWhat we’re looking for\nHands-on experience building or substantially extending environments used to train or evaluate RL agents.\nStrong engineering skills and experience writing tested, maintainable software.\nExperience defining task interfaces, managing environment state, implementing rewards, and debugging agent-environment interactions.\nThe ability to investigate why an agent fails-or succeeds for the wrong reason-and improve the environment accordingly.\nClear technical communication and comfort taking an open-ended problem from an initial prototype to a reliable system.\nWe welcome recent graduates with substantial academic or open-source projects, as well as engineers with industry experience. A research publication is not required; working environments, code, and thoughtful experimental results are useful evidence.\nEspecially relevant experience\nSpeech, audio, conversational agents, or full-duplex interaction.\nTool-use, coding, browser, or computer-use environments.\nUser simulators, executable rewards, reward models, or preference data.\nGymnasium-style interfaces, distributed rollouts, or integration with RL training frameworks.\nUsing human demonstrations or real-world interaction data to construct training tasks.\nReproducible evaluation, deterministic replay, and testing for reward hacking.\nWhy this role\nYou’ll own a core part of how our models learn: the tasks they encounter, the feedback they receive, and the conditions under which we measure progress.\nThis is an opportunity to shape an early engineering and research direction, build environments grounded in real human interactions, and see how your work changes the behavior of conversational agents.","description_format":"text","description_chars":3835,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Machine Learning","AI Training Data & Annotation"],"lifecycle":[{"event":"open","at":"2026-10-15T20:53:37Z"}],"visa":[],"liveness":{"score":30,"band":"fade","label":"Fading","p_open":1,"p_active":0.541,"p_room":0.55,"age_days":20,"expected_fill_days":15,"reasons":["conf:3","win:tail"],"computed_at":"2026-11-05T05:54:30Z"},"pay":{"stated_usd_annual":360000,"is_top_pay":true},"html_url":"https://alion.io/job/besimple-ai-rl-environment-engineer-full-time-part-time-or-contract","json_url":"https://alion.io/job/besimple-ai-rl-environment-engineer-full-time-part-time-or-contract.json","meta":{"generated_at":"2026-11-05T07:25:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9490,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-06T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":94308},"rest":"https://alion.io/mcp/rest/get_company?id=94308"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbesimple-ai-rl-environment-engineer-full-time-part-time-or-contract"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbesimple-ai-rl-environment-engineer-full-time-part-time-or-contract"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbesimple-ai-rl-environment-engineer-full-time-part-time-or-contract"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/besimple-ai-rl-environment-engineer-full-time-part-time-or-contract\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbesimple-ai-rl-environment-engineer-full-time-part-time-or-contract"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":2648556}},{"tool":"search_jobs","arguments":{"company":"besimple.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":2648556},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}