{"id":2341571,"url":"https://alion.io/job/goaly-founding-ai-researcher-rl","title":"Founding Senior AI Researcher, RL","company":{"id":4416231,"name":"Goaly","domain":"goaly.ai","url":"https://alion.io/company/goaly-2","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Palo Alto, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":171000,"max_usd":330000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1332},"experience_years_min":null,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"DeepSpeed","optional":false},{"name":"Fine-tuning","optional":false},{"name":"FSDP","optional":false},{"name":"Function Calling","optional":false},{"name":"JAX","optional":false},{"name":"Megatron-LM","optional":false},{"name":"Post-training","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Ray","optional":false},{"name":"Reinforcement Learning","optional":false},{"name":"RLHF","optional":false}],"status":"live","first_seen_at":"2026-08-09T19:55:51Z","employer_posted_date":"2026-08-09","last_verified_at":"2026-10-30T23:28:19Z","board_verified":true,"closed_at":null,"days_open":82,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":82},"description":"About us\nWe’re building toward a world where every company can become its own AI lab.\nGoaly is a stealth AI startup founded by ex-Meta MSL engineers and researchers. Our mission is to dramatically lower the cost, time, and talent barriers to building proprietary AI - and make each generation of models faster and cheaper to build than the last.\nBacked by leading AI investors and endorsed by frontier AI researchers and builders, we’re looking for exceptional new grads who want to work on hard, foundational AI systems problems with outsized ownership from day one.\nAbout the role\nYou will own the experimental loop that turns a capable base model into a useful agent. You will design tasks and environments, prepare training and evaluation data, run reinforcement-learning and related post-training experiments, diagnose model behavior, and convert results into better recipes and production models.\nThis is a research-engineering role. The best candidates are equally comfortable forming hypotheses, writing high-quality code, operating training pipelines, and investigating why a model or metric moved. You will work closely with RL systems, training, inference, product, and domain experts; when infrastructure slows the science, you will help improve the infrastructure rather than treating it as someone else's problem.\nWhat you'll do\nDesign and run post-training experiments for agentic capabilities, including tool use, coding, reasoning, planning, long-horizon task completion, and recovery from failure.\n\nPrepare high-quality training and evaluation data: define task distributions, curate and filter examples, control contamination, balance difficulty, and build reproducible data-generation pipelines.\n\nBuild realistic RL environments and task harnesses with clear interfaces, reliable resets, isolated execution, useful telemetry, and reward signals that are hard to game.\n\nDevelop evaluations that measure both capability and reliability. Create regression suites, behavioral slices, error taxonomies, and dashboards that connect aggregate metrics to concrete model failures.\n\nIterate on training recipes, including supervised warm starts, sampling strategies, reward design, verifiers, curricula, optimization choices, and reinforcement fine-tuning methods.\n\nAnalyze trajectories and model behavior to find reward hacking, shortcut learning, mode collapse, distribution gaps, and other failure modes; turn those findings into targeted experiments.\n\nImprove the research workflow through better experiment configuration, rollout inspection, reproducibility, checkpoint evaluation, and automated comparison of runs.\n\nPartner with systems engineers to debug cross-layer problems in rollout inference, environment execution, distributed training, and data movement.\n\nTranslate successful research ideas into stable, repeatable pipelines and help set the team's longer-term post-training roadmap.\n\nYou may be a good fit if you have\nStrong Python and software-engineering skills, including the ability to turn ambiguous research ideas into reliable experimental systems.\n\nHands-on experience training, fine-tuning, or evaluating modern language models, or an exceptional record in a closely related ML research area.\n\nSolid understanding of deep learning and optimization, plus enough reinforcement-learning intuition to reason about policies, rewards, sampling, credit assignment, and evaluation bias.\n\nExcellent experimental judgment: you define controls, inspect data, validate metrics, keep results reproducible, and distinguish a real improvement from noise or leakage.\n\nAbility to debug across model behavior, data, code, and distributed infrastructure without losing sight of the user-facing capability being improved.\n\nClear written and verbal communication and a track record of productive collaboration across research and engineering.\n\nStrong pluses\nExperience with RLHF, reinforcement fine-tuning, preference optimization, reward or verifier modeling, or large-scale online sampling.\n\nExperience building agent environments, secure sandboxes, coding benchmarks, tool-use tasks, or long-horizon evaluations.\n\nFamiliarity with PyTorch or JAX and distributed ML systems; experience with frameworks such as FSDP, Megatron, DeepSpeed, Ray, VeRL, or related stacks.\n\nA record of influential research, open-source contributions, technically ambitious independent projects, or production model launches.\n\nHow we work\nMission first. We choose work for its impact on the mission and take responsibility for the outcome, not just our assigned tasks.\n\nHigh agency. We identify what is missing, form a plan, and move without waiting for perfect clarity.\n\nSpeed with rigor. We ship, measure, and iterate quickly while protecting correctness, safety, and reliability.\n\nFlexible scope. We cross team and technical boundaries when that is the fastest way to solve the real problem.\n\nLow ego, high standards. We give direct feedback, change our minds when the evidence changes, and help the whole team win.\n\nContinuous learning. The stack changes quickly; we are willing to learn unfamiliar systems, methods, and domains as the work demands.\n\nLocation, visa sponsorship & benefits\nHybrid in Palo Alto: 4+ days/week in office.\n\nVisa sponsorship: H-1B and OPT/CPT support available, with immigration counsel.\n\nMeals & perks: Complimentary lunch, dinner, snacks, and drinks.\n\nA note on qualifications. We value exceptional ability over perfect keyword matches. If the work excites you and you can show strong technical ability, learning speed, or ownership, we encourage you to apply.\nEqual opportunity\nWe are an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, genetic information, or any other characteristic protected by applicable law. We provide reasonable accommodations for candidates who need them during the hiring process.","description_format":"text","description_chars":5993,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-12T11:26:53Z"}],"visa":[],"liveness":{"score":14,"band":"cold","label":"Long shot","p_open":1,"p_active":0.511,"p_room":0.28,"age_days":81,"expected_fill_days":28,"reasons":["conf:3","win:tail","crowd:"],"computed_at":"2026-10-30T05:48:23Z"},"pay":null,"html_url":"https://alion.io/job/goaly-founding-ai-researcher-rl","json_url":"https://alion.io/job/goaly-founding-ai-researcher-rl.json","meta":{"generated_at":"2026-10-30T23:32:32Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14917,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4416231},"rest":"https://alion.io/mcp/rest/get_company?id=4416231"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fgoaly-founding-ai-researcher-rl"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fgoaly-founding-ai-researcher-rl"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fgoaly-founding-ai-researcher-rl"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/goaly-founding-ai-researcher-rl\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fgoaly-founding-ai-researcher-rl"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":2341571}},{"tool":"search_jobs","arguments":{"company":"goaly.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":2341571},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}