AI Research Engineer

Role: Reinforcement Learning & Post-Training Engineer

Role Overview

As a founding post-training specialist, you will own the end-to-end alignment and reasoning stack taking base pre-trained models through advanced alignment. You will design and execute novel post-training recipes spanning RLAIF, Constitutional AI, and dense process supervision (PRMs) to unlock frontier reasoning and domain alignment directly on raw base weights.

Key Responsibilities

• Base Model Post-Training: Design and scale full-spectrum post-training workflows on base foundation models using algorithms like GRPO, PPO, DPO, and iterative rejection sampling.
• RLAIF & Constitutional AI: Architect automated preference-data synthesis, iterative multi-turn critique loops, and rubric-driven constitutional refinement pipelines to eliminate human annotation bottlenecks.
• Process Reward Modeling (PRMs): Construct and train step-level PRMs to evaluate granular reasoning steps, intermediate chain-of-thought derivations, and dense domain verification tasks.
• Verifiable Reward & Environment Design: Implement deterministic verifiers, execution sandboxes for code and math, and hybrid reward functions combining outcome checks with dense step feedback.
• Alignment Infrastructure: Optimize distributed RL training and rollout loops across accelerator clusters, maximizing rollout throughput, memory management, and inference-engine integration.

Candidate Requirements

• 3+ Years Hands-On RL / Fine-Tuning Experience: Demonstrated track record executing post-training on LLM base models (not generic software engineering or high-level API wrapper development).
• Algorithmic Depth: Deep theoretical and practical command of modern policy gradient methods, credit assignment, value function estimation, and reward-shaping dynamics.
• Dense Reward & Alignment Mastery: Concrete experience designing reward models (ORMs/PRMs), preference optimization objectives, or constitutional self-critique mechanisms.
• High-Throughput RL Stack: Strong fluency with distributed training and rollout architectures (such as Ray, vLLM, DeepSpeed, or custom JAX/PyTorch accelerator pipelines).
• Startup Velocity & Ownership: Ability to independently formulate research hypotheses, diagnose reward hacking or mode collapse, and deploy robust training runs under fast production cycles.

What We Offer

• Direct Architecture Ownership: Full technical authority over the post-training, alignment, and reasoning methodology of foundation models.
• High-Density Compute: Dedicated accelerator clusters to validate novel RL formulations and train production models end-to-end.