{"id":4045175,"url":"https://alion.io/job/turing-research-engineering-manager-stem-2","title":"Research Engineering Manager, STEM","company":{"id":13199,"name":"Turing","domain":"turing.com","url":"https://alion.io/company/turing","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":true,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":88,"open_postings":8,"ghost_share":0,"stale_share":0.5,"repost_share":0,"time_to_fill_p50_days":27,"computed_at":"2026-11-10T06:52:35Z"}},"role":"Leadership","role_family":"Leadership","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States","United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":260000,"max":350000,"currency":"USD","period":"year","gross":null,"usd_annual":350000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Anthropic","optional":false},{"name":"AWS","optional":false},{"name":"Claude Code","optional":false},{"name":"Copilot","optional":false},{"name":"Cursor","optional":false},{"name":"DPO","optional":false},{"name":"Fine-tuning","optional":false},{"name":"GCP","optional":false},{"name":"GRPO","optional":false},{"name":"JAX","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"Machine Learning","optional":false},{"name":"OpenAI","optional":false},{"name":"Post-training","optional":false},{"name":"PPO","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Ray","optional":false},{"name":"Reinforcement Learning","optional":false},{"name":"Reward Modeling","optional":false},{"name":"SFT","optional":false},{"name":"Spark","optional":false},{"name":"Synthetic Data","optional":false},{"name":"Computer Use","optional":true},{"name":"Django","optional":true},{"name":"Docker","optional":true},{"name":"FastAPI","optional":true},{"name":"Function Calling","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-11-10T21:34:53Z","employer_posted_date":"2026-11-10","last_verified_at":"2026-11-10T23:35:58Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Turing\nTuring’s mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality datasets, reinforcement learning environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work, and advanced STEM reasoning. In software engineering, Turing is the largest and longest-running data provider in the category. Turing also works with Fortune 500 enterprises across financial services, life sciences, healthcare, retail, automotive, and CPG to build and deploy end-to-end agentic AI systems inside mission-critical workflows. By operating on both sides, Turing closes the loop between frontier research and enterprise deployment, turning real-world deployment signals into better data, evaluations, and more capable models. Learn more at www.turing.com. \nThe Role\nTuring builds large-scale datasets and reinforcement learning (RL) environments that power post-training for the world's leading AI labs and enterprises.\nThe STEM Horizontal team produces the high-signal coding and STEM data frontier labs train on. We're looking for a Research Engineering Manager to lead the research engineering behind its next layer: synthetic data that measurably improves models, and new benchmarks that measure what today's evals miss.\nYou'll lead a team of research engineers, work side by side with research scientists, and stay close enough to the code to review an eval harness line by line or prototype a generator yourself when the team needs it. You'll also build the team: hiring research engineers is a core part of this role, not a side task. Ideally you've been on the other side, at a frontier lab, and know what makes a lab trust a dataset or a benchmark result.\nSynthetic data that earns its place. Generation, verification, and filtering pipelines where every sample is checked, and where we can show which properties of the data drive downstream gains, not just how much of it we made.\nBenchmarks that stay meaningful. New evaluations for capabilities current benchmarks miss, built with calibrated difficulty, contamination controls, and statistics strong enough that a lab can make a decision on the result.\nQuality failures here are quiet. A subtle bug in a verifier doesn't crash anything; it ships thousands of wrong labels into someone's training run and costs weeks. If you want to build the team and the systems that catch that early, this is the seat.\nWhat You'll Do\n1. Build and Lead the Team\nBuild the team: define the profiles you need, run hiring, and grow research engineers selected for research taste as much as engineering rigor.\nRun the team's operating rhythm: project selection, planning, experiment reviews, design docs, and clear ownership.\nCoach engineers on experimental design, code quality, and presenting results; give direct, regular feedback and run fair performance cycles.\nDefine the standards the team works to: eval methodology, data quality bars, and reproducibility - every dataset and result can be regenerated from a commit, a config, and a seed.\n2. Partner with Research Scientists\nTurn hypotheses into experiment plans together: what we're testing, the baseline, the ablations, and the result that would change our minds.\nSet the agenda with research scientists. You're expected to bring your own hypotheses, not only implement theirs.\nTake research prototypes to production scale without losing the scientific intent.\n3. Build Synthetic Data Systems at Scale\nOwn synthetic data pipelines that generate, verify, filter, deduplicate, and version data, combining programmatic generators, LLM-based generation, automated verifiers, and targeted expert review.\nJudge data by its effect on models: ablations and fine-tuning or RL experiments that show which attributes (difficulty, diversity, correctness, coverage) drive gains.\nBuild quality systems that hold up at volume: gold sets, LLM-judge calibration against expert labels, sampling audits, and agreement metrics.\n4. Create New Benchmarks and Evaluations\nFind where frontier models fail and where existing benchmarks have saturated, and design evaluations that measure what's missing.\nOwn benchmark methodology end to end: task taxonomy, difficulty calibration, graders and verifiers, contamination controls, held-out splits, and confidence intervals.\nShip eval harnesses, including agentic and sandboxed-execution evals, that are deterministic, reproducible, and trusted by internal teams and partner labs.\nMake the call on whether a result holds up: partner labs and internal teams act on your sign-off.\nPublish benchmarks, datasets, and findings with our research scientists at venues such as NeurIPS, ICML, and ICLR.\n5. Stay Hands-On and Work with Frontier Labs\nWrite code every week on the hardest, highest-leverage parts: core verifier logic, eval statistics, the pipeline component everything else depends on. Expect a third or more of your time on direct technical work.\nBe the person the team brings its hardest debugging and methodology questions to: why a judge disagrees with experts, why an eval number moved, whether a gain is real or noise.\nAct as a technical counterpart to researchers at frontier AI labs: scope requests, set acceptance criteria, and explain results and trade-offs plainly.\nPartner with Strategic Project Leads, delivery, and engineering teams so research advances land in client work and in the platforms the team builds.\nSample Projects\nIdentify a capability gap, design and ship a benchmark for it, and see it adopted by partner labs.\nStand up a synthetic data pipeline for long-horizon coding tasks with execution-based verifiers, and run the ablations that show which task properties drive RL gains.\nCalibrate an LLM-judge grading system against expert labels, map where it fails, and decide where humans stay in the loop.\nDesign the experiment that tells a partner lab whether a two-point gain on their eval is real.\nDecide which of three competing synthetic data approaches the team should bet on, and design the experiments that settle it.\nTech Stack\nResearch: Python · PyTorch or JAX · SFT · DPO · PPO / GRPO · RL with verifiable rewards\nEvals & data: LLM-as-judge · programmatic verifiers · sandboxed execution · gold sets · contamination checks\n Platform: Python services (Django / FastAPI) · PostgreSQL · Docker · Terraform · AWS or GCP\nWhat We're Looking For\nExperience: 8+ years of hands-on ML or research engineering, at least 5 in industry, including 3+ years directly managing research engineers, ML engineers, or researchers (hiring and performance management included).\nSynthetic data at scale: you've owned synthetic or curated data pipelines in production whose output drove training decisions, and can show how you measured their quality and downstream impact.\nEvaluation rigor: you've designed and shipped LLM evals or benchmarks that others used to make model decisions, and understand contamination, saturation, judge bias, inter-annotator agreement, variance, and confidence intervals.\nExperimental judgment: you plan ablations up front, choose baselines honestly, and can tell a real effect from noise.\n Technical depth: strong Python; production experience with PyTorch or JAX; working knowledge of the post-training stack (SFT, DPO, PPO/GRPO, RL with verifiable rewards).\nTechnical direction: a track record of setting direction for a team, not only executing a roadmap handed to you.\n Scale: distributed data processing and large evaluation or training jobs (e.g., Ray, Spark, Kubernetes) on AWS or GCP.\nCommunication: clear written communication for scientists and non-specialists alike; comfortable presenting results to researchers at partner labs.\n AI-forward: daily use of LLM coding tools (Claude Code, Cursor, Copilot) as part of how you ship, with the judgment to review their output critically. This is a must-have.\nEducation: PhD or Master's degree in AI, machine learning, computer science, statistics, or a closely related field; PhD preferred. Exceptional equivalent research experience will also be considered. We weigh industry outcomes most heavily.\nStrongly Preferred\n Frontier AI lab experience: post-training data, evals, or reward modeling at a frontier lab (e.g., OpenAI, Anthropic, Google DeepMind, Meta, xAI) or a top industry research group.\nBuilt or contributed to a public benchmark or dataset the community uses.\nNice to Have\nFirst-author papers at NeurIPS, ICML, ICLR, ACL, EMNLP, or similar.\nRL environment and verifier design for agentic tasks: coding agents, tool use, computer use, long-horizon workflows.\nData valuation or attribution: measuring what each slice of data contributes to a model.\nDepth in a STEM domain such as math, physics, chemistry, or biology (not required).\nExperience managing tech leads or managers, or running several concurrent programs.\nDirecting large expert networks through specs, rubrics, and fast feedback loops.\nA note from our CTO, Ece Kamar\nSome of the most important questions in AI can't be answered from inside a single lab: how to evaluate frontier models, how data and RL truly drive capability, and what happens when AI meets the real world. At Turing, we work directly with frontier labs, the academic community, and enterprises deploying AI at scale. That creates a feedback loop where deployment shapes our research and our research shapes the field, and we publish our findings, datasets, and benchmarks openly. Join our talented team at Turing to push the frontier of AI with rigorous science that matters.\nWhy Turing\nWork directly with leading AI labs and enterprises at the frontier of post-training, evaluation, and synthetic data.\nBuild the datasets and benchmarks that improve and measure the capabilities of advanced AI systems.\nShape how frontier labs measure progress on coding and STEM reasoning.\nOperate with high autonomy, rapid iteration, and meaningful commercial impact.\nCollaborate with exceptional colleagues from organizations including Google, Meta, Amazon, and other leading technology companies.\nContribute to research that may be shared through technical publications and leading conferences such as ICLR, ICML, and NeurIPS.\nCompensation\n$260,000 to $350,000 + Equity\nDon't meet every single requirement?\nStudies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. Turing is proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, disability, protected veteran status, or any other legally protected characteristics. At Turing we are dedicated to building a diverse, inclusive, and authentic workplace and celebrate authenticity, so if you're excited about this role but your past experience doesn't align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.\nFor applicants from the European Union, please review Turing's GDPR notice here.\nValues\nWe are client first: We put our clients at the center of everything we do, because their success is the ultimate measure of our value.\nWe work at Start-Up Speed: We move fast, stay agile and favor action because momentum is the foundation of perfection\nWe are AI forward: We help our clients build the future of Al and implement it in our own roles and workflow to amplify productivity.\nAdvantages of joining Turing\nWork at the frontier of AI, helping the world’s leading AI labs improve their most advanced models by building expert datasets, RL environments, and first-of-a-kind benchmarks.\nContribute to leading-edge AI research and showcase your work at top conferences such as ICLR, ICML, and NeurIPS.\nBring frontier AI innovation to the enterprise, applying lessons learned from leading AI labs to solve real-world busin...","description_format":"text","description_chars":12956,"description_truncated":true,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Recruiting & Staffing","Freelance & Talent Marketplaces","AI Training Data & Annotation"],"lifecycle":[{"event":"open","at":"2026-11-10T23:35:58Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":27,"reasons":["conf:4","win:early"],"computed_at":"2026-11-11T03:42:38Z"},"pay":{"stated_usd_annual":350000,"is_top_pay":true},"html_url":"https://alion.io/job/turing-research-engineering-manager-stem-2","json_url":"https://alion.io/job/turing-research-engineering-manager-stem-2.json","meta":{"generated_at":"2026-11-11T03:42:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3257,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":13199},"rest":"https://alion.io/mcp/rest/get_company?id=13199"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fturing-research-engineering-manager-stem-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fturing-research-engineering-manager-stem-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fturing-research-engineering-manager-stem-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/turing-research-engineering-manager-stem-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fturing-research-engineering-manager-stem-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4045175}},{"tool":"search_jobs","arguments":{"company":"turing.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4045175},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}