{"id":3097212,"url":"https://alion.io/job/recho-senior-llm-data-engineer-training-data-evaluation","title":"Senior LLM Data Engineer (Training Data & Evaluation)","company":{"id":2675564,"name":"Recho","domain":"recho-ai.com","url":"https://alion.io/company/recho-ai","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"HERP","truth_index":{"grade":"A","score":85,"open_postings":13,"ghost_share":0,"stale_share":0.615,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-04T06:34:25Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chiyoda, Japan"],"countries":["JP"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":10000000,"max":20000000,"currency":"JPY","period":"year","gross":null,"usd_annual":128560},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":true,"relocation_package":false,"has_equity":true,"technologies":[{"name":"AI Agents","optional":false},{"name":"LLM","optional":false},{"name":"Post-training","optional":false},{"name":"SFT","optional":false},{"name":"Synthetic Data","optional":false},{"name":"Claude Code","optional":true},{"name":"ETL/ELT","optional":true},{"name":"OpenAI Codex","optional":true},{"name":"Polars","optional":true},{"name":"Python","optional":true},{"name":"Slack","optional":true},{"name":"Spark","optional":true},{"name":"SQL","optional":true},{"name":"Transformers","optional":true},{"name":"TRL","optional":true}],"status":"live","first_seen_at":"2026-10-22T15:50:40Z","employer_posted_date":"2026-10-22","last_verified_at":"2026-11-04T08:52:56Z","board_verified":true,"closed_at":null,"days_open":12,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":12},"description":"Senior LLM Data Engineer (Training Data & Evaluation)\nDescription\n## In short\nYou'll design and build the \"curriculum\" that makes Recho's AI smarter: the training and evaluation data for our LLMs, built end to end from real-world business data. Starting from call logs and our clients' business systems, you'll decide what the model should learn, build the data, and put systems in place to guarantee its quality. Today, data building is ad hoc and varies from project to project. Your job is to turn it into a repeatable, standardized workflow.\n- **Team language:** English. Japanese at around JLPT N2 level is also required, since you'll work directly with Japanese call logs and business data.\n- **Salary:** ¥10M-¥20M per year, plus stock options\n- **Location:** Tokyo (Hanzomon), hybrid. Candidates based outside Japan are welcome. We offer visa sponsorship and relocation support, and we're open to discussing fully remote arrangements.\n## You might be a fit if you are…\n- Someone who has built post-training data (SFT, preference, synthetic data) at a foundation model company\n- Someone at a customer service or conversational AI company who has designed training data from real business logs and systems\n- A data engineer or ML engineer who has designed and implemented data integrations with business systems yourself\n## About the role\nAt Recho, we believe the ceiling on model performance is set by the quality of rewards and data. Your core mission is to design and build LLM training and evaluation data end to end, starting from real-world data such as call logs, business systems, FAQs and manuals.\nRight now, building data for each project depends on individual effort and isn't reproducible. You'll turn the whole process into a standardized system: cleansing, anonymizing and structuring raw data; building SFT and RL data (synthetic data generation, difficulty control, deduplication, mixture tuning); and maintaining evaluation sets and benchmarks.\nThis is the foundation for scaling to the next 20-30 client projects. You'll also design and run the \"data flywheel\" that turns error analysis of training results into better data. Down the line, this role could grow into leading our data and evaluation team.\n## What this role is *not*\n- Not an on-call or SRE role. SLA management and infrastructure maintenance for online services are not the focus.\n- GPU cluster operations and general SRE/DevOps are handled by a separate team.\n- The final design of training algorithms and rewards (SFT/RL methods, loss functions) belongs to our LLM Training Engineer role. You'll partner with them on data and evaluation sets.\n- Defining client requirements and what a \"correct response\" looks like belongs to our Data PM role. You'll turn those definitions into real data.\n## What you'll do\n### 1. Investigate, design and prepare real-world data\n- Investigate each project's business systems and data, and design training and evaluation data end to end\n- Cleanse, anonymize and structure real-world data such as call logs\n### 2. Build training and evaluation data\n- Build SFT and RL data: synthetic data generation, difficulty control, deduplication and mixture tuning\n- Implement reward functions and evaluation sets, and maintain benchmarks for each project\n### 3. Run the data flywheel\n- Design and run the loop that turns error analysis of training results into data improvements\n- Build data pipelines with reproducibility and versioning built in\nWe're happy to go into more detail during the intro call and interviews.\n## Why this role\n- **Set the ceiling on model performance.** That ceiling is set by the quality of rewards and data. You'll decide what the model should learn and what belongs in the prompt, and build the foundation of its intelligence yourself.\n- **Turn ad hoc work into a system, from zero.** You'll rebuild fragmented, project-by-project data work into a repeatable data flywheel, and design the foundation for scaling to 20-30 projects.\n- **Work at the front line of real data and real products.** You'll work with actual call logs and business systems and turn real customer-service problems into data. This isn't clean research data; it's the data that runs production.\n## Tech stack\n- **Languages:** Python (pandas, Polars, Spark, etc.)\n- **Data infrastructure:** ETL, versioning, reproducibility, SQL, API and database integrations\n- **Synthetic data & evaluation:** Synthetic data generation via LLM APIs, LLM-as-a-Judge\n- **Training framework inputs:** TRL, verl (formatting SFT and RL data)\n## Our product\nWe build the Recho AI Voice Platform, which delivers voice conversations natural enough to be hard to tell apart from a human. We also deploy and operate Voice AI Agents for large enterprises.\nOur edge is a platform for building and improving high-quality agents quickly. It captures industry know-how and turns user feedback into a fast, continuous improvement loop. Our agents now handle complex, large-scale contact center operations in finance, manufacturing and the public sector. In some deployments, they've resolved every call without handing off to a human agent.\n## Hiring process\nIntro call → Case assignment & first interview → Paid work trial* → Final interview → Offer meeting\n*The work trial is 1-2 consecutive days at our Tokyo office, working on real tasks alongside the team, and it's paid. It's a chance for both sides to check fit and get a feel for the work.\n- **If you're based outside Japan,** we'll agree on the format together. We won't ask you to travel to Japan just for this step.\n- If your schedule or your current employer's side-work policy makes the trial difficult, just let us know.\n- We may also ask for references.\n## About Recho\nRecho develops foundation models for customer-support AI agents and also deploys them for clients, all within one organization. Our core strength is voice AI technology we built entirely in-house, which resolves the industry's long-standing trade-off between quality and cost.\nWe've closed a Series A of approximately ¥700M and are rapidly rolling out to demanding production environments at major companies such as SBI Shinsei Bank and KDDI.\n## Learn more\n- [Corporate website](https://recho-ai.com/)\n- [Team interviews (note, in Japanese)](https://note.com/recho_ai)\n- [Company deck](https://recruit.recho-ai.com/)\n- [Case study: Partnership with KDDI and Altius Link (Japanese)](https://prtimes.jp/main/html/rd/p/000000021.000159800.html)\n- [Case study: SBI Shinsei Bank (Japanese)](https://mainichi.jp/articles/20260130/k00/00m/020/275000c)\n- [2-minute voice demo](https://recruit.recho-ai.com/#2f276fb799f480d5bba7d5784d6ad31e) - give it a listen!\nRequirements\n## In short\nYou'll design and build the \"curriculum\" that makes Recho's AI smarter: the training and evaluation data for our LLMs, built end to end from real-world business data. Starting from call logs and our clients' business systems, you'll decide what the model should learn, build the data, and put systems in place to guarantee its quality. Today, data building is ad hoc and varies from project to project. Your job is to turn it into a repeatable, standardized workflow.\n- **Team language:** English. Japanese at around JLPT N2 level is also required, since you'll work directly with Japanese call logs and business data.\n- **Salary:** ¥10M-¥20M per year, plus stock options\n- **Location:** Tokyo (Hanzomon), hybrid. Candidates based outside Japan are welcome. We offer visa sponsorship and relocation support, and we're open to discussing fully remote arrangements.\n## You might be a fit if you are…\n- Someone who has built post-training data (SFT, preference, synthetic data) at a foundation model company\n- Someone at a customer service or conversational AI company who has designed training data from real business logs and systems\n- A data engineer or ML engineer who has designed and implemented data integrations with business systems yourself\n## About the role\nAt Recho, we believe the ceiling on model performance is set by the quality of rewards and data. Your core mission is to design and build LLM training and evaluation data end to end, starting from real-world data such as call logs, business systems, FAQs and manuals.\nRight now, building data for each project depends on individual effort and isn't reproducible. You'll turn the whole process into a standardized system: cleansing, anonymizing and structuring raw data; building SFT and RL data (synthetic data generation, difficulty control, deduplication, mixture tuning); and maintaining evaluation sets and benchmarks.\nThis is the foundation for scaling to the next 20-30 client projects. You'll also design and run the \"data flywheel\" that turns error analysis of training results into better data. Down the line, this role could grow into leading our data and evaluation team.\n## What this role is *not*\n- Not an on-call or SRE role. SLA management and infrastructure maintenance for online services are not the focus.\n- GPU cluster operations and general SRE/DevOps are handled by a separate team.\n- The final design of training algorithms and rewards (SFT/RL methods, loss functions) belongs to our LLM Training Engineer role. You'll partner with them on data and evaluation sets.\n- Defining client requirements and what a \"correct response\" looks like belongs to our Data PM role. You'll turn those definitions into real data.\n## What you'll do\n### 1. Investigate, design and prepare real-world data\n- Investigate each project's business systems and data, and design training and evaluation data end to end\n- Cleanse, anonymize and structure real-world data such as call logs\n### 2. Build training and evaluation data\n- Build SFT and RL data: synthetic data generation, difficulty control, deduplication and mixture tuning\n- Implement reward functions and evaluation sets, and maintain benchmarks for each project\n### 3. Run the data flywheel\n- Design and run the loop that turns error analysis of training results into data improvements\n- Build data pipelines with reproducibility and versioning built in\nWe're happy to go into more detail during the intro call and interviews.\n## Why this role\n- **Set the ceiling on model performance.** That ceiling is set by the quality of rewards and data. You'll decide what the model should learn and what belongs in the prompt, and build the foundation of its intelligence yourself.\n- **Turn ad hoc work into a system, from zero.** You'll rebuild fragmented, project-by-project data work into a repeatable data flywheel, and design the foundation for scaling to 20-30 projects.\n- **Work at the front line of real data and real products.** You'll work with actual call logs and business systems and turn real customer-service problems into data. This isn't clean research data; it's the data that runs production.\n## Tech stack\n- **Languages:** Python (pandas, Polars, Spark, etc.)\n- **Data infrastructure:** ETL, versioning, reproducibility, SQL, API and database integrations\n- **Synthetic data & evaluation:** Synthetic data generation via LLM APIs, LLM-as-a-Judge\n- **Training framework inputs:** TRL, verl (formatting SFT and RL data)\n## Our product\nWe build the Recho AI Voice Platform, which delivers voice conversations natural enough to be hard to tell apart from a human. We also deploy and operate Voice AI Agents for large enterprises.\nOur edge is a platform for building and improving high-quality agents quickly. It captures industry know-how and turns user feedback into a fast, continuous improvement loop. Our agents now handle complex, large-scale contact center operations in finance, manufacturing and the public sector. In some deployments, they've resolved every call without handing off to a human agent.\n## Hiring process\nIntro call → Case assignment & first interview → Paid work trial* → Final interview → Offer meeting\n*The work trial is 1-2 consecutive days at our Tokyo office, working on real tasks alongside the team, and it's paid. It's a chance for both side...","description_format":"text","description_chars":17673,"description_truncated":true,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"Japanese","level":"All levels","optional":false},{"language":"English","level":"All levels","optional":false}]},"benefits":["Annual leave","Apple Macbook","Stock options"],"hiring_locations":[{"name":"Japan","iso":"JP","kind":"country"}],"hiring_excludes":[],"relocation_offered":true,"industries":["Speech & Audio AI","AI Agents","Call Center Services"],"lifecycle":[{"event":"open","at":"2026-10-22T16:29:12Z"}],"visa":[],"liveness":{"score":56,"band":"ok","label":"Likely open","p_open":1,"p_active":0.624,"p_room":0.9,"age_days":12,"expected_fill_days":36,"reasons":["conf:2","stale_co","velocity","win:mid"],"computed_at":"2026-11-04T06:34:25Z"},"pay":{"stated_usd_annual":128560,"is_top_pay":false},"html_url":"https://alion.io/job/recho-senior-llm-data-engineer-training-data-evaluation","json_url":"https://alion.io/job/recho-senior-llm-data-engineer-training-data-evaluation.json","meta":{"generated_at":"2026-11-04T09:44:22Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15112,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2675564},"rest":"https://alion.io/mcp/rest/get_company?id=2675564"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Frecho-senior-llm-data-engineer-training-data-evaluation"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Frecho-senior-llm-data-engineer-training-data-evaluation"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Frecho-senior-llm-data-engineer-training-data-evaluation"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/recho-senior-llm-data-engineer-training-data-evaluation\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Frecho-senior-llm-data-engineer-training-data-evaluation"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3097212}},{"tool":"search_jobs","arguments":{"company":"recho-ai.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3097212},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}