{"id":58726,"url":"https://alion.io/job/langchain-research-engineer-langsmith-engine","title":"Research Engineer, LangSmith Engine","company":{"id":4855,"name":"LangChain","domain":"langchain.com","url":"https://alion.io/company/langchain","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":90,"open_postings":46,"ghost_share":0,"stale_share":0.217,"repost_share":0,"time_to_fill_p50_days":72,"computed_at":"2026-10-28T05:59:10Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States","San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":161000,"max_usd":311000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":508},"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Cloudflare","optional":false},{"name":"Fine-tuning","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"LangSmith","optional":false},{"name":"Monday.com","optional":false},{"name":"Post-training","optional":false},{"name":"LLM","optional":true},{"name":"Machine Learning","optional":true},{"name":"Reinforcement Learning","optional":true},{"name":"RLAIF","optional":true},{"name":"RLHF","optional":true},{"name":"SFT","optional":true},{"name":"Synthetic Data","optional":true}],"status":"live","first_seen_at":"2026-08-14T17:40:43Z","employer_posted_date":"2026-08-14","last_verified_at":"2026-10-28T05:09:06Z","board_verified":true,"closed_at":null,"days_open":74,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":74},"description":"About Us\nAt LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.\nWith $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.\nToday, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.\nAbout the Team:\nThe LangSmith Engine team is building a proactive agent engineer that analyzes production traces, identifies important failures, recommends and writes fixes, and helps prevent those issues from coming back. We’re building agents that can understand complex software systems and continuously improve the quality of other AI agents.\nAbout the Role:\nWe’re looking for an experienced research engineer to help make the Engine agent more capable and more efficient.\nYou’ll study real agent failures, build benchmarks that capture what matters, run experiments to improve performance, and turn successful ideas into production. This may include prompting and agent-harness improvements, model selection, fine-tuning and post-training custom models. The focus is on measurable improvements to the overall agent.\nThis role also requires a understanding of production engineering and system-level tradeoffs. Engine is a production system, so improving an agent is not just about maximizing benchmark performance-it also means understanding the impact on cost, latency, reliability, and scalability. You’ll work in the same team with production engineers to design, test, and ship improvements that work reliably in real-world environments.\nLocation: SF and NYC\nWhat You’ll Do:\nBuild and maintain benchmarks and evaluations that measure the quality and efficiency of Engine agents on real-world tasks.\n\nDesign and run experiments to improve agent performance across models, prompting, context, tools, orchestration, and agent strategies.\n\nExplore and implement post-training and fine-tuning techniques when they can meaningfully improve agent capabilities, quality, or cost.\n\nTurn successful experiments into production improvements, working closely with engineers and researchers to measure impact and prevent regressions.\n\nHelp define the ML roadmap and technical direction for improving Engine agents, and mentor other engineers through strong technical leadership.\n\nWhat You’ll Bring:\n4+ years of experience in ML/AI research, or a closely related field.\n\nMaster’s or Ph.D. in a relevant scientific field.\n\nHands-on experience working with LLMs and AI agents, including analyzing model behavior and improving real-world performance\n\nStrong experience designing benchmarks, evaluations, and experiments for AI/ML systems; you know how to tell whether a change actually made an agent better.\n\nStrong software engineering skills, with a track record of taking ideas from research prototype to measurable production impact.\n\nYou have maximum agency and strong research judgment: you can identify high-impact problems, work through ambiguity, move quickly, and communicate your findings clearly.\n\nNice to Have:\nPh.D. in Machine Learning, Computer Science or Physics.\n\nHands on experience with LLM-as-a-judge, automated graders, synthetic data generation, or human evaluation.\n\nHands on experience with reinforcement learning, preference optimization, SFT, RLHF/RLAIF, or other post-training techniques for LLMs.\n\nExperience optimizing LLM agents for cost, latency, or task efficiency on productions\n\nExperience with model serving, inference optimization, distributed systems, or GPU infrastructure.\n\nCompensation\nSalary Range: $240,000-$280,000 USD\nCompensation Philosophy:\nWe offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.\nWe are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.\nBenefits\nBenefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.","description_format":"text","description_chars":5302,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":true},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","AI Agents","AI Development Tools","AI Evaluation & Observability"],"lifecycle":[{"event":"open","at":"2026-08-14T17:40:43Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 17","filings_12m":17,"filings_prev_12m":2,"green_card_filings_12m":0,"median_offered_wage_usd":172500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":13}],"liveness":{"score":34,"band":"fade","label":"Fading","p_open":1,"p_active":0.774,"p_room":0.44,"age_days":74,"expected_fill_days":72,"reasons":["conf:0","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-28T05:59:10Z"},"pay":null,"html_url":"https://alion.io/job/langchain-research-engineer-langsmith-engine","json_url":"https://alion.io/job/langchain-research-engineer-langsmith-engine.json","meta":{"generated_at":"2026-10-28T08:03:20Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10368,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4855},"rest":"https://alion.io/mcp/rest/get_company?id=4855"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Flangchain-research-engineer-langsmith-engine"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Flangchain-research-engineer-langsmith-engine"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Flangchain-research-engineer-langsmith-engine"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/langchain-research-engineer-langsmith-engine\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Flangchain-research-engineer-langsmith-engine"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":58726}},{"tool":"search_jobs","arguments":{"company":"langchain.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":58726},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}