{"id":2833231,"url":"https://alion.io/job/reddit-software-engineer-agent-optimization-evaluation","title":"Software Engineer, Agent Optimization & Evaluation","company":{"id":16,"name":"Reddit","domain":"reddit.com","url":"https://alion.io/company/reddit","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":79,"open_postings":25,"ghost_share":0,"stale_share":0.64,"repost_share":0,"time_to_fill_p50_days":68,"computed_at":"2026-10-23T05:54:15Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States","United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":109800,"max":325000,"currency":"USD","period":"year","gross":null,"usd_annual":325000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"AI Agents","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Platform Engineering","optional":false}],"status":"live","first_seen_at":"2026-10-19T01:44:46Z","employer_posted_date":"2026-10-19","last_verified_at":"2026-10-23T18:00:48Z","board_verified":true,"closed_at":null,"days_open":4,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":4},"description":"Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com.\nWe are Software Engineers across multiple levels! The Team \nWe're building Reddit's next-generation AI developer platform: a best-in-class agent stack that helps every Snoo build, test, review, and ship software efficiently while preserving Reddit's control over quality, costs, and long-term AI strategy. Our optimization harness measures and improves agents across the software development lifecycle by benchmarking models, detecting regressions, optimizing routing, incorporating production feedback, and improving developer productivity.\n You'll report to Kyle Maxwell and partner with Platform Engineering, Infrastructure, and Developer Productivity to shape AI-assisted software development across Reddit.\nThe Role\nAs a Software Engineer, Agent Optimization & Evaluation, you will lead our agent optimization and evaluation platform. You'll build systems to measure and improve agents' impact on engineering velocity, including Reddit-specific evaluation environments, intelligent model orchestration, and feedback loops that learn from production usage. This hands-on role involves writing production code and building new systems with ownership and autonomy. Strong platform and infrastructure partners will support your work on agent optimization, evaluation, and orchestration.\nWhat You’ll Do:\nDesign and build Reddit's agent optimization harness for evaluating, benchmarking, and improving AI agents across real software engineering workflows.\nDevelop Reddit-specific evaluation environments that accurately measure agent performance against meaningful engineering tasks.\nBuild systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.\nDesign model routing and orchestration strategies that optimize for quality, latency, and cost.\nDefine metrics and experimentation frameworks that measure developer productivity and engineering velocity.\nBuild tooling to analyze agent behavior, investigate failures, and accelerate iteration.\nPartner closely with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into engineering workflows.\nHelp shape Reddit's long-term strategy for a flexible, model-agnostic agent platform that gives us control over our AI capabilities and economics\nYou Will Bring:\n5-12+ years of engineering experience\nExtensive experience building and shipping large-scale production software systems.\nExperience designing evaluation, experimentation, benchmarking, or measurement systems for AI, search, developer platforms, or other complex distributed systems.\nStrong understanding of modern LLMs, AI agents, and the engineering systems required to deploy them effectively.\nExperience building systems that optimize across multiple dimensions, including quality, latency, reliability, and cost.\nExcellent software engineering fundamentals and a passion for building production-quality systems.\nAbility to operate independently in ambiguous environments and drive technical direction for highly strategic initiatives.\nStrong cross-functional collaboration skills and experience working across engineering, infrastructure, and platform organizations.\nBenefits\nComprehensive Healthcare Benefits and Income Replacement Programs\n401k with Employer Match\nGlobal Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support\nFamily Planning Support\nGender-Affirming Care\nMental Health & Coaching Benefits\nFlexible Vacation & Paid Volunteer Time Off\nGenerous Paid Parental Leave\nPay Transparency:\nThis job posting may span more than one career level.\nIn addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit https://www.redditinc.com/careers/.\nTo provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.\nThe base salary range for this position is:\n$109,800—$325,000 USD\nIn select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.\nDuring the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our Candidate Privacy Policy for Potential Employees and Contractors.\nReddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.","description_format":"text","description_chars":6526,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Equity","Parental leave","Professional development","Restricted stock units","Vision insurance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Online Forums & Community Platforms","Social Networks"],"lifecycle":[{"event":"open","at":"2026-10-19T04:05:57Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 92 · green card filings: 20","filings_12m":92,"filings_prev_12m":89,"green_card_filings_12m":20,"median_offered_wage_usd":258929,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":63}],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":4,"expected_fill_days":68,"reasons":["conf:1","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-23T05:54:15Z"},"pay":{"stated_usd_annual":325000,"is_top_pay":true},"html_url":"https://alion.io/job/reddit-software-engineer-agent-optimization-evaluation","json_url":"https://alion.io/job/reddit-software-engineer-agent-optimization-evaluation.json","meta":{"generated_at":"2026-10-23T20:03:44Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1430,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":16},"rest":"https://alion.io/mcp/rest/get_company?id=16"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Freddit-software-engineer-agent-optimization-evaluation"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Freddit-software-engineer-agent-optimization-evaluation"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Freddit-software-engineer-agent-optimization-evaluation"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/reddit-software-engineer-agent-optimization-evaluation\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Freddit-software-engineer-agent-optimization-evaluation"}]}