{"id":14226,"url":"https://alion.io/job/baseten-software-engineer-training-infrastructure","title":"Software Engineer - Training Infrastructure","company":{"id":4399,"name":"Baseten","domain":"baseten.co","url":"https://alion.io/company/baseten","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":72,"open_postings":17,"ghost_share":0,"stale_share":0.882,"repost_share":0.059,"time_to_fill_p50_days":92,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States","New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":165000,"max":330000,"currency":"USD","period":"year","gross":null,"usd_annual":330000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Baseten","optional":false},{"name":"Cursor","optional":false},{"name":"Go","optional":false},{"name":"Kubernetes","optional":false},{"name":"Reinforcement Learning","optional":false},{"name":"Spark","optional":false},{"name":"AWS","optional":true},{"name":"DeepSpeed","optional":true},{"name":"DigitalOcean","optional":true},{"name":"FSDP","optional":true},{"name":"GCP","optional":true},{"name":"Machine Learning","optional":true},{"name":"Megatron-LM","optional":true},{"name":"NCCL","optional":true},{"name":"Python","optional":true},{"name":"PyTorch","optional":true}],"status":"live","first_seen_at":"2025-08-29T20:39:32Z","employer_posted_date":"2025-08-29","last_verified_at":"2026-10-17T09:02:23Z","board_verified":true,"closed_at":null,"days_open":413,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":413},"description":"ABOUT BASETEN\nBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.\nTHE ROLE\nAs a Software Engineer on the Training Infrastructure team, you'll architect and lead development of our training platform, supporting top tier research engineers and model developers. You'll make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor their workloads with high performance and reliability. You’ll own scheduling, storage, networking, reliability, and observability of technical systems in the training stack\nEXAMPLE INITIATIVES\nTake a look at what we’ve built so far:\nOverview of the product so far\n\nTraining docs overview\n\nStory of the Training product\n\nResearch we've done\n\nRESPONSIBILITIES\nDesign and architect scalable infrastructure systems for our ML training platform (e.g. scheduling, storage, and networking)\n\nPartner closely with developers and research engineers to translate complex training requirements into technical solutions\n\nDesign and architect a global training scheduler\n\nDesign and architect reinforcement learning systems and continuous learning pipelines\n\nDrive long-term improvements to increase reliability of systems and velocity of development\n\nPartner closely with SRE and Capacity teams to unlock state of the art training infrastructure\n\nMake critical architectural decisions balancing performance with system reliability\n\nLead technical discussions and mentor junior engineers on infrastructure best practices\n\nContribute to long-term technical strategy and infrastructure roadmap\n\nREQUIREMENTS\nBachelor’s degree or higher in Computer Science or related field\n\n5+ years of experience\n\nProficiency in Go, with\n\nDeep expertise with Kubernetes in production environments\n\nAdvanced understanding of distributed systems concepts and performance tuning\n\nProven experience designing observability systems\n\nExperience with ML/AI workloads and MLOps platforms\n\nNICE TO HAVE\nExperience with distributed storage systems\n\nPython experience a plus\n\nExtensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius)\n\nExperience with workload orchestration platforms like Temporal or Airflow\n\nFamiliarity or experience with the open source training stack and frameworks (NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, HF Trainer) and distributed training techniques (FSDP, DeepSpeed).\n\nExperience developing AI products, tooling, or agents\n\nBENEFITS\nCompetitive compensation, including meaningful equity\n\n(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents\n\nFlexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)\n\nPaid parental leave\n\nFertility and family-building stipend through Carrot\n\n(U.S. only) Company-facilitated 401(k)\n\nExposure to a variety of ML startups, offering unparalleled learning and networking opportunities.\n\nApply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.\nAt Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.\nWe are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).","description_format":"text","description_chars":4229,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Equity","Parental leave","Vision insurance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["MLOps","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2025-08-29T20:39:32Z"},{"event":"open","at":"2026-09-26T00:45:59Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.297,"p_room":0.28,"age_days":413,"expected_fill_days":92,"reasons":["conf:0","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":330000,"is_top_pay":true},"html_url":"https://alion.io/job/baseten-software-engineer-training-infrastructure","json_url":"https://alion.io/job/baseten-software-engineer-training-infrastructure.json","meta":{"generated_at":"2026-10-17T11:54:33Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15707,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4399},"rest":"https://alion.io/mcp/rest/get_company?id=4399"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbaseten-software-engineer-training-infrastructure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbaseten-software-engineer-training-infrastructure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbaseten-software-engineer-training-infrastructure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/baseten-software-engineer-training-infrastructure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbaseten-software-engineer-training-infrastructure"}]}