{"id":4300445,"url":"https://alion.io/job/coreweave-senior-software-engineer-ii-inference","title":"Senior Software Engineer II, Inference","company":{"id":7348,"name":"CoreWeave","domain":"coreweave.com","url":"https://alion.io/company/coreweave","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":74,"open_postings":70,"ghost_share":0,"stale_share":0.843,"repost_share":0,"time_to_fill_p50_days":61,"computed_at":"2026-11-12T10:38:37Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Sunnyvale, United States","Bellevue, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":182000,"max":242000,"currency":"USD","period":"year","gross":null,"usd_annual":242000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"C++","optional":false},{"name":"CI/CD","optional":false},{"name":"CoreWeave","optional":false},{"name":"Grafana","optional":false},{"name":"Kubernetes","optional":false},{"name":"KV Cache","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"CUDA","optional":true},{"name":"NCCL","optional":true},{"name":"Outlook","optional":true},{"name":"Ray","optional":true},{"name":"Ray Serve","optional":true},{"name":"TensorRT","optional":true},{"name":"TensorRT-LLM","optional":true},{"name":"TorchServe","optional":true},{"name":"Triton","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2026-11-13T23:39:38Z","employer_posted_date":"2026-11-13","last_verified_at":"2026-11-14T02:54:34Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com.\nAbout the Team\nSenior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services. You'll partner with product, orchestration, and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale.\nKey Responsibilities:\nLead design reviews and drive architecture within the team; decompose multi-service work into clear milestones.\nDefine and own SLIs/SLOs; ensure post-incident actions land and reliability improves release-over-release.\nImplement advanced optimizations (e.g., micro-batch schedulers, speculative decoding, KV-cache reuse) and quantify impact.\nStrengthen incident posture: capacity planning, autoscaling policy, graceful degradation, rollback/traffic-shift strategies.\nMentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing standards.\nFor IC4: own an area spanning multiple services and teams (e.g., request routing & adaptive scheduling, cost-per-token analytics, GPU resource isolation).\nQualifications:\nIC3: ~3-5 years; IC4: ~5-8 years industry experience building distributed systems or cloud services.\nStrong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and performance.\nHands-on experience with Kubernetes at production scale, CI/CD, and observability stacks (Prometheus, Grafana, OpenTelemetry).\nPractical knowledge of inference internals: batching, caching, mixed precision (BF16/FP8), streaming token delivery.\nProven track record improving tail latency (P95/P99) and service reliability through metrics-driven work.\nBachelor's or Master's in Computer Science or related field (or equivalent practical experience).\nPreferred Skills:\nContributions to inference frameworks (vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe).\nExperience with CUDA kernels, NCCL/SHARP, RDMA/NUMA, or GPU interconnect topologies.\nLeading multi-team initiatives or partnering with customers on mission-critical launches.\nWhy CoreWeave?\nAt CoreWeave, we work hard, have fun, and move fast! We're in an exciting stage of hyper-growth that you will not want to miss out on. We're not afraid of a little chaos, and we're constantly learning. Our team cares deeply about how we build our product and how we work together, which is represented through our core values:\nBe Curious at Your Core\nAct Like an Owner\nEmpower Employees\nDeliver Best-in-Class Client Experiences\nAchieve More Together\nWe support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and enables the development of innovative solutions to complex problems. As we get set for takeoff, the organization's growth opportunities are constantly expanding. You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us!\nThe base salary range for this role is $182,000 to $242,000. The starting salary will be determined by job-related knowledge, skills, experience, and the market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).\nWhat We Offer\nIn addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings for full-time employees; for roles in other locations, benefits vary and are shared during the hiring process. These include:\nMedical, dental, and vision insurance - 100% paid for by CoreWeave\nCompany-paid Life Insurance \nVoluntary supplemental life insurance \nShort and long-term disability insurance \nFlexible Spending Account\nHealth Savings Account\nTuition Reimbursement \nAbility to Participate in Employee Stock Purchase Program (ESPP)\nMental Wellness Benefits through Spring Health \nFamily-Forming support provided by Carrot\nPaid Parental Leave \nFlexible, full-service childcare support with Kinside\n401(k) with a generous employer match\nFlexible PTO\nCatered lunch each day in our office and data center locations\nA casual work environment\nA work culture focused on innovative disruption\nCalifornia Applicants\nCalifornia Consumer Privacy Act \nEqual Opportunity & Accommodations\nCoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.\nAs part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: .\nExport Control Compliance\nThis position requires access to technology and/or source code subject to U.S. export control laws. Any such access will be provided only in compliance with applicable U.S. export control requirements. As part of the recruitment process, CoreWeave may request limited information reasonably necessary to assess applicable export-control requirements.","description_format":"text","description_chars":5999,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity","Growth opportunities","Life insurance","Parental leave","Vision insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Centers & Colocation","Cloud Platforms (IaaS & PaaS)","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-11-14T02:54:34Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 86","filings_12m":86,"filings_prev_12m":10,"green_card_filings_12m":0,"median_offered_wage_usd":232500,"route":null,"cap_exempt":false,"checked_at":"2026-11-12T07:36:15+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":62}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":61,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-14T04:01:54Z"},"pay":{"stated_usd_annual":242000,"is_top_pay":true},"html_url":"https://alion.io/job/coreweave-senior-software-engineer-ii-inference","json_url":"https://alion.io/job/coreweave-senior-software-engineer-ii-inference.json","meta":{"generated_at":"2026-11-14T04:01:54Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6339,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7348},"rest":"https://alion.io/mcp/rest/get_company?id=7348"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcoreweave-senior-software-engineer-ii-inference"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcoreweave-senior-software-engineer-ii-inference"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcoreweave-senior-software-engineer-ii-inference"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/coreweave-senior-software-engineer-ii-inference\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcoreweave-senior-software-engineer-ii-inference"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4300445}},{"tool":"search_jobs","arguments":{"company":"coreweave.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4300445},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}