{"id":605894,"url":"https://alion.io/job/bloomberg-senior-software-engineer-ai-inference","title":"Senior Software Engineer - AI Inference","company":{"id":7892,"name":"Bloomberg","domain":"bloomberg.com","url":"https://alion.io/company/bloomberg","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Avature","truth_index":{"grade":"A","score":100,"open_postings":40,"ghost_share":0,"stale_share":0,"repost_share":0.1,"time_to_fill_p50_days":19,"computed_at":"2026-10-30T05:48:23Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":160000,"max":240000,"currency":"USD","period":"year","gross":null,"usd_annual":240000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CUDA","optional":false},{"name":"InfiniBand","optional":false},{"name":"KServe","optional":false},{"name":"Kubernetes","optional":false},{"name":"Machine Learning","optional":false},{"name":"NCCL","optional":false},{"name":"NVLink","optional":false},{"name":"ONNX","optional":false},{"name":"Prompt Caching","optional":false},{"name":"PyTorch","optional":false},{"name":"TensorRT","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false}],"status":"live","first_seen_at":"2026-09-10T17:58:34Z","employer_posted_date":"2026-09-10","last_verified_at":"2026-10-30T18:56:05Z","board_verified":true,"closed_at":null,"days_open":50,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":50},"description":"Our team:\nJoin the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference Platform provides production-grade managed infrastructure for hosting, deploying, and serving all machine learning models, both predictive and cutting-edge generative models. We abstract away infrastructure complexity, empowering engineering teams to focus on creating intelligent applications with guaranteed scalability, performance, and governance. Our platform is built on the open-source KServe project, and the CNCS AI Inference team is a primary contributor to its development.\nWe'll trust you to:\nDesign and build scalable infrastructure for both online and offline inference workloads. \nLead integration of high-performance inference runtimes and serving frameworks, including TensorRT, vLLM, ONNX, and Triton. \nDrive architecture and technical decisions across Bloomberg’s inference platform, balancing latency, throughput, reliability, and cost. \nPartner across engineering teams to improve model deployment, observability, and production performance. \nMentor junior engineers on system design, debugging, and performance optimization. \nYou'll need to have:\n5+ years of professional software engineering experience. \nExperience designing, building, and operating production distributed systems. \nStrong systems intuition and a track record of debugging and optimizing performance-critical services. \nAbility to own problems end-to-end and quickly ramp up in unfamiliar technical areas. \n4+ years of demonstrated experience working with an object-oriented programming language. \nA degree in Computer Science, Electrical Engineering, or equivalent practical experience. \nWe'd love to see:\nExperience deploying and operating machine learning systems at scale. \nExperience with inference optimization techniques such as batching, caching, request scheduling, or memory-aware serving. \nFamiliarity with PyTorch and GPU software stacks such as CUDA and NCCL. \nExposure to high-performance interconnects and distributed computing technologies such as NVLink, InfiniBand, or MPI. \nExperience with Kubernetes and cloud-native infrastructure. \nExperience with load balancing, request routing, or traffic management systems. \nRepresentative projects:\nAutoscaling a heterogeneous compute fleet to match supply and demand aross diverse inference workloads. \nBuilding production-grade deployment pipelines to safely roll out new models to millions of users. \nDeveloping new inference capabilities such as structured sampling, prompt caching, and advanced serving optimizations. \nAnalyzing observability data from real production workloads to improve latency, throughput, and resource efficiency.\nSalary Range = 160,000 - 240,000 USD Annual + Benefits + Bonus\nThe referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.\nWe offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.\nDiscover what makes Bloomberg unique - watch our podcast series for an inside look at our culture, values, and the people behind our success.","description_format":"text","description_chars":3609,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Life insurance","Wellness"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Financial Data & Market Intelligence","Financial News & Media"],"lifecycle":[{"event":"open","at":"2026-09-10T17:58:34Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 434 · green card filings: 457","filings_12m":434,"filings_prev_12m":472,"green_card_filings_12m":457,"median_offered_wage_usd":165065,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":245},{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Skilled Worker, Senior or Specialist Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker; Global Business Mobility: Senior or Specialist Worker","cap_exempt":false,"checked_at":"2026-10-30T06:20:16+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":17,"band":"cold","label":"Long shot","p_open":1,"p_active":0.609,"p_room":0.28,"age_days":49,"expected_fill_days":19,"reasons":["conf:0","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-30T05:48:23Z"},"pay":{"stated_usd_annual":240000,"is_top_pay":true},"html_url":"https://alion.io/job/bloomberg-senior-software-engineer-ai-inference","json_url":"https://alion.io/job/bloomberg-senior-software-engineer-ai-inference.json","meta":{"generated_at":"2026-10-30T22:48:47Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13750,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7892},"rest":"https://alion.io/mcp/rest/get_company?id=7892"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbloomberg-senior-software-engineer-ai-inference"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbloomberg-senior-software-engineer-ai-inference"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbloomberg-senior-software-engineer-ai-inference"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/bloomberg-senior-software-engineer-ai-inference\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbloomberg-senior-software-engineer-ai-inference"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":605894}},{"tool":"search_jobs","arguments":{"company":"bloomberg.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":605894},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}