{"id":750726,"url":"https://alion.io/job/sciforium-distributed-training-and-inference-engineer","title":"Distributed Training and Inference Engineer","company":{"id":716759,"name":"Sciforium","domain":"sciforium.ai","url":"https://alion.io/company/sciforium-2","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":84,"open_postings":6,"ghost_share":0,"stale_share":0.833,"repost_share":0,"time_to_fill_p50_days":11,"computed_at":"2026-11-06T05:58:05Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":190000,"max":250000,"currency":"USD","period":"year","gross":null,"usd_annual":250000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"JAX","optional":false},{"name":"Machine Learning","optional":false},{"name":"Multimodal AI","optional":false},{"name":"NCCL","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"ROCm","optional":false},{"name":"TPU","optional":false},{"name":"vLLM","optional":false},{"name":"XLA","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-08-24T19:04:23Z","employer_posted_date":"2026-08-24","last_verified_at":"2026-11-06T07:42:03Z","board_verified":true,"closed_at":null,"days_open":73,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":73},"description":"Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.\nAbout the role\nSciforium is seeking a highly skilled Distributed Training and Inference Engineer to build, optimize, and maintain the critical software stack that powers our large-scale AI training and serving workloads. In this role, you will work across the entire machine learning infrastructure from low-level CUDA/ROCm runtimes to high-level frameworks like JAX and PyTorch to ensure our distributed training systems are fast, scalable, stable, and efficient.\nThis position is ideal for someone who loves deep systems engineering, debugging complex hardware-software interactions, and optimizing performance at every layer of the ML stack. You will play a pivotal role in enabling the training and deployment of next-generation LLMs and generative AI models.\nWhat you'll do\nSoftware Stack Maintenance: Maintain, update, and optimize critical ML libraries and frameworks including JAX, PyTorch, CUDA, and ROCm across multiple environments and hardware configurations.\n\nEnd-to-End Stack Ownership: Build, maintain, and continuously improve the entire ML software stack from ROCm/CUDA drivers to high-level JAX/PyTorch tooling.\n\nDistributed System Optimization: Ensure all model implementations are efficiently sharded, partitioned, and configured for large-scale distributed training and serving.\n\nSystem Integration: Continuously integrate and validate modules for runtime correctness, memory efficiency, and scalability across multi-node GPU/accelerator clusters.\n\nProfiling & Performance Analysis: Conduct detailed profiling of compilation graphs, training workloads, and runtime execution to optimize performance and eliminate bottlenecks.\n\nDebugging & Reliability: Troubleshoot complex hardware-software interaction issues, including vLLM compilation failures on ROCm, CUDA memory leaks, distributed runtime failures, and kernel-level inconsistencies.\n\nCollaborate with research, infrastructure, and kernel engineering teams to improve system throughput, stability, and developer experience.\n\nIdeal candidate profile\n5+ years of industry experience in ML systems, distributed training, or related fields.\n\nBachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or related technical fields.\n\nStrong programming experience in Python, C++, and familiarity with ML tooling and distributed systems.\n\nDeep understanding of profiling tools (e.g., Nsight, ROCm Profiler, XLA profiler, TPU tools).\n\nDeep expertise with partitioning configuration on the modern ML frameworks such as PyTorch and JAX.\n\nExperience with multi-node distributed training systems and orchestration frameworks (DTensor, GSPMD, etc.).\n\nHands-on experience maintaining or building ML training stacks involving CUDA, ROCm, NCCL, XLA, or similar technologies.\n\nNice-to-have\nExtensive experience with the XLA/JAX stack, including compilation internals and custom lowering paths.\n\nFamiliarity with distributed serving or large-scale inference frameworks (e.g., vLLM, TensorRT, FasterTransformer).\n\nBackground in GPU kernel optimization or accelerator-aware model partitioning.\n\nStrong understanding of low-level C++ building blocks used in ML frameworks (e.g., XLA, CUDA kernels, custom ops).\n\nBenefits include\nMedical, dental, and vision insurance\n\n401k plan\n\nDaily lunch, snacks, and beverages\n\nFlexible time off\n\nCompetitive salary and equity\n\nEqual opportunity\nSciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.","description_format":"text","description_chars":3963,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["401k plan","Equity","Flexible time off","Vision insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-09-11T15:41:32Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 5","filings_12m":5,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":175500,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":5}],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":1,"p_active":0.41,"p_room":0.28,"age_days":73,"expected_fill_days":11,"reasons":["conf:2","win:tail","crowd:"],"computed_at":"2026-11-06T05:58:05Z"},"pay":{"stated_usd_annual":250000,"is_top_pay":true},"html_url":"https://alion.io/job/sciforium-distributed-training-and-inference-engineer","json_url":"https://alion.io/job/sciforium-distributed-training-and-inference-engineer.json","meta":{"generated_at":"2026-11-06T09:25:14Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":17011,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":716759},"rest":"https://alion.io/mcp/rest/get_company?id=716759"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsciforium-distributed-training-and-inference-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsciforium-distributed-training-and-inference-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsciforium-distributed-training-and-inference-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sciforium-distributed-training-and-inference-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsciforium-distributed-training-and-inference-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":750726}},{"tool":"search_jobs","arguments":{"company":"sciforium.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":750726},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}