{"id":667197,"url":"https://alion.io/job/rhoda-inference-infrastructure-engineer","title":"Inference Infrastructure Engineer","company":{"id":685148,"name":"Rhoda AI","domain":"rhoda.ai","url":"https://alion.io/company/rhoda","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":42,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":78,"computed_at":"2026-10-17T05:46:00Z"}},"role":"DevOps","role_family":"DevOps","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Mountain View, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":175000,"max":280000,"currency":"USD","period":"year","gross":null,"usd_annual":280000},"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"GCP","optional":false},{"name":"JAX","optional":false},{"name":"Kubernetes","optional":false},{"name":"PyTorch","optional":false},{"name":"Ray","optional":false},{"name":"Ray Serve","optional":false},{"name":"TorchServe","optional":false},{"name":"Triton","optional":false},{"name":"World Models","optional":false},{"name":"Apache Kafka","optional":true},{"name":"gRPC","optional":true},{"name":"NATS","optional":true},{"name":"SLURM","optional":true}],"status":"live","first_seen_at":"2026-05-12T14:55:06Z","employer_posted_date":"2026-05-12","last_verified_at":"2026-10-17T17:36:43Z","board_verified":true,"closed_at":null,"days_open":158,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":157},"description":"At Rhoda AI, we’re building the next generation of generalist intelligent robots. We own the full robotics stack from high-performance hardware and robot systems to the infrastructure and state-of-the-art foundation world models that control our robots. Our robots are designed to be generalists capable of operating in complex, real-world environments and handling long-tail edge cases, made possible by our cutting edge research and end-to-end system design. We've raised over $450M and are investing aggressively in model research, infrastructure, hardware development, and manufacturing scale-up to make generalist robotics a reality.\nWe're looking for an Inference Infrastructure Engineer to help build and operate the systems that power our model deployment stack. You'll be responsible for running large foundation models efficiently and reliably across cloud and on-prem environments, with a focus on resource management, scheduling, and infrastructure scalability.\nWhat You'll Do\nDesign and operate large-scale infrastructure to run model workloads across cloud and on-prem environments\n\nBuild and maintain Kubernetes-based deployment pipelines for managing distributed ML workloads\n\nOwn resource scheduling and orchestration across GPU clusters - optimizing utilization, workload balancing, and cost-performance tradeoffs\n\nIntegrate and manage ML frameworks and model serving systems (e.g., Triton, Ray Serve, TorchServe) across research and production use cases\n\nBuild tooling for model deployment, versioning, and observability to support fast iteration cycles\n\nContribute to the reliability and scalability of the infrastructure stack as model complexity and deployment footprint grow\n\nWhat We're Looking For\n3+ years of experience in ML infrastructure, MLOps, or distributed systems\n\nStrong proficiency with Kubernetes and containerized deployment pipelines\n\nExperience with GPU orchestration and resource scheduling across large distributed jobs\n\nExperience with cloud providers (e.g., AWS, GCP) and hybrid cloud/on-prem infrastructure\n\nFamiliarity with ML frameworks (e.g., PyTorch, JAX) and model serving tools (e.g., Triton, Ray Serve, TorchServe)\n\nStrong debugging instincts and ownership mentality - comfortable driving issues to resolution across the stack\n\nNice to Have (But Not Required)\nExperience with streaming systems or high-throughput data transport (e.g., Kafka, gRPC, NATS)\n\nBackground in networking, low-latency systems, or network-aware scheduling\n\nExperience with edge/cloud hybrid deployment patterns and the latency constraints that come with them\n\nFamiliarity with on-robot or embedded inference environments\n\nExperience with large-scale cluster topology and scheduling systems (e.g., SLURM, Ray, Volcano)\n\nWhy This Role\nOwn the infrastructure layer that connects our foundation models to real robot behavior - a direct line between your work and what the robot does in the world\n\nBe part of building the infrastructure stack for one of the most technically ambitious robotics companies in the world","description_format":"text","description_chars":3036,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Industrial Robotics","Humanoid Robots"],"lifecycle":[{"event":"open","at":"2026-09-10T22:05:03Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 6","filings_12m":6,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":252500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":1}],"liveness":{"score":18,"band":"cold","label":"Long shot","p_open":1,"p_active":0.627,"p_room":0.28,"age_days":157,"expected_fill_days":78,"reasons":["conf:1","velocity","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":280000,"is_top_pay":true},"html_url":"https://alion.io/job/rhoda-inference-infrastructure-engineer","json_url":"https://alion.io/job/rhoda-inference-infrastructure-engineer.json","meta":{"generated_at":"2026-10-17T20:13:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3850,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":685148},"rest":"https://alion.io/mcp/rest/get_company?id=685148"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Frhoda-inference-infrastructure-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Frhoda-inference-infrastructure-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Frhoda-inference-infrastructure-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/rhoda-inference-infrastructure-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Frhoda-inference-infrastructure-engineer"}]}