{"id":2977976,"url":"https://alion.io/job/rhoda-ai-software-engineer-intern-inference","title":"Software Engineer Intern, Inference","company":{"id":685148,"name":"Rhoda AI","domain":"rhoda.ai","url":"https://alion.io/company/rhoda","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":41,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":78,"computed_at":"2026-10-21T05:46:15Z"}},"role":"Backend","role_family":"Backend","seniority":"intern","employment_type":"internship","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Mountain View, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache TVM","optional":false},{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"CUTLASS","optional":false},{"name":"Knowledge Distillation","optional":false},{"name":"Model Distillation","optional":false},{"name":"ONNX Runtime","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Quantization","optional":false},{"name":"TensorRT","optional":false},{"name":"Triton","optional":false},{"name":"World Models","optional":false}],"status":"live","first_seen_at":"2026-10-21T01:58:59Z","employer_posted_date":"2026-10-21","last_verified_at":"2026-10-21T20:12:24Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":0},"description":"At Rhoda AI, we’re building the next generation of generalist intelligent robots. We own the full robotics stack from high-performance hardware and robot systems to the infrastructure and state-of-the-art foundation world models that control our robots. Our robots are designed to be generalists capable of operating in complex, real-world environments and handling long-tail edge cases, made possible by our cutting edge research and end-to-end system design. We've raised over $450M and are investing aggressively in model research, infrastructure, hardware development, and manufacturing scale-up to make generalist robotics a reality.\nThe Role\nOur foundation world models have to run fast enough to control robots in the real world, and efficiently enough to support large-scale research. As an Inference Infrastructure Engineer Intern, you'll work with our infra and research engineers to make model inference faster and more efficient across the stack, from data pipelines down to GPU kernels. You'll own a scoped, high-impact project end to end, ship it into our production or research workflow, and present your results to the team.\nWhat You'll Do\nProfile and benchmark inference for large video and world models to find bottlenecks in latency, throughput, and memory.\n\nApply and evaluate inference optimization techniques like quantization and low-precision inference, step distillation and sampling acceleration for diffusion-style models, attention and caching optimizations across frames, model compilation, and graph-level optimizations.\n\nMake data movement and processing more efficient: video decoding and preprocessing, input pipelines, host-device transfer, caching, and storage/IO paths that feed inference and training.\n\nWrite and tune GPU kernels (CUDA, Triton, or similar) for performance-critical operators, and integrate them into our inference stack.\n\nBuild tooling and benchmarks that let the team track performance regressions and improvements reliably.\n\nWork with researchers to turn promising ideas into production-quality infrastructure.\n\nWhat We're Looking For\nYou don't need all of these. Strong depth in any one of the areas below is enough to apply:\nML inference optimization: hands-on experience making deep learning models run faster or cheaper, e.g. quantization (INT8/FP8), pruning/distillation, operator fusion, mixed precision, or compilers and runtimes such as torch.compile, TensorRT, ONNX Runtime, or TVM.\n\nData efficiency optimization: experience speeding up data loading and preprocessing pipelines (especially video or other high-bandwidth sensor data), cutting IO and memory overhead, or improving data/compute utilization in ML systems.\n\nGPU kernel optimization: experience writing or tuning GPU kernels in CUDA, Triton, CUTLASS, or similar; familiarity with the GPU memory hierarchy, occupancy, and profiling tools (Nsight Systems/Compute, PyTorch profiler).\n\nBasic Qualifications\nCurrently pursuing a BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, or a related field.\n\nStrong programming skills in Python and/or C++.\n\nSolid understanding of deep learning fundamentals and at least one framework (PyTorch preferred).\n\nComfortable reading performance data and reasoning about trade-offs between latency, throughput, memory, and accuracy.\n\nNice to Have\nExperience with video model inference is a huge plus, e.g. optimizing video generation, video diffusion, or world models, or real-time video understanding pipelines.\n\nResearch experience in systems or ML, e.g. publications or substantial research projects (MLSys, OSDI/SOSP, CVPR/ICCV, NeurIPS/ICML/ICLR, or similar).\n\nExperience with real-time or latency-critical inference, e.g. on robots or edge/embedded accelerators.\n\nExperience with multi-GPU inference (tensor/sequence/pipeline parallelism).\n\nContributions to open-source ML systems projects.\n\nWhat You'll Get\nA real project with measurable impact on robots operating in the real world.\n\nMentorship from experienced infra and research engineers.\n\nAccess to modern GPU compute for experiments.","description_format":"text","description_chars":4070,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Industrial Robotics","Humanoid Robots"],"lifecycle":[{"event":"open","at":"2026-10-21T05:33:34Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 6","filings_12m":6,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":252500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":1}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":78,"reasons":["conf:0","win:early","comp:junior"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/rhoda-ai-software-engineer-intern-inference","json_url":"https://alion.io/job/rhoda-ai-software-engineer-intern-inference.json","meta":{"generated_at":"2026-10-21T22:10:23Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":31500,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":685148},"rest":"https://alion.io/mcp/rest/get_company?id=685148"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Frhoda-ai-software-engineer-intern-inference"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Frhoda-ai-software-engineer-intern-inference"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Frhoda-ai-software-engineer-intern-inference"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/rhoda-ai-software-engineer-intern-inference\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Frhoda-ai-software-engineer-intern-inference"}]}