{"id":82224,"url":"https://alion.io/job/eventual-research-engineer-multimodal-data-2","title":"Research Engineer, Multimodal Data","company":{"id":33679,"name":"Eventual","domain":"eventual.ai","url":"https://alion.io/company/eventual-ai","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":150000,"max":300000,"currency":"USD","period":"year","gross":null,"usd_annual":300000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Computer Vision","optional":false},{"name":"Databricks","optional":false},{"name":"Embeddings","optional":false},{"name":"Knowledge Distillation","optional":false},{"name":"Model Distillation","optional":false},{"name":"Multimodal AI","optional":false},{"name":"Perplexity","optional":false},{"name":"Physical AI","optional":false},{"name":"World Models","optional":false}],"status":"live","first_seen_at":"2026-04-29T21:37:38Z","employer_posted_date":"2026-04-29","last_verified_at":"2026-10-17T21:25:03Z","board_verified":true,"closed_at":null,"days_open":171,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":170},"description":"About Eventual\nRobots and world models learn about the physical world from video: millions of hours of people cooking, building, carrying and fixing things. That footage is piling up faster than anyone can review it, and much of it is mislabeled, out of sync or not useful for training. Most teams still choose what to train on by having people watch a small sample. When a model learns from bad examples, it learns the wrong behavior.\nEventual is building data curation for Physical AI. We process video and sensor data at petabyte scale and extract signals from it: how hands and objects interact, what happens over time (a failed grasp, a retry, a recovery) and whether a clip is reliable enough to learn from. Leading Physical AI labs and robotics teams use these signals to decide what goes into their next training run.\nThe work spans large-scale data systems, computer vision and ML research, and it ships directly into how frontier models get trained. We’re a small team from AWS, Lyft and Tesla, backed by $30M from Felicis, CRV, Y Combinator and the co-founders of Databricks and Perplexity. We helped power the last generation of Physical AI in self-driving, and now we’re building what the next generation trains on.\nJoin our small (but powerful!) team, 4 days/week in our SF Mission District office.\nYour Role\nAs a Research Engineer on the Visual Understanding team, you'll own the layer that makes petabytes of video queryable by content. Physical AI teams have video, lidar, radar, and sim outputs scattered across object stores with no way to find what they need without weeks of human annotation. Eventual runs vision/language models and pipelines over every clip in a corpus along axes the customer cares about (gripper type, failure mode, object class, scene, motion density), so a researcher can ask \"left-arm grasp failures on deformable objects\" and get a curated dataset in minutes.\nYou'll define the roadmap for our visual understanding capabilities, train and select the models that make corpus-scale annotation tractable at single-digit cents per hour of video, and build the rich datasets that go on to train customer models. This is a applied research role - meaning you'll read papers and run experiments, but you ship to production and your work has a real impact on our customers’ models and robots.\nKey Responsibilities\nOwn the visual understanding roadmap end-to-end: from picking the model family for a customer's taxonomy to landing it in production inference at corpus scale.\n\nTrain, fine-tune, and evaluate VLMs, VQA models, embedding models, and CNNs against customer datasets and benchmarks.\n\nDrive down per-clip annotation cost - model selection, distillation, batching, decode pipelining - so \"annotate every clip in a 10K-hour corpus\" stays economical.\n\nBuild the rich, queryable datasets that customers train on: design taxonomies with researchers, instrument quality, version the outputs.\n\nPartner with the dataloading and storage teams so visual understanding outputs flow into the index and on to the GPU without re-engineering.\n\nWork directly with researchers at our partner labs - your shortest feedback loop is their next training iteration.\n\nWhat we look for\nStrong familiarity with modern vision and multimodal models - convolution nets, VLMs, VQA, embeddings - and a sense for the SOTA that's actually deployable today vs. on a leaderboard.\n\nExperience running these models at scale on real video and sensor data, ideally for perception tasks (detection, tracking, segmentation, retrieval, captioning).\n\nBackground from a perception team at a self-driving, robotics, or visual-data company - or equivalent depth from a research lab.\n\nComfortable with cloud infrastructure and large-scale data processing - you don't need to be a distributed-systems engineer, but you've shipped jobs that run on thousands of GPU-hours of video.\n\nNice to have\nExperience training and evaluating vision or multimodal models (not just calling APIs).\n\nML/AI research background - papers, citations, or a research org on your resume.\n\nWorked on embeddings, retrieval, or content-aware search at scale.\n\nExperience designing labeling taxonomies or running annotation programs.\n\nPerks & Benefits\nIn-person, tight-knit team - 4 days/week in our SF Mission office.\n\nCompetitive comp and meaningful startup equity.\n\nCatered lunches and dinners for SF employees.\n\nCommuter benefit.\n\nTeam-building events and poker nights.\n\nHealth, vision, and dental coverage.\n\nFlexible PTO.\n\nLatest Apple equipment.\n\n401(k) plan with match.\n\nIf you're excited about being on the team that turns petabytes of raw video into the training data for the next generation of Physical AI, we'd love to talk.","description_format":"text","description_chars":4707,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Computer Vision","Multimodal AI"],"lifecycle":[{"event":"open","at":"2026-04-29T21:37:38Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 1","filings_12m":1,"filings_prev_12m":3,"green_card_filings_12m":0,"median_offered_wage_usd":152500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":1}],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.268,"p_room":0.28,"age_days":170,"expected_fill_days":61,"reasons":["conf:0","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":300000,"is_top_pay":true},"html_url":"https://alion.io/job/eventual-research-engineer-multimodal-data-2","json_url":"https://alion.io/job/eventual-research-engineer-multimodal-data-2.json","meta":{"generated_at":"2026-10-18T00:00:19Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":33679},"rest":"https://alion.io/mcp/rest/get_company?id=33679"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Feventual-research-engineer-multimodal-data-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Feventual-research-engineer-multimodal-data-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Feventual-research-engineer-multimodal-data-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/eventual-research-engineer-multimodal-data-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Feventual-research-engineer-multimodal-data-2"}]}