{"id":950684,"url":"https://alion.io/job/nvidia-senior-deep-learning-engineer-cosmo-3d-spatial","title":"Senior Deep Learning Engineer, Cosmo 3D Spatial","company":{"id":6,"name":"NVIDIA","domain":"nvidia.com","url":"https://alion.io/company/nvidia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":86,"open_postings":410,"ghost_share":0.01,"stale_share":0.534,"repost_share":0.032,"time_to_fill_p50_days":33,"computed_at":"2026-10-16T05:45:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Santa Clara, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":224000,"max":356500,"currency":"USD","period":"year","gross":null,"usd_annual":356500},"salary_estimate":null,"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Chain-of-Thought","optional":false},{"name":"Computer Vision","optional":false},{"name":"Embodied AI","optional":false},{"name":"FSDP","optional":false},{"name":"JAX","optional":false},{"name":"Linux","optional":false},{"name":"Localization","optional":false},{"name":"Multimodal AI","optional":false},{"name":"Physical AI","optional":false},{"name":"Post-training","optional":false},{"name":"Pre-training","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Ray","optional":false},{"name":"Reinforcement Learning","optional":false},{"name":"Reinforcement Learning","optional":false},{"name":"Reward Modeling","optional":false},{"name":"SFT","optional":false},{"name":"SLAM","optional":false},{"name":"SLURM","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-09-15T00:00:00Z","employer_posted_date":"2026-09-15","last_verified_at":"2026-10-16T10:51:04Z","board_verified":true,"closed_at":null,"days_open":31,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":31},"description":"NVIDIA is at the heart of the AI revolution, and Physical AI is its next frontier: machines that perceive, reason about, and act in the three-dimensional world. NVIDIA Cosmos is our open platform of world foundation models for Physical AI, built to interpret images, video, and text and turn them into a structured understanding of a physical scene: motion, object interactions, geometry, and physical context. These models are the reasoning layer for robots, autonomous vehicles, and smart infrastructure.\nThe Cosmos Engineering team builds the foundational capabilities behind these models. We are hiring a Senior Deep Learning Engineer to own thedata engine and end-to-end training verification behind the 3D spatial reasoning and perception capabilities of these models: 2D and 3D grounding, metric geometry, spatial reference frames, cross-view correspondence, and embodied spatial reasoning. You will decide what the model learns geometry from, prove that it learned it, and work directly with research scientists in Cosmos Lab to turn 3D research hypotheses into measurable capability in shipped models. If you believe frontier model quality is won or lost in the data and the evaluations, this is the seat where that belief does the most work.\nWhat you'll be doing:\nOwn the 3D data engine for Cosmos spatial reasoning: source, curate, filter, and balance large-scale real-world image and video corpora into vision-language training data with the coverage and diversity that spatial understanding demands.\n\nBuild the annotation and auto-labeling pipelines that produce 3D-grounded supervision at scale, camera-relative 3D boxes, referring and spatial question answering, free space and reachability, ego-, world-, and object-centric reference frames, cross-view correspondence, camera motion, distance and size, and chain-of-thought traces, validated by programmatic and model-based critics.\n\nOwn data quality end to end: semantic deduplication, automated quality scoring for faithfulness, completeness, and correctness, coverage analysis across scene types and reference frames, and the sampling strategies that keep pre-training and supervised fine-tuning mixtures balanced.\n\nVerify end-to-end model training: run and validate full pre-training and supervised fine-tuning pipelines, guard reproducibility, catch data and checkpoint regressions, diagnose throughput and loss anomalies, and attribute capability changes back to the specific data and recipe decisions that caused them.\n\nBuild and operate the 3D and spatial evaluation suite, public benchmarks such as CV-Bench, BLINK, RefSpatial, VSI-Bench, SPAR-Bench, and RoboSpatial, NVIDIA's VANTAGE-Bench for real-world fixed-camera video understanding, and in-house benchmarks you design with continuous evaluation and full traceability from every reported score back to the exact weights, inputs, configuration, and evaluation code.\n\nPartner closely with Cosmos Lab research scientists: translate 3D research hypotheses into dataset and ablation experiments, run them at scale, and feed honest results back into recipe and architecture decisions.\n\nOperate on large multi-node GPU clusters, tuning data throughput, sharding, and dataloader performance so that data is never the bottleneck on a long training run.\n\nShip the results into Cosmos releases, open-source datasets and benchmarks where appropriate, and raise the bar for data and evaluation rigor across the team.\n\nWhat we need to see:\nMS or PhD in Computer Science, Electrical/Computer Engineering, Robotics, or a related field, or equivalent experience.\n\n12+ years of proven experience building deep learning systems in Python with PyTorch or JAX on Linux.\n\nDeep expertise in 3D computer vision, multi-view geometry, structure-from-motion or SLAM, depth and camera pose estimation, point cloud processing, or 3D reconstruction with the practical ability to produce and validate 3D ground truth at scale, not just consume it.\n\nHands-on experience with vision-language models, including building the training data and evaluations that measurably improve visual grounding and reasoning quality.\n\nDemonstrated experience building large-scale multimodal data pipelines: distributed video and image processing, deduplication, captioning and annotation, automated quality metrics, and dataset versioning.\n\nExperience running and validating large model training on multi-GPU, multi-node clusters, with working knowledge of distributed training and sharding strategies such as data, tensor, and pipeline parallelism or FSDP.\n\nRigorous evaluation methodology: designing benchmarks that resist gaming, building clean ablations, and reading results honestly enough to kill your own ideas.\n\nExcellent written and verbal communication, with a track record of partnering effectively with research scientists and translating research direction into engineering execution.\n\nWays to stand out from the crowd:\nPhD and/or publications at CVPR, ICCV, ECCV, NeurIPS, ICLR, or CoRL in 3D vision, multimodal learning, or embodied AI.\n\nExperience curating web-scale or petabyte-scale video corpora, and building the distributed processing infrastructure behind it using Ray, Spark, Slurm, or similar.\n\nFamiliarity with 3D foundation models and modern auto-labeling techniques for geometry, camera estimation, and correspondence.\n\nExperience with vision-language model post-training, supervised fine-tuning, chain-of-thought data design, reward modeling, or reinforcement learning with verifiable rewards applied to reasoning quality.\n\nExperience building evaluation infrastructure and harnesses such as VLMEvalKit, including leaderboards, dashboards, and example-level failure inspection.\n\nWith competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and versatile people in the world working with us, and our engineering teams are growing fast in some of the most impactful fields of our generation: Deep Learning, Artificial Intelligence, and Physical AI. If you're a creative engineer who enjoys autonomy and shares our passion for technology, we want to hear from you!\nYour base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD.You will also be eligible for equity and benefits.\nApplications for this job will be accepted at least until September 19, 2026.This posting is for an existing vacancy.\nNVIDIA uses AI tools in its recruiting processes.\nNVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.","description_format":"text","description_chars":7045,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Servers & Data Center Hardware","Computer Components","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-09-16T00:39:09Z"}],"visa":[],"liveness":{"score":39,"band":"fade","label":"Fading","p_open":1,"p_active":0.521,"p_room":0.75,"age_days":31,"expected_fill_days":33,"reasons":["conf:0","stale_co","velocity","win:late","comp:brand"],"computed_at":"2026-10-16T05:45:00Z"},"pay":{"stated_usd_annual":356500,"is_top_pay":true},"html_url":"https://alion.io/job/nvidia-senior-deep-learning-engineer-cosmo-3d-spatial","json_url":"https://alion.io/job/nvidia-senior-deep-learning-engineer-cosmo-3d-spatial.json","meta":{"generated_at":"2026-10-16T13:02:54Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12428,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6},"rest":"https://alion.io/mcp/rest/get_company?id=6"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnvidia-senior-deep-learning-engineer-cosmo-3d-spatial"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnvidia-senior-deep-learning-engineer-cosmo-3d-spatial"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnvidia-senior-deep-learning-engineer-cosmo-3d-spatial"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nvidia-senior-deep-learning-engineer-cosmo-3d-spatial\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnvidia-senior-deep-learning-engineer-cosmo-3d-spatial"}]}