{"id":2736158,"url":"https://alion.io/job/nvidia-senior-llm-agents-architect","title":"Senior LLM Agents Architect","company":{"id":6,"name":"NVIDIA","domain":"nvidia.com","url":"https://alion.io/company/nvidia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":82,"open_postings":592,"ghost_share":0.019,"stale_share":0.66,"repost_share":0.034,"time_to_fill_p50_days":33,"computed_at":"2026-10-17T05:46:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Yokneam, Israel","Ra'anana, Israel"],"countries":["IL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":180000,"max_usd":410000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":1148},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"C++","optional":false},{"name":"Claude Code","optional":false},{"name":"CrewAI","optional":false},{"name":"CUDA","optional":false},{"name":"CUDA Toolkit","optional":false},{"name":"Cursor","optional":false},{"name":"Function Calling","optional":false},{"name":"HPC","optional":false},{"name":"InfiniBand","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"NVLink","optional":false},{"name":"OpenAI Codex","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"PyTorch C++","optional":false},{"name":"RAG","optional":false},{"name":"Tool Use","optional":false},{"name":"Triton","optional":false}],"status":"live","first_seen_at":"2026-05-20T00:00:00Z","employer_posted_date":"2026-05-20","last_verified_at":"2026-10-17T21:30:23Z","board_verified":true,"closed_at":null,"days_open":151,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":150},"description":"We don't just build the hardware and software that powers the AI revolution - we are building the AI that designs the next generation of both. Our team sits at the intersection of inference software and GPU architecture, creating autonomous LLM-driven systems that reason about hardware, write high-performance CUDA, and automate the complex loops of architectural simulation, analysis, and optimization.\nWe are looking for a senior LLM Agents Architect to work hands-on with hardware architects, verification engineers, GPU performance experts, and software developers to build end-to-end agent flows that drive significant improvements in kernel optimization, architectural exploration, and developer efficiency.\nWhat you'll be doing:\nDesign and build agentic AI systems that generate, analyze, and optimize GPU compute kernels - targeting speed-of-light performance on NVIDIA hardware.\n\nCollaborate with GPU architects and performance engineers to encode domain expertise - memory hierarchy trade-offs, occupancy tuning, instruction-level reasoning - into agent workflows that rival hand-tuned optimization.\n\nBuild automated performance forensics agents capable of ingesting large-scale simulation traces and Nsight profiler data to identify bottlenecks and propose architectural or software mitigations.\n\nPartner with HW architects to develop agentic flows for GPU architectural studies - enabling rapid what-if analysis across micro-architecture configurations such as cache sizing, memory controller design, and compute unit scaling.\n\nExplore agentic approaches to HW/SW co-design challenges, including replacing or augmenting graph-compiler functionality (e.g., TorchInductor) with LLM-driven optimization and code-generation pipelines.\n\nRapidly prototype and thoughtfully productize; integrate with internal services, utilize GPU capabilities, remove bottlenecks, and deliver fitting solutions.\n\nSet up evaluation backbone using offline golden sets and online telemetry for confident iterations, cost control, and safe improvements.\n\nMentor and improve teams through insights in agent orchestration, prompting, RAG, observability, crafting documentation and playbooks for NVIDIA's teams.\n\nWhat we need to see:\n8+ years in applied ML/AI or large-scale systems, with 2+ years crafting agentic or LLM-powered applications in production environments.\n\nB.Sc in Computer Science / Electrical Engineering.\n\nSolid grounding in computer architecture: memory hierarchies, parallelism models, pipelining, and cache behavior. Specific familiarity with NVIDIA GPU architecture - streaming multiprocessors, warp scheduling, shared/global memory model, and occupancy reasoning - is essential.\n\nHands-on CUDA programming experience: writing, profiling, and optimizing GPU kernels - not just calling into CUDA-accelerated libraries. Comfortable with tools such as Nsight Compute, Nsight Systems, or equivalent profiling workflows.\n\nProven ownership of at least one end-to-end agentic system or LLM application: requirements, architecture, implementation, evaluation, and incremental hardening in production - not just experience with off-the-shelf frameworks.\n\nStrong software engineering skills in Python and one systems language (C++ preferred).\n\nProficient in tool use, RAG pipelines, and model adaptation techniques for building agentic systems.\n\nDemonstrated ability to collaborate with HW/SW domain experts and translate their heuristics into deterministic tools, constraints, and evaluation metrics.\n\nExcellence in communication and facilitation: aligning diverse collaborators, documenting decisions/assumptions,and influencing without authority.\n\nTrack record of building observability for AI systems: dataset/version management, offline test suites, online telemetry, guardrails/safety checks, and rollback plans.\n\nWays to stand out from the crowd:\nFamiliarity with the PyTorch compilation and lowering stack (torch.compile, TorchDynamo, TorchInductor, Triton, down to PTX), and with GPU graph compilers, kernel fusion strategies, or auto-tuning frameworks.\n\nBackground in performance engineering for HPC or GPU-accelerated workloads, including experience with performance modeling or hardware simulators.\n\nFamiliarity with distributed processing, multi-GPU workloads, and networking (e.g., NVLink, InfiniBand).\n\nFamiliarity with frontier agentic coding tools (e.g., Claude Code, Codex, Cursor) - understanding their underlying architecture: tool orchestration, context management, and autonomous task execution patterns.\n\nHands-on experience building a domain-specific coding agent - whether on top of frontier agentic harnesses (e.g., Claude Code, Codex SDK) or lower-level agent frameworks (e.g., LangChain/LangGraph deep agents, CrewAI). Comfortable with the design choices that make a coding agent useful in practice: task scoping, tool and context curation, evaluation, and failure recovery\n\nWidely considered to be one of the technology world's most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/","description_format":"text","description_chars":5152,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Servers & Data Center Hardware","Computer Components","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-10-16T19:06:27Z"}],"visa":[],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":1,"p_active":0.377,"p_room":0.28,"age_days":150,"expected_fill_days":33,"reasons":["conf:1","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/nvidia-senior-llm-agents-architect","json_url":"https://alion.io/job/nvidia-senior-llm-agents-architect.json","meta":{"generated_at":"2026-10-18T01:27:24Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2392,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6},"rest":"https://alion.io/mcp/rest/get_company?id=6"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnvidia-senior-llm-agents-architect"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnvidia-senior-llm-agents-architect"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnvidia-senior-llm-agents-architect"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nvidia-senior-llm-agents-architect\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnvidia-senior-llm-agents-architect"}]}