{"id":2950587,"url":"https://alion.io/job/venice-engineering-lead-inference-optimization","title":"Engineering Lead, Inference Optimization","company":{"id":719973,"name":"Venice","domain":"venice.ai","url":"https://alion.io/company/venice-2","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":170000,"max_usd":304000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":180},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"HPC","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"Mixture of Experts","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Quantization","optional":false},{"name":"Rust","optional":false},{"name":"SGLang","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"AI Agents","optional":true}],"status":"live","first_seen_at":"2026-08-20T03:09:44Z","employer_posted_date":"2026-10-20","last_verified_at":"2026-10-24T03:17:22Z","board_verified":true,"closed_at":null,"days_open":65,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":65},"description":"About Us\nVenice is the world’s leading consumer AI company built on principles of privacy, free speech, and user sovereignty. \nWe’re building the Port City of AI, in which millions of individuals, third party apps, and AI agents gather, interact, and access sophisticated AI resources on a private and permissive foundation. Our mission is to make artificial intelligence approachable and useful in everyday work-bridging the gap between cutting-edge research and practical, real-world impact.\nWe’re a fast-moving startup where every team member is expected to make a clear impact. Our culture is rooted in curiosity, ownership, ethical principle, philosophy, and collaboration-whether we’re designing better AI workflows, supporting our growing community, or shaping the future of human-AI interaction.\nJoining Venice AI means joining a team of unorthodox builders who believe in moving quickly, delivering a beautiful mass-marketand highly useful consumer product that doesn’t spy on people or censor their ideas and questions., and maintaining an edge in the rapidly evolving world of agentic machine intelligence. If you’re energized by big ideas, entrepreneurial spirit, individual empowerment, and the opportunity to help shape a fast-growing company in the world’s hottest industry from the ground up, please reach out.you’ll feel right at home here.\nWhy we are hiring\nVenice is the only AI platform that runs inference with zero data retention and zero training on user inputs. This is an opportunity for you to be on the bleeding edge of privacy-focused AI with a unique and dedicated team of high-agency individuals alongside you. This role requires both hands on work as an individual contributor as well as the management of a small team. You will play a pivotal role, shaping Venice's overarching technical strategy and assembling an exceptional team to deliver peak inference performance at massive scale.\nWhat you'll do\nOwn Venice’s technical strategy for inference performance\nRecruit and lead the Inference Optimization Team at Venice\nOptimize Venice's GPU infrastructure across a range of architectures (e.g. H200s, B300s)\nImprove latency, throughput, and cost per token for LLM inference workloads\nBuild reproducible benchmarking harnesses across inference engines (e.g. vLLM, SGLang) to identify the optimal engine, quantization scheme, and parallelism strategy per workload and GPU SKU\nWork with our inference routing system to optimize multivariate inference load-balancing algorithms\nEvaluate emerging inference optimization techniques (custom CUDA/Triton kernels), novel attention variants, new quantization schemes, and compilation stack improvements. Hands-on kernel development experience is a strong plus.\nEvaluate emerging inference hardware (FPGAs, ASICs, custom silicon) for viability in Venice's stack. \nWho you are\n8+ years in performance optimization or HPC, with deep GPU architecture and parallel programming knowledge\n5+ years experience leading engineering teams\nProficiency in Python, Rust, or Go. \nBonus: C++/CUDA\nHands-on experience with at least one production LLM inference engine (e.g. vLLM, SGLang) running at high volume in production\nDemonstrated experience with LLM inference optimization techniques: continuous batching, PagedAttention/KV cache management, speculative decoding, quantization, CUDA graphs, and torch.compile\nFluency with quantization tradeoffs, both qualitative and quantitative\nExperience with distributed inference strategies (tensor parallelism, pipeline parallelism, MoE parallelism) in multi-GPU and multi-node environments\nFluency with GPU profiling (Nsight Systems, Nsight Compute, PyTorch Profiler) and a bias toward measuring before optimizing\nBonus: diffusion/image model inference optimization, custom Triton kernels, contributions to open-source inference frameworks","description_format":"text","description_chars":3843,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","Generative Image"],"lifecycle":[{"event":"open","at":"2026-10-20T19:54:45Z"}],"visa":[],"liveness":{"score":23,"band":"cold","label":"Long shot","p_open":1,"p_active":0.648,"p_room":0.36,"age_days":64,"expected_fill_days":34,"reasons":["conf:1","velocity","win:tail","crowd:"],"computed_at":"2026-10-23T05:54:15Z"},"pay":null,"html_url":"https://alion.io/job/venice-engineering-lead-inference-optimization","json_url":"https://alion.io/job/venice-engineering-lead-inference-optimization.json","meta":{"generated_at":"2026-10-24T03:21:08Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5225,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-25T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":719973},"rest":"https://alion.io/mcp/rest/get_company?id=719973"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvenice-engineering-lead-inference-optimization"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvenice-engineering-lead-inference-optimization"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvenice-engineering-lead-inference-optimization"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/venice-engineering-lead-inference-optimization\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvenice-engineering-lead-inference-optimization"}]}