{"id":738927,"url":"https://alion.io/job/montaukcap-head-of-inference-perimeter-compute","title":"Head of Inference, Perimeter Compute","company":{"id":678863,"name":"Montauk Capital","domain":"montaukcap.com","url":"https://alion.io/company/montaukcap","size_band":"201-500","is_staffing_agency":true,"is_intermediary":false,"ats_vendor":"Ashby","truth_index":{"grade":"C","score":55,"open_postings":12,"ghost_share":0.75,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-09-23T05:45:00Z"}},"role":"Leadership","role_family":"Leadership","seniority":"head","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"hiring_geo_confidence":"structured","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":194000,"max_usd":361000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1323},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"CUDA Toolkit","optional":false},{"name":"Edge AI","optional":false},{"name":"Electron","optional":false},{"name":"Kubernetes","optional":false},{"name":"KV Cache","optional":false},{"name":"Quantization","optional":false},{"name":"Ray","optional":false},{"name":"Rust","optional":false},{"name":"SGLang","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Triton","optional":false},{"name":"Triton Inference Server","optional":false},{"name":"vLLM","optional":false},{"name":"JavaScript","optional":true},{"name":"Node JS","optional":true},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-05-06T12:53:06Z","employer_posted_date":"2026-05-06","last_verified_at":"2026-09-24T04:02:04Z","board_verified":true,"closed_at":null,"days_open":140,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":140},"description":"Head of Inference\nFull Time, Remote, NYC Preferred (US Based)\nAbout Montauk Capital\nMontauk Capital builds and backs companies at the forefront of the Electron Economy, the generational shift towards electrified, intelligent technologies reshaping industries and driving unprecedented demand for energy. Our team combines deep investing acumen with decades of operating experience to give founders the strategic clarity and hands-on support that accelerates the building of enduring companies of consequence.\nAbout Perimeter Compute\nCo-founded by Montauk Capital, Perimeter Compute is a pre-seed venture specialized in modular, metro-edge AI capabilities. By leveraging existing infrastructure for inference deployment, Perimeter Compute provides low-latency, SLA-guaranteed performance across diverse GPU SKUs and colocation environments. Our technology intelligently routes traffic based on demand proximity and real-world network limitations, bypassing the heavy power and infrastructure requirements of traditional hyperscalers. Currently initiating operations with pilot nodes in NYC, we are executing a city-by-city expansion strategy with plans for a broader multi-metro rollout.\nAbout the Role\nWe are seeking a visionary and execution-oriented Head of Inference. You'll define the inference architecture, make foundational decisions, build the first POC, and own this domain end to end alongside the CEO. You will be a senior, hands-on technical leader and the technical authority on inference in the room. You’ll own the key technical decisions, and will be the internal and external expert on inference. You will own the core inference capability driving the platform and customer experience, and have a strong voice over the technical foundation of the company. You’ll evolve the vision into a viable proof of concept, building the practical system to then design and implement distributed inference systems. Alongside the CEO, you’ll represent the company with top-tier partners, early customers and investors, and will own this domain end to end. In addition to the CEO, you will have the support of a team of strong advisors, and the initial founding team.\nWhat You’ll Do\nCreate the inference strategy and define the inference architecture for Edge AI\n\nOwn the inference serving layer end-to-end: vLLM, TensorRT-LLM, Triton, or equivalent\n\nBuild a credible POC fast - proves the platform works to NVIDIA, cloud providers, and customers\n\nDrive cost-per-token optimization\n\nOptimize GPU utilization, KV-cache management, and batching for production workloads\n\nOwn observability and reliability SLAs\n\nBuild distributed inference pipelines across multi-GPU, multi-node edge deployments\n\nSet performance baselines and SLAs for inference latency and throughput, plus observability and performance SLA’s\n\nDefine quantization strategy\n\nTranslate complex inference requirements for infrastructure designs\n\nDefine the software access layer architecture and oversee integration efforts\n\nEngage credibly with investors, partners, and technical stakeholders, represent the company externally\n\nWhat You’ll Bring\nYou have a passion for inference and a background as a hands-on technical builder who has directly implemented inference systems before, ideally in production or near-production environments. Deep knowledge and are excited about model serving, and the practical engineering required to make an inference system work on real hardware. You can take a vision and initial concept and translate it into a viable POC quickly and are comfortable making foundational technical decisions quickly, in ambiguity, and building first of a kind.\nIf inference is your craft and you've built systems in production, we want to talk.\nProduction inference serving - vLLM, TensorRT-LLM, Triton Inference Server, or equivalent distributed at scale\n\nQuantization, SGLang, containerization, cost-per-token\n\nObservability tooling:distributed tracing, latency profiling, alerting. Instrument and debug complex distributed systems with a focus on building world-class observability and debuggability tools\n\nC++/CUDA/Rust\n\nGPU utilization and CUDA kernel optimization - has pushed hardware to its limits\n\nBatching, KV-cache, speculative decoding expertise\n\nScale systems using Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference\n\nHas built a serving system that NVIDIA and cloud providers respect\n\nModel deployment and serving\n\nSystems engineering\n\nTechnical leadership experience, either over teams or outcomes\n\nStartup / 0→1 DNA: You ship fast and communicate clearly\n\nWhy Join Us\nCategory-Defining Opportunity: Solving the AI inference bottleneck without the burden of power and infrastructure constraints Own the metro edge inference across heterogeneous, disparate compute nodes\n\nMassive Market Opportunity: AI spending projected to exceed hundreds of billions annually, 54GW of AI Inference demand expected by 2030\n\nStudio Support: Leverage Montauk Capital's resources, network, and operational expertise during critical early stages\n\nCompetitive compensation + equity: True ownership over what you build","description_format":"text","description_chars":5114,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-09-11T11:59:19Z"}],"liveness":{"score":3,"band":"cold","label":"Long shot","p_open":1,"p_active":0.12,"p_room":0.28,"age_days":139,"expected_fill_days":43,"reasons":["conf:0","agency","stale_co","ghost","win:tail","crowd:"],"computed_at":"2026-09-23T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/montaukcap-head-of-inference-perimeter-compute","json_url":"https://alion.io/job/montaukcap-head-of-inference-perimeter-compute.json","meta":{"generated_at":"2026-09-24T05:04:16Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers"}}