{"id":127679,"url":"https://alion.io/job/deepinfra-forward-deployed-engineer","title":"Forward Deployed Engineer","company":{"id":48033,"name":"DeepInfra","domain":"deepinfra.com","url":"https://alion.io/company/deepinfra","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Gem","truth_index":{"grade":"C","score":68,"open_postings":19,"ghost_share":0.526,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Solutions","role_family":"Solutions","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Palo Alto, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":150000,"max":195000,"currency":"USD","period":"year","gross":null,"usd_annual":195000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"InfiniBand","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"LoRA","optional":false},{"name":"NVLink","optional":false},{"name":"Python","optional":false},{"name":"Quantization","optional":false},{"name":"SGLang","optional":false},{"name":"Speech Recognition","optional":false},{"name":"Text-to-Speech","optional":false},{"name":"vLLM","optional":false},{"name":"PEFT","optional":true}],"status":"live","first_seen_at":"2026-08-14T22:33:17Z","employer_posted_date":"2026-08-14","last_verified_at":"2026-10-16T15:05:58Z","board_verified":true,"closed_at":null,"days_open":62,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":62},"description":"About DeepInfra\nDeepInfra is building the foundation for companies to use modern AI in production - simply, reliably, and at scale. Our team has deep experience building large systems that serve hundreds of millions of users, and we're bringing that same level of rigor to a rapidly evolving AI inference space. Our mission is to make advanced AI available to people and teams everywhere.\nWe're an early, tight-knit team where you can influence product direction, try bold ideas, and drive meaningful work forward quickly. If you want to join a fast-growing company at a defining moment, we'd love to talk.\nDeepInfra is backed by leading investors including A.Capital, Felicis, 500 Global, Georges Harik, Samsung Next, Supermicro, Upper90, Peak6, SVAngel and Nvidia.\nWhy this role matters\nAs DeepInfra's enterprise pipeline grows, our customers need a technical partner who can run rigorous evals, defend benchmarks, and speak fluently to both engineering and procurement - someone who can own the technical win from first call through production.\nThis is a pioneering role. You'll work closely with Sales, our co-founders, and the engineering team on the deals that matter most. You'll own the technical win end to end: running head-to-head bake-offs against leading AI providers, tuning deployments on the latest hardware, and turning what you learn into reusable assets that make every future deal faster to close. As our first FDE, you'll also define what the function looks like as GTM scales.\nWhat You'll Do\nOwn the technical win and the POC timeline, working closely with Sales and Engineering, from call one.\nDesign and run reproducible benchmark harnesses (TTFT, ITL, throughput/GPU, p95/p99) and quality-parity evals.\nRun head-to-head bake-offs against leading AI providers - and win them.\nTune model-to-hardware deployments on B200/B300/GB300 NVL72.\nBuild cost-per-token models and write migration plans.\nHandle enterprise security and compliance review, and get deployments to launch readiness.\nOwn account health post-signature, driving usage reviews and expansion.\nTurn what you learn into reusable benchmark reports, reference architectures, and AE enablement material.\nWhat You Bring\nCustomer-facing engineering with an owned technical outcome at an infrastructure or ML platform company.\nStrong Python skills.\nDual-audience presence with commercial instinct - credible with a skeptical staff engineer, clear with a CFO, and able to tell a technical objection from a procurement one.\nBonus\nHands-on experience with inference internals: vLLM, SGLang, or TRT-LLM, batching, KV cache math, quantization.\nExperience with agentic or coding-assistant workloads at scale.\nPrefix-cache-heavy long context workloads.\nDiffusion image/video, ASR/TTS, or multi-LoRA serving.\nOpen-source contributions to vLLM or SGLang.\nDeep NVLink/InfiniBand topology knowledge.\nWhy DeepInfra\nDefine DeepInfra's Forward Deployed Engineering function from day one and have a direct impact on its direction.\nWork directly with co-founders and the inference team on the deals that matter most.\nJoin a small, high-performing team where your work ships quickly and reaches customers around the world.\nHelp shape how enterprises adopt some of the world's leading open-source AI models.\nHow we work\nThree traits define the people who thrive here, and this role leans on all three.\nInitiative. We take ownership and step in where we can add value. Whether it’s starting something new, improving what exists, or helping move ideas forward, we aim to be proactive and thoughtful in how we contribute.\nDrive. We’re energized by hard problems. Building AI infrastructure is complex, and we lean into that. We care about doing things well, moving fast, and continuously improving - because solving meaningful challenges is what motivates us.\nGrit. Things don’t always work on the first try - and that’s expected. We stay persistent, adapt quickly, and learn as we go. We take setbacks seriously, but not personally, and use them to get better.\nCompensation\nThe base pay range for this role is $150,000 - $195,000 per year.","description_format":"text","description_chars":4097,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-08-14T22:33:17Z"}],"visa":[],"liveness":{"score":7,"band":"cold","label":"Long shot","p_open":1,"p_active":0.261,"p_room":0.28,"age_days":62,"expected_fill_days":26,"reasons":["conf:0","stale_co","velocity","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":{"stated_usd_annual":195000,"is_top_pay":true},"html_url":"https://alion.io/job/deepinfra-forward-deployed-engineer","json_url":"https://alion.io/job/deepinfra-forward-deployed-engineer.json","meta":{"generated_at":"2026-10-16T18:23:46Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3427,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":48033},"rest":"https://alion.io/mcp/rest/get_company?id=48033"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdeepinfra-forward-deployed-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdeepinfra-forward-deployed-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdeepinfra-forward-deployed-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/deepinfra-forward-deployed-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdeepinfra-forward-deployed-engineer"}]}