{"id":95714,"url":"https://alion.io/job/together-senior-machine-learning-engineer-voice-ai","title":"Senior Machine Learning Engineer, Voice AI","company":{"id":36054,"name":"Together AI","domain":"together.ai","url":"https://alion.io/company/together","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":92,"open_postings":71,"ghost_share":0,"stale_share":0.31,"repost_share":0,"time_to_fill_p50_days":55,"computed_at":"2026-10-17T05:46:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":200000,"max":260000,"currency":"USD","period":"year","gross":null,"usd_annual":260000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CUDA","optional":false},{"name":"CUDA Toolkit","optional":false},{"name":"Deepgram","optional":false},{"name":"Fine-tuning","optional":false},{"name":"LLM","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"SGLang","optional":false},{"name":"Speech Recognition","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Text-to-Speech","optional":false},{"name":"Together AI","optional":false},{"name":"Tokenization","optional":false},{"name":"vLLM","optional":false},{"name":"Voice Agents","optional":false},{"name":"Whisper","optional":false},{"name":"Cursor","optional":true},{"name":"ElevenLabs","optional":true},{"name":"Pre-training","optional":true},{"name":"Reinforcement Learning","optional":true},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-03-30T19:36:00Z","employer_posted_date":"2026-09-23","last_verified_at":"2026-10-17T19:19:41Z","board_verified":true,"closed_at":null,"days_open":201,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":200},"description":"About the Role\nTogether AI is building the best inference infrastructure for voice applications. Our Voice AI platform powers production-grade, real-time voice agents and applications - serving speech-to-text and text-to-speech models with best-in-class latency and reliability.\nWe're looking for a Senior ML Engineer to drive the model serving layer for voice workloads. You'll work hands-on with inference engines like TRT-LLM and SGLang to optimize how we serve models like Whisper, Parakeet, Orpheus, and Kokoro - pushing latency and throughput to the frontier. You'll profile GPU utilization, design batching strategies for streaming audio, and ensure new model architectures can go from research to production quickly.\nThis is a foundational hire on a small, high-impact team. Voice inference has unique challenges - streaming audio, tokenization, real-time latency budgets - that require dedicated ML engineering focus. You'll shape how Together serves voice models as the industry moves from pipeline architectures (ASR → LLM → TTS) toward end-to-end speech-to-speech.\nOwn the model serving stack that powers Together's voice platform across STT, TTS, and speech-to-speech.\nWork directly with state-of-the-art accelerators (H100s, H200s, B200s) to optimize voice model inference.\nCollaborate with model partners (Cartesia, Deepgram, Rime, and others) to bring their models to production on Together's infrastructure.\nBuild quality evaluation frameworks that guide model selection for customers and inform the roadmap.\nJoin a small, early-stage team with outsized impact on a fast-growing product area.\nResponsibilities\nOptimize inference performance for voice models (STT, TTS, speech-to-speech) - targeting best-in-class TTFB, throughput, and GPU utilization across our curated model set.\nProductionize voice models on serverless and dedicated endpoints, including batching strategies, streaming inference, and memory management tailored to audio workloads.\nBuild and maintain a voice model evaluation framework - measuring WER across accents, languages, and noise conditions for STT; naturalness, latency, and pronunciation accuracy for TTS.\nEnable new model architectures in our serving stack as the field evolves, including audio-native LLMs, codec-based models (SNAC), and speech-to-speech systems.\nCollaborate with model partners to integrate and optimize their models (Cartesia, Deepgram, Rime, and others) running on Together's infrastructure.\nProfile and debug performance across the full inference stack - from GPU kernels to framework-level bottlenecks - and ship measurable improvements.\nWork with the platform engineering side of the team to ensure the serving layer meets the latency and reliability requirements of real-time voice APIs.\nContribute to voice model fine-tuning capabilities (STT and TTS) as we enable customers to build differentiated voice experiences on Together.\nLay the groundwork for multiple new products down the line.\nRequirements\n5+ years of experience in ML engineering, with a focus on model serving, inference optimization, or ML infrastructure.\nHands-on experience with LLM serving engines (vLLM, SGLang, TensorRT-LLM, or similar) - comfortable reading and modifying engine internals, not just using APIs.\nStrong proficiency in Python and PyTorch; experience with GPU profiling and optimization (CUDA, memory management, kernel-level debugging).\nTrack record of shipping ML systems to production with measurable performance improvements.\nStrong product sense - you think about what developers building voice apps actually need, not just what's technically interesting.\nComfort working on a small, early-stage team where you'll wear multiple hats and move fast.\nExperience with speech and audio ML (ASR, TTS architectures, audio signal processing) is a strong plus but not required - you can learn this quickly if you have strong ML engineering fundamentals.\nFamiliarity with audio codecs and tokenization schemes (SNAC, Encodec, DAC) is a plus.\nExperience training or fine-tuning speech models is a plus.\nBachelor's or Master's degree in Computer Science, Electrical Engineering, or related field, or equivalent practical experience\nAbout Together AI\nTogether AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.\nCompensation\nWe offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200,000 - $260,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.\nEqual Opportunity\nTogether AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.\nPlease see our privacy policy at https://www.together.ai/privacy","description_format":"text","description_chars":5427,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity","Health insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Cloud Platforms (IaaS & PaaS)","Foundation Models","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-03-30T19:36:00Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 48 · green card filings: 1","filings_12m":48,"filings_prev_12m":22,"green_card_filings_12m":1,"median_offered_wage_usd":207398,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":41}],"liveness":{"score":14,"band":"cold","label":"Long shot","p_open":1,"p_active":0.494,"p_room":0.28,"age_days":200,"expected_fill_days":55,"reasons":["conf:3","velocity","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":260000,"is_top_pay":true},"html_url":"https://alion.io/job/together-senior-machine-learning-engineer-voice-ai","json_url":"https://alion.io/job/together-senior-machine-learning-engineer-voice-ai.json","meta":{"generated_at":"2026-10-17T20:20:04Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4080,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":36054},"rest":"https://alion.io/mcp/rest/get_company?id=36054"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftogether-senior-machine-learning-engineer-voice-ai"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftogether-senior-machine-learning-engineer-voice-ai"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftogether-senior-machine-learning-engineer-voice-ai"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/together-senior-machine-learning-engineer-voice-ai\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftogether-senior-machine-learning-engineer-voice-ai"}]}