{"id":2241568,"url":"https://alion.io/job/nebius-principal-ml-solutions-architect-token-factory","title":"Principal ML Solutions Architect - Token Factory","company":{"id":6364,"name":"Nebius","domain":"nebius.com","url":"https://alion.io/company/nebius","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":84,"open_postings":114,"ghost_share":0,"stale_share":0.623,"repost_share":0,"time_to_fill_p50_days":56,"computed_at":"2026-10-20T05:45:00Z"}},"role":"Solutions","role_family":"Solutions","seniority":"lead","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":208000,"max":261000,"currency":"USD","period":"year","gross":null,"usd_annual":261000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Anthropic","optional":false},{"name":"Fine-tuning","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"LoRA","optional":false},{"name":"OpenAI","optional":false},{"name":"PoC Library","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"Quantization","optional":false},{"name":"RAG","optional":false},{"name":"SFT","optional":false},{"name":"SGLang","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"vLLM","optional":false},{"name":"Amazon SageMaker","optional":true},{"name":"AWS","optional":true},{"name":"AWS Bedrock","optional":true},{"name":"Azure","optional":true},{"name":"Docker","optional":true},{"name":"GCP","optional":true},{"name":"Git","optional":true},{"name":"Kubernetes","optional":true},{"name":"Multimodal AI","optional":true},{"name":"PEFT","optional":true},{"name":"TensorRT","optional":true},{"name":"Transformers","optional":true},{"name":"Vertex AI","optional":true}],"status":"live","first_seen_at":"2026-10-09T15:17:57Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-20T15:39:50Z","board_verified":true,"closed_at":null,"days_open":11,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":11},"description":"About Nebius:\nNebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.\nBuilt by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.\nListed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.\nThe role\nThis position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning (LoRA, full FT, RFT) backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference stack.\nWe're looking for a Principal ML Solutions Architect to act as the most senior technical authority for customers leveraging Token Factory's serverless inference and fine-tuning platforms. Beyond designing and implementing optimized inference and fine-tuning workflows, you will set technical direction across our largest and most strategic accounts, own the hardest performance and quality problems end to end, mentor other Solutions Architects, and serve as a primary technical voice shaping the platform roadmap with backend, product, and research teams.\nYou’re welcome to work remotely from the United States.\nYour responsibilities will include: \nOwn the most complex, highest-stakes customer engagements from architecture through production across multiple modalities, driving measurable business value\nOptimize LLM inference at the framework and hardware level and codify the resulting best practices into reusable playbooks for the team\nLead supervised and reinforcement fine-tuning efforts to maximize model quality\nDesign and implement production-ready LLM solutions using Token Factory's inference services\nProvide deep technical expertise in prompt engineering, RAG architectures, model selection, and cost/performance trade-offs at scale\nPartner closely with product, engineering and research to surface customer needs, prototype platform features, and directly influence the roadmap\nGuide customers from PoC to production with a focus on performance, reliability, and cost efficiency - and define the standards by which the team does so\nMentor Senior and mid-level Solutions Architects; raise the technical bar of the team through review, enablement, and knowledge sharing\nRepresent Token Factory externally through talks, blog posts, and conferences\nWe expect you to have: \n8+ years of experience in ML/AI systems, with at least 4 years focused on LLMs and generative AI\nDemonstrated technical leadership: owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers\nExpert knowledge of the LLM ecosystem: model architectures, fine-tuning approaches, and inference internals\nDeep, hands-on command of inference optimization: quantization, KV-cache management, batching, routing, etc.\nHands-on experience with:Running LLMs in production at scale: deploying, operating, and debugging inference workloads down to the framework level\nLLM fine-tuning, including SFT/LoRAand data preparation/curation; experience with RL-based fine-tuning\nLLM evaluation: building task-specific benchmarks and offline/online eval pipelines, including LLM-as-a-judge setups\n Inference frameworks and libraries (vLLM, SGLang, TensorRT-LLM), including the ability to read, modify, and contribute to their internals\nDeploying LLM-powered applications using APIs from OpenAI, Anthropic, or open-source models\n\nStrong Python programming skills\nExcellent communication skills, with the ability to clearly explain technical concepts to diverse audiences, from engineers to executives\nIt would be an added bonus if you have: \nContributions or maintainership in major OSSinference/ML projects (vLLM, SGLang, TensorRT-LLM)\nPublished research, conference talks, or widely-read technical writing in the LLM/serving space\nDeep work with multimodal AI models (vision-language, speech)\nProficiency with DevOps tooling (Docker, Kubernetes) and infrastructure-as-code\nExperience building or owning internal tooling/automation for ML workflows at scale\nPreferred technical stack:\nProgramming Languages: Python\nML Frameworks and Libraries: vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs\n MLOps and DevOps tools: Kubernetes (K8s), Docker, Git\n Cloud Platforms: AWS (SageMaker, Bedrock), GCP (Vertex AI), Azure (Azure ML)\nKey Employee Benefits:\nHealth Insurance: 100% company-paid medical, dental, and vision coverage for employees and families.\n 401(k) Plan: Up to 4% company match with immediate vesting.\nParental Leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.\nRemote Work Reimbursement: Up to $85/month for mobile and internet.\nDisability & Life Insurance: Company-paid short-term, long-term, and life insurance coverage.\nPay Transparency\nWe offer competitive compensation and benefits packages. Actual compensation will be determined based on job-related factors, including experience, skills, qualifications, the level at which the candidate is hired, and geographic location, consistent with applicable law.\nBase Compensation Range\n$208,000—$261,000 USD\nBenefits & Perks:\nCompetitive compensation\nCareer growth and learning opportunities\nFlexibility and ownership\nCollaborative and innovative culture\nOpportunity to work on impactful AI projects\nInternational environment and talented teams\nWhat's it like to work at Nebius:\nFast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI \nEqual Opportunity Statement:\nNebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.\nApplicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire. \nIf you need accommodations during the application process, please let us know.","description_format":"text","description_chars":6922,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Health insurance","Insurance coverage","Life insurance","Parental leave"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Commerce","Education","Data Centers & Colocation"],"lifecycle":[{"event":"open","at":"2026-10-11T01:05:42Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":10,"expected_fill_days":56,"reasons":["conf:3","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-20T05:45:00Z"},"pay":{"stated_usd_annual":261000,"is_top_pay":true},"html_url":"https://alion.io/job/nebius-principal-ml-solutions-architect-token-factory","json_url":"https://alion.io/job/nebius-principal-ml-solutions-architect-token-factory.json","meta":{"generated_at":"2026-10-20T17:21:54Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":19872,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6364},"rest":"https://alion.io/mcp/rest/get_company?id=6364"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnebius-principal-ml-solutions-architect-token-factory"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnebius-principal-ml-solutions-architect-token-factory"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnebius-principal-ml-solutions-architect-token-factory"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nebius-principal-ml-solutions-architect-token-factory\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnebius-principal-ml-solutions-architect-token-factory"}]}