{"id":3592504,"url":"https://alion.io/job/tensordyne-senior-software-engineer-ml-inference-numerics","title":"Senior Software Engineer — ML Inference & Numerics","company":{"id":39776,"name":"Tensordyne","domain":"tensordyne.ai","url":"https://alion.io/company/tensordyne","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":90,"open_postings":23,"ghost_share":0,"stale_share":0.217,"repost_share":0,"time_to_fill_p50_days":214,"computed_at":"2026-11-03T05:54:40Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Munich, Germany"],"countries":["DE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":82000,"max_usd":170000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":19},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"AWS Trainium","optional":false},{"name":"Cerebras","optional":false},{"name":"Groq","optional":false},{"name":"LLM","optional":false},{"name":"Mixture of Experts","optional":false},{"name":"Multimodal AI","optional":false},{"name":"Python","optional":false},{"name":"Quantization","optional":false},{"name":"SGLang","optional":false},{"name":"TPU","optional":false},{"name":"vLLM","optional":false}],"status":"live","first_seen_at":"2026-11-01T19:09:56Z","employer_posted_date":"2026-11-01","last_verified_at":"2026-11-03T17:57:10Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"About Tensordyne \nAI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications.Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!\nThe role\nHelp make the latest AI models run well on our silicon. You’ll work from model code to measured hardware performance: bring up new architectures, track down accuracy failures, and improve latency, throughput, and memory use.\nThe bigger challenge is making that work repeatable. You’ll build an agentic harness that can explore implementations, run experiments, check results, and guide the next change. Every investigation should leave behind better software, better tests, and a shorter path for the next model.\nWe’re looking for an excellent software engineer who understands LLM inference deeply and knows how to put coding agents to work. You’ll own substantial parts of our SDK and work closely with engineers across models, compilers, runtime, and hardware. Your particular focus will be numerical optimization: finding where precision matters, where computation can be cheaper, and how to preserve model quality.\nWhat you’ll do\nBuild the agentic workflows. Give agents the tools to inspect models, change implementations and numerical settings, run emulation and hardware experiments, and diagnose failures. Build the feedback and evaluation that make the results trustworthy.\nBring up new models quickly; make them go brrrr. Work with engineers across the stack to take unfamiliar architectures from reference code to validated, performant execution on our accelerator. Turn what you learn into reusable model support and SDK improvements.\nOptimize numerics. Explore precision, accumulation, and quantization choices across the model. Understand how they interact with kernels, KV caches, memory, and distributed execution, then measure the gains in latency, throughput, and memory use against model quality on silicon.\nMake numerical quality measurable. Build conversion and emulation software that lets you test numerical choices quickly. Compare activations and outputs against reference models, trace accuracy regressions to their source, and validate changes with end-to-end model evaluations.\nShip software that lasts. Own design, implementation, testing, and delivery. Build clear APIs that are easy to use for agents. Make difficult bugs reproducible and keep them from returning. Know when to build fast, and when to build thoroughly.\nShape the next chip. Work with hardware architects to test how numerical formats and arithmetic choices affect real models. Turn those findings into better hardware and algorithm designs.\nWhat we need from you\nYou understand LLM inference end to end. You can read a new model’s implementation and reason about prefill, decode, attention, KV caches, MoE, batching, and parallelism. You understand how these translate into compute, memory, and communication on an accelerator.\nYou build excellent software. You’ve owned substantial systems and delivered complex features from design through production. You’re strong in Python, thoughtful about interfaces, and rigorous about abstractions and testing.\nYou are fluent with agentic tooling. You’d rather build the agent that runs the optimization than doing it by hand; and running numerous agents in parallel excites you. You know what is required for agents to work effectively in a large software organization, and you have the judgement when an agentic loop still needs a human.\nYou take ownership and bring others along. You form clear hypotheses, test them, and drive problems to resolution across software boundaries. You communicate clearly through specs, design docs, and reviews that people and agents can act on. You explain complex trade-offs, give direct feedback, and make the people around you better.\nIf you tick a few of these boxes, we’d love to hear from you.\nWe’d be thrilled if you had\nExpertise in improving inference systems like debugging and optimizing the runtime of complex models and reasoning about accuracy-performance trade-offs.\nExperience with ML compilers, accelerator SDKs, or model compression libraries, particularly for non-NVIDIA accelerators such as TPU, Trainium/Inferentia, Tenstorrent, Groq, or Cerebras.\nExperience with model quantization, sparsity, codebooks, low-rank factorization or other compression techniques.\nContributions to distributed inference or serving frameworks such as vLLM or SGLang.\nWhy join us\nYour code will help determine how quickly we support new models, how efficiently they run, and what we build into our next chip. You’ll own meaningful software, work directly with the people designing the hardware, and see your decisions tested on real silicon.\nIf you want to build the tools, solve the hard failures, and help set the engineering direction of a new inference platform, we’d like to hear from you.\nTensordyne's culture was built on the following values\nPut people first. We only succeed when our people succeed.\nEthics and integrity always. Be open, honest, and respectful of everyone.\nThink Big. Be ambitious and have audacious goals.\nAim for excellence. Quality and excellence count in everything we do.\nOwn it and get it done. Results matter!\nMake each person better together than they would be as an individual.\nEmbrace each other’s differences, and embrace that there will be differences.\nTensordyne is an equal opportunity employer. We believe diverse teams are better equipped to solve complex problems and build exceptional technology. All qualified applicants will receive consideration for employment without regard to age, color, gender identity or expression, marital status, national origin, disability, protected veteran status, race, religion, pregnancy, sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances.\nA note to recruitment agencies: Please do not contact Tensordyne employees or leaders regarding this role. We do not accept unsolicited agency resumes and are not responsible for fees associated with unsolicited submissions.","description_format":"text","description_chars":7267,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"region"},{"name":"Canada","iso":"CA","kind":"region"},{"name":"Mexico","iso":"MX","kind":"region"},{"name":"Anguilla","iso":"AI","kind":"region"},{"name":"Antigua and Barbuda","iso":"AG","kind":"region"},{"name":"Aruba","iso":"AW","kind":"region"},{"name":"Bahamas","iso":"BS","kind":"region"},{"name":"Barbados","iso":"BB","kind":"region"},{"name":"Belize","iso":"BZ","kind":"region"},{"name":"Bermuda","iso":"BM","kind":"region"},{"name":"British Virgin Islands","iso":"VG","kind":"region"},{"name":"Bonaire, Sint Eustatius and Saba","iso":"BQ","kind":"region"},{"name":"Cayman Islands","iso":"KY","kind":"region"},{"name":"Costa Rica","iso":"CR","kind":"region"},{"name":"Curaçao","iso":"CW","kind":"region"},{"name":"Dominica","iso":"DM","kind":"region"},{"name":"Dominican Republic","iso":"DO","kind":"region"},{"name":"El Salvador","iso":"SV","kind":"region"},{"name":"Greenland","iso":"GL","kind":"region"},{"name":"Grenada","iso":"GD","kind":"region"},{"name":"Guadeloupe","iso":"GP","kind":"region"},{"name":"Guatemala","iso":"GT","kind":"region"},{"name":"Haiti","iso":"HT","kind":"region"},{"name":"Honduras","iso":"HN","kind":"region"},{"name":"Jamaica","iso":"JM","kind":"region"},{"name":"Martinique","iso":"MQ","kind":"region"},{"name":"Montserrat","iso":"MS","kind":"region"},{"name":"Nicaragua","iso":"NI","kind":"region"},{"name":"Panama","iso":"PA","kind":"region"},{"name":"Puerto Rico","iso":"PR","kind":"region"},{"name":"Saint Kitts and Nevis","iso":"KN","kind":"region"},{"name":"Saint Lucia","iso":"LC","kind":"region"},{"name":"Saint Vincent and the Grenadines","iso":"VC","kind":"region"},{"name":"Saint-Pierre and Miquelon","iso":"PM","kind":"region"},{"name":"Sint Maarten","iso":"SX","kind":"region"},{"name":"Trinidad and Tobago","iso":"TT","kind":"region"},{"name":"Turks and Caicos Islands","iso":"TC","kind":"region"},{"name":"United States Virgin Islands","iso":"VI","kind":"region"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Processors, MCUs & AI Chips","AI Compute & Inference","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-11-01T21:26:42Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":214,"reasons":["conf:2","velocity","win:early"],"computed_at":"2026-11-03T05:54:40Z"},"pay":null,"html_url":"https://alion.io/job/tensordyne-senior-software-engineer-ml-inference-numerics","json_url":"https://alion.io/job/tensordyne-senior-software-engineer-ml-inference-numerics.json","meta":{"generated_at":"2026-11-03T22:08:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":524,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-04T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":39776},"rest":"https://alion.io/mcp/rest/get_company?id=39776"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftensordyne-senior-software-engineer-ml-inference-numerics"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftensordyne-senior-software-engineer-ml-inference-numerics"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftensordyne-senior-software-engineer-ml-inference-numerics"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tensordyne-senior-software-engineer-ml-inference-numerics\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftensordyne-senior-software-engineer-ml-inference-numerics"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3592504}},{"tool":"search_jobs","arguments":{"company":"tensordyne.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3592504},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}