{"id":4203468,"url":"https://alion.io/job/tensordyne-senior-software-engineer-inference-performance","title":"Senior Software Engineer, Inference Performance","company":{"id":39776,"name":"Tensordyne","domain":"tensordyne.ai","url":"https://alion.io/company/tensordyne","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":83,"open_postings":25,"ghost_share":0.2,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":214,"computed_at":"2026-11-12T10:38:37Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Munich, Germany"],"countries":["DE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"C++","optional":false},{"name":"LLM","optional":false},{"name":"Mixture of Experts","optional":false},{"name":"MLIR","optional":false},{"name":"Multimodal AI","optional":false},{"name":"Python","optional":false},{"name":"Rust","optional":false},{"name":"SGLang","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false}],"status":"live","first_seen_at":"2026-11-12T18:06:37Z","employer_posted_date":"2026-11-12","last_verified_at":"2026-11-12T23:00:31Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Tensordyne \nAI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications.Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!\nThe role\nYou’ll build the software stack that takes a model from code down to the hardware: the abstractions, kernels, libraries, and tools that engineers and agents use to reach peak performance. Help optimize the latest AI models on our silicon.\nOur hardware is designed to be straightforward to program, so the goal is not to hide it. The goal is to expose the right level of control at each layer, from our compiler-driven Python SDK to our low-level Rust programming stack, and to make every performance gap measurable and every fix permanent.\nWe’re looking for a builder who understands hardware deeply and develops with agents by default. You’ll own substantial parts of one of these layers and work closely with engineers across models, compilers, runtime, and hardware. Your focus is performance: where cycles, bandwidth, and communication go, and how to win them back. Number formats and model accuracy are owned by our conversion and emulation team; you’ll partner with them where precision and speed meet.\nWhat you’ll do\nBuild the stack. Design APIs, kernel abstractions, and libraries in our Python SDK or Rust stack so model engineers and agents can reach high performance at the layer that fits their problem.\nMake models fast. Take priority workloads, from LLMs to multimodal models, to peak performance on real silicon. Profile, find the bottleneck across kernels, compiler, runtime, and parallelism, and fix it at the right layer.\nClose the gap between model and measurement. Compare measured performance against analytical models and simulation. Explain every material gap, and turn the explanation into a fix or a better model.\nBuild the agentic performance loop. Give agents the profilers, traces, counters, and benchmark harnesses to form a hypothesis, change code, and measure the result in minutes. Make the results trustworthy enough to act on.\nSet the bar for performance. Define how we measure, track regressions, and report results.\nBuild for the next chip. Design abstractions that carry forward to future hardware generations. Work with hardware architects to test how architectural choices affect real workloads.\nWhat we need from you\nYou understand hardware performance. You’ve optimized AI workloads on GPUs or custom accelerators and can reason about compute utilization, memory hierarchy, latency hiding, synchronization, and multi-chip scaling.\nYou build excellent software. You’ve owned substantial systems from design through production. You’re strong in Python and/or at least one systems language such as Rust, C++, or C, and rigorous about interfaces, abstractions, and testing. We care about engineering quality more than a specific language.\nYou understand LLM inference end to end. You can read a new model’s implementation and reason about prefill, decode, attention variants, KV caches, MoE, and parallelism, and how they map to compute, memory, and communication.\nYou build with agents. Agentic development is how you work, not an experiment. You’d rather build the loop that finds the optimization than find it by hand, and you know when the loop still needs a human.\nYou build things others succeed with. You’ve designed APIs, libraries, or performance tooling that other engineers adopted.\nYou drive problems to resolution. You form clear hypotheses, measure, and follow the evidence across software and hardware boundaries. You take ownership of the result.\nIf you hit a few of those boxes, we’d like to speak to you.\nWe’d be thrilled if you had\nExperience with embedded, bare-metal, or low-level runtime programming.\nExperience with MLIR, other compiler frameworks, or kernel DSLs such as Triton, Pallas, NKI, or CuTe.\nContributions to LLM serving stacks such as vLLM or SGLang, or a track record of taking end-to-end inference workloads to competitive performance on a hardware target.\nWhy join us\nYour code will decide how fast models run on our hardware, and how easy it is for the next engineer, or the next agent, to make them faster. You’ll own a layer of a new programming model, work directly with the people designing the hardware, and see your decisions tested on real silicon and carried into the next generation.\nTensordyne Values\nThink big. Pursue ambitious technical and business goals.\nAim for excellence. Quality matters in everything we build and deliver.\nOwn it and get it done. Take responsibility and drive results.\nOperate with integrity. Be direct, transparent, and respectful.\nWin as a team. Make the people around you more effective.\nValue different perspectives. The strongest teams challenge assumptions and bring diverse experience to difficult problems.\nTensordyne is an equal opportunity employer. We believe diverse teams are better equipped to solve complex problems and build exceptional technology. All qualified applicants will receive consideration for employment without regard to age, color, gender identity or expression, marital status, national origin, disability, protected veteran status, race, religion, pregnancy, sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances.\nA note to recruitment agencies: Please do not contact Tensordyne employees or leaders regarding this role. We do not accept unsolicited agency resumes and are not responsible for fees associated with unsolicited submissions.","description_format":"text","description_chars":6725,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"region"},{"name":"Canada","iso":"CA","kind":"region"},{"name":"Mexico","iso":"MX","kind":"region"},{"name":"Anguilla","iso":"AI","kind":"region"},{"name":"Antigua and Barbuda","iso":"AG","kind":"region"},{"name":"Aruba","iso":"AW","kind":"region"},{"name":"Bahamas","iso":"BS","kind":"region"},{"name":"Barbados","iso":"BB","kind":"region"},{"name":"Belize","iso":"BZ","kind":"region"},{"name":"Bermuda","iso":"BM","kind":"region"},{"name":"British Virgin Islands","iso":"VG","kind":"region"},{"name":"Bonaire, Sint Eustatius and Saba","iso":"BQ","kind":"region"},{"name":"Cayman Islands","iso":"KY","kind":"region"},{"name":"Costa Rica","iso":"CR","kind":"region"},{"name":"Curaçao","iso":"CW","kind":"region"},{"name":"Dominica","iso":"DM","kind":"region"},{"name":"Dominican Republic","iso":"DO","kind":"region"},{"name":"El Salvador","iso":"SV","kind":"region"},{"name":"Greenland","iso":"GL","kind":"region"},{"name":"Grenada","iso":"GD","kind":"region"},{"name":"Guadeloupe","iso":"GP","kind":"region"},{"name":"Guatemala","iso":"GT","kind":"region"},{"name":"Haiti","iso":"HT","kind":"region"},{"name":"Honduras","iso":"HN","kind":"region"},{"name":"Jamaica","iso":"JM","kind":"region"},{"name":"Martinique","iso":"MQ","kind":"region"},{"name":"Montserrat","iso":"MS","kind":"region"},{"name":"Nicaragua","iso":"NI","kind":"region"},{"name":"Panama","iso":"PA","kind":"region"},{"name":"Puerto Rico","iso":"PR","kind":"region"},{"name":"Saint Kitts and Nevis","iso":"KN","kind":"region"},{"name":"Saint Lucia","iso":"LC","kind":"region"},{"name":"Saint Vincent and the Grenadines","iso":"VC","kind":"region"},{"name":"Saint-Pierre and Miquelon","iso":"PM","kind":"region"},{"name":"Sint Maarten","iso":"SX","kind":"region"},{"name":"Trinidad and Tobago","iso":"TT","kind":"region"},{"name":"Turks and Caicos Islands","iso":"TC","kind":"region"},{"name":"United States Virgin Islands","iso":"VI","kind":"region"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","AI Compute & Inference","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-11-12T23:00:31Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":214,"reasons":["conf:1","win:early"],"computed_at":"2026-11-13T00:57:06Z"},"pay":null,"html_url":"https://alion.io/job/tensordyne-senior-software-engineer-inference-performance","json_url":"https://alion.io/job/tensordyne-senior-software-engineer-inference-performance.json","meta":{"generated_at":"2026-11-13T00:57:06Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2150,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":39776},"rest":"https://alion.io/mcp/rest/get_company?id=39776"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftensordyne-senior-software-engineer-inference-performance"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftensordyne-senior-software-engineer-inference-performance"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftensordyne-senior-software-engineer-inference-performance"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tensordyne-senior-software-engineer-inference-performance\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftensordyne-senior-software-engineer-inference-performance"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4203468}},{"tool":"search_jobs","arguments":{"company":"tensordyne.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4203468},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}