{"id":16836,"url":"https://alion.io/job/etched-inference-software-engineer","title":"Inference Software Engineer","company":{"id":5021,"name":"Etched","domain":"etched.com","url":"https://alion.io/company/etched","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":90,"open_postings":79,"ghost_share":0.076,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":162,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Backend","role_family":"Backend","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Jose, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":175000,"max":400000,"currency":"USD","period":"year","gross":null,"usd_annual":400000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"InfiniBand","optional":false},{"name":"JAX","optional":false},{"name":"Linux","optional":false},{"name":"NVLink","optional":false},{"name":"PyTorch","optional":false},{"name":"PyTorch C++","optional":false},{"name":"Rust","optional":false},{"name":"TPU","optional":false},{"name":"Mixture of Experts","optional":true},{"name":"Transformers","optional":true}],"status":"live","first_seen_at":"2025-06-17T20:09:53Z","employer_posted_date":"2025-06-17","last_verified_at":"2026-10-16T23:10:01Z","board_verified":true,"closed_at":null,"days_open":486,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":485},"description":"About Etched\nEtched is building hardware for frontier intelligence. We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and latency across both prefill and decode workloads. Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing industry in history.\nKey responsibilities\nSupport porting state-of-the-art models to our architecture. Help build programming abstractions and testing capabilities to rapidly iterate on model porting.\n\nBuild, enhance, and scale our runtime, including multi-node inference, intra-node execution, state management, and robust error handling.\n\nOptimize routing and communication layers using our collectives.\n\nUtilize performance profiling and debugging tools to identify bottlenecks and correctness issues.\n\nYou may be a good fit if you have\nProficiency in C++ or Rust.\n\nUnderstanding of performance-sensitive or complex distributed software systems like Linux internals, accelerator architectures (e.g. GPUs, TPUs), Compilers, or high-speed interconnects (e.g. NVLink, InfiniBand).\n\nFamiliarity with PyTorch or JAX.\n\nPorted applications to non-standard accelerator hardware or hardware platforms.\n\nStrong candidates may also have experience with (Nice-to-have qualifications)\nDeveloped low-latency, high-performance applications using both kernel-level and user-space networking stacks.\n\nDeep understanding of distributed systems concepts, algorithms, and challenges, including consensus protocols, consistency models, and communication patterns.\n\nSolid grasp of Transformer architectures, particularly Mixture-of-Experts (MoE).\n\nBuilt applications with extensive SIMD (Single Instruction, Multiple Data) optimizations for performance-critical paths.\n\nBenefits\nMedical, dental, and vision packages with generous premium coverage\n$500 per month credit for waiving medical benefits\n\nHousing subsidy of $2.5k per month for those living within walking distance of the office\n\nRelocation support for those moving to San Jose (Santana Row)\n\nVarious wellness benefits covering fitness, mental health, and more\n\nDaily lunch + dinner in our office\n\nUnlimited compute budget subject to ROI justification\n\nHow we’re different\nEtched believes in the Bitter Lesson. We are the first inference-focused frontier AI system. Our addressable market is the entirety of inference, unlike many of our competitors.\nWe are a fully in-person team in San Jose (Santana Row), and greatly value engineering skills. We do not have boundaries between engineering and research, and we expect all of our technical staff to contribute to both and work across disciplines as needed.","description_format":"text","description_chars":2773,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":true,"industries":["Processors, MCUs & AI Chips","AI Compute & Inference","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2025-06-17T20:09:53Z"},{"event":"open","at":"2026-09-25T23:06:06Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 5","filings_12m":5,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":173500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.276,"p_room":0.28,"age_days":485,"expected_fill_days":162,"reasons":["conf:0","ghost","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":{"stated_usd_annual":400000,"is_top_pay":true},"html_url":"https://alion.io/job/etched-inference-software-engineer","json_url":"https://alion.io/job/etched-inference-software-engineer.json","meta":{"generated_at":"2026-10-17T00:57:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1335,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5021},"rest":"https://alion.io/mcp/rest/get_company?id=5021"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fetched-inference-software-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fetched-inference-software-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fetched-inference-software-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/etched-inference-software-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fetched-inference-software-engineer"}]}