{"id":52899,"url":"https://alion.io/job/basecmpt-founding-ml-engineer","title":"Founding ML Engineer","company":{"id":12726,"name":"Base Compute","domain":"basecompute.co","url":"https://alion.io/company/basecmpt","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Melbourne, Australia"],"countries":["AU"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"CUDA Toolkit","optional":false},{"name":"Edge AI","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Quantization","optional":false},{"name":"ROCm","optional":false},{"name":"Rust","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"Triton","optional":false},{"name":"LLMOps","optional":true}],"status":"live","first_seen_at":"2026-07-03T06:09:50Z","employer_posted_date":"2026-07-03","last_verified_at":"2026-10-18T08:24:38Z","board_verified":true,"closed_at":null,"days_open":107,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":106},"description":"About Us\nBase Compute is an AI inference lab. Our mission is to bring AGI on device. We believe in a world where everyone has access to intelligence: fast, private and always available on your device.\nWe’re building the infrastructure for the next generation of on-device AI, from silicon-level optimizations to distributed inference systems.\nWe’re working on hard problems at the intersection of inference efficiency, model intelligence and autonomous research.\nThe Role\nWe’re looking for a Founding ML Engineer to work at the frontier of on-device AI. This role is for someone who lives at the intersection of systems engineering and machine learning, turning state-of-the-art research into hyper-optimized, production-ready infrastructure.\nYou’ll have significant ownership over our entire inference stack and direct influence on the technical bets the company makes.\nWhat You’ll Work On\nInference engine development: Building and scaling our custom inference engine, handling everything from weight loading and KV-cache management to efficient request scheduling\n\nCross-platform silicon optimization: Writing and tuning custom kernels and leveraging hardware-specific instructions to squeeze maximum performance out of diverse architectures, including Apple Silicon, NVIDIA, AMD, Snapdragon, and other edge platforms\n\nSystems architecture: Developing robust, low-latency serving runtimes in C++ to manage model routing, continuous batching, and novel decoding strategies under strict thermal and memory constraints\n\nPerformance profiling: Identifying and eliminating bottlenecks across the entire stack, from memory bandwidth ceilings to kernel interleaving\n\nWhat We’re Looking For\n3+ years of experience in ML engineering or systems programming (Rust, C/C++), with a strong track record of building performance-critical software\n\nExpertise in GPU programming and hardware optimization across various platforms (CUDA, ROCm, Metal, Triton, or similar)\n\nSolid understanding of modern LLM architectures, including parsing formats and implementing optimization techniques (quantization, speculative decoding, etc.)\n\nA strong sense of ownership and autonomy: the ability to take ambiguous architectural challenges and drive them from research translation directly into production-ready infrastructure\n\nGood communication: the ability to explain complex architectural decisions simply, give honest feedback and document systems cleanly\n\nNice-to-haves:\nFamiliarity with ML compilers (torch.compile, custom operators)\n\nExperience with low-precision inference (INT8/FP8/FP4)\n\nKnowledge of Edge LLMOps\n\nWhat We Offer\nFounding team equity and strong base salary\n\nDirect influence on technical direction: your ideas will shape the roadmap\n\nWork on genuinely hard problems that haven't been solved yet\n\nSmall team, fast iteration, low bureaucracy\n\nLocation\nThe team is based in Melbourne and Berlin and works in-person from the office most days. We require strong written and spoken English, since the team collaborates across time zones.","description_format":"text","description_chars":3029,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Machine Learning","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-07-03T06:09:50Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.276,"p_room":0.28,"age_days":105,"expected_fill_days":21,"reasons":["conf:2","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/basecmpt-founding-ml-engineer","json_url":"https://alion.io/job/basecmpt-founding-ml-engineer.json","meta":{"generated_at":"2026-10-18T09:49:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14485,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":12726},"rest":"https://alion.io/mcp/rest/get_company?id=12726"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbasecmpt-founding-ml-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbasecmpt-founding-ml-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbasecmpt-founding-ml-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/basecmpt-founding-ml-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbasecmpt-founding-ml-engineer"}]}