{"id":2154395,"url":"https://alion.io/job/code-metal-senior-ai-platform-engineer","title":"Senior AI Platform Engineer","company":{"id":716539,"name":"Code Metal","domain":"codemetal.ai","url":"https://alion.io/company/codemetal","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":6,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":82,"computed_at":"2026-10-12T06:55:09Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Boston, United States","San Francisco, United States","Washington, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":170000,"max":210000,"currency":"USD","period":"year","gross":null,"usd_annual":210000},"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"API Gateway","optional":false},{"name":"CI/CD","optional":false},{"name":"Context Engineering","optional":false},{"name":"Embeddings","optional":false},{"name":"Hugging Face","optional":false},{"name":"Hybrid Search","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"RAG","optional":false},{"name":"SGLang","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"vLLM","optional":false},{"name":"Fine-tuning","optional":true},{"name":"MLFlow","optional":true},{"name":"Model Context Protocol","optional":true},{"name":"Speculative Decoding","optional":true},{"name":"TensorRT","optional":true},{"name":"Weights & Biases","optional":true}],"status":"live","first_seen_at":"2026-10-09T04:02:18Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-12T17:51:18Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"About Code Metal\nCode Metal is the leader in automated software engineering you can trust. As AI writes more of the world's code, the bottleneck in software has shifted from writing code to verifying it works, and AI cannot verify its own work with certainty. Code Metal takes a fundamentally different approach: constrain AI to what it does reliably, verify every step independently of the model using formal methods, and keep engineers in the loop on the decisions that matter. The result isn't code that probably works - it's code that is provably correct, with auditable proof. Customers including the U.S. Air Force, L3Harris, RTX, and Toshiba use Code Metal to modernize legacy code, optimize performance on real hardware, and move prototypes to production, fast. Founded in 2023 with offices in Boston and San Francisco, Code Metal is funded by Accel, Salesforce Ventures, B Capital, Smith Point Capital, J2 Ventures, Shield Capital, Overmatch, RTX, and others. \nLearn more at codemetal.ai.\nThe Role\nCode Metal's engineering teams are building AI-driven code transpilation, modernization, optimization, modeling and simulation solutions. They all need the same foundations: models to serve, agents to run, context to manage, and results to measure. Our AI Platform team builds those foundations.\nAs a Senior Software Engineer on the AI Platform team, you'll design, build, and operate parts of the AI enablement stack our engineers depend on: GPU inference serving, model gateways, agent harnesses, context engineering, observability, and AI experimentation management. It is an internal platform, but we're building it to product standard.\nOver time you will own 1 area, such as model serving, agentic infrastructure, or experimentation and telemetry, while you also contribute across the rest of the stack. We don't expect you to arrive with every skill on this page.\nThis is an engineering role first. Most of your time goes to designing, building, and operating production systems. You'll also need solid data science and AI research fundamentals: you'll work closely with our Applied AI Research team, and you'll sometimes run experiments when a platform decision needs evidence.\nFocus Areas\nEach engineer on the team brings depth in at least 1 of these areas:\nModel serving: Deploy, benchmark, and tune elastic, production inference for open-weight models on runtimes such as vLLM, SGLang, and TensorRT-LLM. Run the model gateways that teams use to reach self-hosted and commercial models.\n\nAgentic infrastructure: Build agent harnesses, orchestration primitives, and context-engineering services (memory, retrieval, and data discovery) that product teams compose into reliable, verifiable workflows.\n\nObservability and experimentation: Instrument the stack end to end, for example, with OpenTelemetry traces and service metrics. Build evaluation harnesses and the experiment-tracking and artifact layer that lets engineers and researchers reproduce and compare results.\n\nCore Responsibilities\nOwn 1 or more platform components end to end, from design doc to production operation.\n\nBuild and operate the services in your focus area, and contribute across the rest of the stack.\n\nWrite clean, well-tested code, and hold AI-generated code to the same bar: correct, modular, and fully tested.\n\nDebug hard production issues in the components you own, such as tail latency, GPU memory pressure, or agent runs that fail or loop.\n\nScope and estimate efforts with internal customers, and raise risks early.\n\nReview teammates' code and designs, and help onboard new engineers.\n\nRun focused benchmarks and experiments when a platform decision needs evidence.\n\nRequired Qualifications\nProduction-grade Python and solid platform engineering fundamentals: API and service design, distributed systems, containers and orchestration (such as Kubernetes), CI/CD, and testing.\n\nProduction experience in at least 1 focus area:\nModel serving: deploying and tuning LLM inference, or running an LLM gateway or API gateway.\n\nAgentic infrastructure: shipping agentic systems, or building context-engineering services such as retrieval-augmented generation, embeddings, and vector or hybrid search.\n\nObservability and experimentation: instrumenting and operating services against SLOs, or building evaluation and experiment-tracking systems.\n\nSolid data science and AI research fundamentals: how transformers and LLM inference work, experiment design, benchmarking, and model evaluation. Working familiarity with PyTorch and Hugging Face.\n\nExperience owning a service or component in production, including debugging and improving its reliability.\n\nExperience writing design docs for focused projects, reviewing code, and mentoring or onboarding teammates.\n\nPreferred Qualifications\nExperience in more than 1 focus area.\n\nProduction experience running an LLM gateway or proxy such as SMG or Bifrost, or building an API gateway, including routing, auth, rate limiting, quotas, failover, and cost attribution.\n\nFamiliarity with inference optimization: speculative decoding, prefix caching, tensor/pipeline/expert parallelism, GPU profiling.\n\nExperience with durable workflows, agent frameworks, or tool protocols such as MCP.\n\nExperience fine-tuning language models, including distributed training across multiple GPU nodes.\n\nExperience with experiment-tracking or artifact management systems such as MLflow or Weights & Biases.\n\nExperience deploying AI systems on-prem or in regulated domains such as defense or aerospace.\n\nExperience Level\nTypically 4+ years of software engineering experience, including 2+ years building and operating ML/AI or LLM systems in production.\nBenefits\nPay depends on experience, but we strive to be at the upper end of the salary range\n\nHealth care plan with 100% premium coverage, including medical, dental, and vision\n\n401k with 5% matching\n\nPaid Time Off (uncapped vacation, plus sick and public holidays)\n\nFlexible hybrid or remote work arrangement\n\nRelocation assistance for qualifying employees\n\nWage Transparency - The salary range for this role is not a guarantee of compensation or salary, as the final offer amount may vary based on factors including, but not limited to, individual proficiency, skills, experience, and location.\nWe are an equal opportunity employer. US Citizenship may be required for certain project assignments involving security clearance.\nPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.","description_format":"text","description_chars":6529,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Relocation assistance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":true,"industries":["Embedded Software & RTOS","Code Intelligence","AI Development Tools"],"lifecycle":[{"event":"open","at":"2026-10-09T06:18:27Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":82,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-10-12T06:55:09Z"},"pay":{"stated_usd_annual":210000,"is_top_pay":true},"html_url":"https://alion.io/job/code-metal-senior-ai-platform-engineer","json_url":"https://alion.io/job/code-metal-senior-ai-platform-engineer.json","meta":{"generated_at":"2026-10-12T19:19:04Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":31300,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":716539},"rest":"https://alion.io/mcp/rest/get_company?id=716539"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcode-metal-senior-ai-platform-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcode-metal-senior-ai-platform-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcode-metal-senior-ai-platform-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/code-metal-senior-ai-platform-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcode-metal-senior-ai-platform-engineer"}]}