{"id":2410679,"url":"https://alion.io/job/allspice-llm-platform-engineer","title":"LLM Platform Engineer","company":{"id":669515,"name":"AllSpice","domain":"allspice.io","url":"https://alion.io/company/allspice-2","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Boston, United States","San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":160000,"max":190000,"currency":"USD","period":"year","gross":null,"usd_annual":190000},"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"CI/CD","optional":false},{"name":"Copilot","optional":false},{"name":"Datadog","optional":false},{"name":"Git","optional":false},{"name":"Gitea","optional":false},{"name":"GitHub","optional":false},{"name":"GitHub Actions","optional":false},{"name":"GitLab","optional":false},{"name":"Grafana","optional":false},{"name":"LangChain","optional":false},{"name":"Langfuse","optional":false},{"name":"LLM","optional":false},{"name":"Looker","optional":false},{"name":"Metabase","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Pydantic AI","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"React.js","optional":false},{"name":"SQL","optional":false},{"name":"TypeScript","optional":false},{"name":"Vue.js","optional":false},{"name":"AWS","optional":true},{"name":"Docker","optional":true},{"name":"Docker Swarm","optional":true},{"name":"JavaScript","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-10-13T00:02:25Z","employer_posted_date":"2026-10-13","last_verified_at":"2026-10-13T05:00:53Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Help define the future of hardware development! At AllSpice, we're building the automation engine that powers the next generation of circuit design, enabling breakthroughs in smart vehicles, robotics, rockets, IoT, medical devices, and more.\nWe're creating the agile development environment for hardware engineers with a Git-friendly translation layer and automated CI/CD framework for native circuit designs. Think GitHub/GitLab + Copilot for electronics.\nOur mission is to bring the same modern workflows that revolutionized software: version control, automation, and collaboration to the hardware world.\nLearn more about our journey in TechCrunch and our recent Series A announcement.\nIf you're passionate about building tools that empower teams and delight customers, and you want to shape the foundation of modern hardware DevOps, we'd love to meet you!\nRead more at https://allspice.io\nWhat will you do?\nThis is a senior, high-impact software engineering role at the intersection of AI platform development, data engineering, and full-stack product development. You will own the tooling, evaluation systems, and data platforms that make AllSpice's Generative AI team more effective. Your primary users will be internal engineers and product managers, with opportunities to build customer-facing experiences where they support our AI products.\nWe’re looking for someone who can identify the right problems, make thoughtful technical decisions, and take solutions from discovery through implementation, adoption, and ongoing improvement. As you build domain knowledge and establish the AI platform foundation, we’d also like you to grow into contributing directly to AllSpice’s core product alongside the product engineering team. This is an aspirational growth opportunity, not a prerequisite or the role’s initial primary focus.\nYou will:\nPartner with engineers and product managers to discover workflow bottlenecks, prioritize the highest-impact problems, and own solutions end-to-end-from requirements and architecture to rollout and iteration.\n\nOwn the evaluation and observability layer for our AI products, including automated and human review workflows, regression detection, and comparisons across models, prompts, and pipelines. Make quality, cost, latency, usage, and customer outcomes visible and actionable.\n\nBuild usable internal applications and self-service tools that help engineers and product managers inspect AI results, investigate failures, and provide feedback. Where useful, extend these capabilities into customer-facing experiences.\n\nBuild and maintain scripts, reliable data pipelines, and integrations that connect internal systems, third-party services, LLMs, and Model Context Protocol (MCP) tools, with attention to data quality, schema evolution, and customer data privacy.\n\nWrite clear documentation and communicate findings to both technical and non-technical audiences, including leadership and customers.\n\nChampion code quality, testing, and reliability across the tooling stack through reviews, mentorship, and thoughtful design.\n\nExample Projects\nBuild an internal evaluation workspace for DRCY, our AI design review product, that captures run configurations, inputs, outputs, and telemetry; compares model and prompt changes; and tracks quality, false positives, cost, and latency over time.\n\nDevelop review workflows that let engineers and product managers inspect AI-generated findings, apply scoring rubrics, override automated scores, and investigate regressions-with opportunities to surface relevant insights and feedback workflows to customers.\n\nCreate and maintain data pipelines that aggregate evaluation results, customer feedback, and telemetry into a unified analytics layer.\n\nBuild scripting tools and automations to streamline the Gen AI team's development and testing workflows (e.g., batch evaluation runs, report generation).\n\nDesign and implement RAG-based information repositories and tooling to capture component data and domain knowledge for use by our suite of AI products.\n\nIntegrate with CI/CD systems (GitHub Actions) to surface AI insights directly in engineering workflows.\n\nPartner with infrastructure to measure cache effectiveness, usage, and cost, and use those insights to improve the reliability and efficiency of AI workflows.\n\nAs an aspirational next step, contribute directly to core AllSpice product features-for example, integrating AI review findings and feedback into existing engineering workflows-in partnership with the product engineering team.\n\nOur stack\nLanguages: Python, TypeScript/JavaScript, SQL\n\nAnalytics & Data: SQL databases (Postgres), Jupyter Notebooks, business intelligence/analytics tools\n\nAI/LLM: Langchain, Pydantic AI, Langfuse\n\nWeb: Vue/TypeScript front-end, common web architectures and APIs\n\nInfrastructure: GitHub Actions for CI/CD, Docker Swarm & Terraform, AWS\n\nOur Hub application is a soft fork of Gitea\nGo [server-side]\n\nVue/TypeScript Front-end\n\nExpectations\nOur ideal candidate should have the following:\n4+ years of software engineering experience with a focus on tooling, data platforms, or full-stack web development, with demonstrated senior-level ownership of systems or products that other people depend on.\n\nStrong SQL skills and experience designing data pipelines and storage schemas, handling data quality and schema evolution, and using data/analytics tools (e.g., Jupyter, Metabase, Looker, or similar BI platforms).\n\nProficiency in Python scripting and automation for data pipelines, integrations, and internal tools.\n\nExperience building web applications or customer-facing tools using modern frameworks (e.g., Vue, React, TypeScript).\n\nPractical experience shipping or maintaining LLM-enabled systems and building infrastructure around them, such as evaluation pipelines, observability, or integrations. You understand non-determinism, quality and reliability challenges, and tradeoffs across cost, latency, and model performance.\n\nExcellent communication skills - you can translate technical findings into clear insights for engineers, product managers, and customers alike.\n\nA customer-first mindset: you think about the end-user experience and proactively seek feedback to improve the tools you build.\n\nBachelor's degree or higher in a technology-related field, or equivalent practical experience.\n\nProject management skills with the ability to lead and collaborate with varied stakeholders to move projects forward.\n\nComfort with ambiguity and autonomy: you independently identify problems, propose solutions, make pragmatic build-vs.-buy and architectural decisions, and bring stakeholders along in a fast-moving environment.\n\n(Preferred) Availability to work out of our flex offices in San Francisco or Boston on a hybrid basis (2-3 times/week), but we are flexible for the right candidate.\n\nRelevant Skills\nYou don't necessarily have to be proficient in all of these, but the more you know, the better:\nPython, TypeScript, SQL\n\nBusiness analytics and data visualization tools\n\nLangchain, Pydantic AI, and LLM evaluation frameworks\n\nGitHub Actions development and CI/CD\n\nCommon web architectures, APIs, and front-end frameworks (Vue, React)\n\nMonitoring and observability tools (e.g., Langfuse, DataDog, Grafana)\n\nProject management and stakeholder communication\n\nBenefits\nSupportive and smart colleagues, flexible work, opportunity to make a big impact, competitive salary & equity, health, dental, vision, generous PTO, home office stipend.","description_format":"text","description_chars":7478,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity","Flexible schedule","Home office"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["CAD, PLM & BIM Software","Developer Tools"],"lifecycle":[{"event":"open","at":"2026-10-13T02:04:53Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 1","filings_12m":1,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":187500,"route":null,"cap_exempt":false,"checked_at":"2026-10-03T21:08:04+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":1}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":31,"reasons":["conf:0","win:early"],"computed_at":"2026-10-13T05:45:00Z"},"pay":{"stated_usd_annual":190000,"is_top_pay":false},"html_url":"https://alion.io/job/allspice-llm-platform-engineer","json_url":"https://alion.io/job/allspice-llm-platform-engineer.json","meta":{"generated_at":"2026-10-13T07:52:08Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11550,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":669515},"rest":"https://alion.io/mcp/rest/get_company?id=669515"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fallspice-llm-platform-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fallspice-llm-platform-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fallspice-llm-platform-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/allspice-llm-platform-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fallspice-llm-platform-engineer"}]}