{"id":745204,"url":"https://alion.io/job/fabrion-ml-ops-engineer-agentic-ai-lab-founding-team","title":"ML Ops Engineer — Agentic AI Lab (Founding Team)","company":{"id":720009,"name":"Fabrion","domain":"fabrion.com","url":"https://alion.io/company/fabrion-2","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":75,"open_postings":7,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-04T06:34:25Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":162000,"max_usd":312000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1332},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Amazon EKS","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"ArgoCD","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Chroma","optional":false},{"name":"CI/CD","optional":false},{"name":"Dagster","optional":false},{"name":"DeepSpeed","optional":false},{"name":"Docker","optional":false},{"name":"DPO","optional":false},{"name":"FAISS","optional":false},{"name":"Falcon","optional":false},{"name":"Fine-tuning","optional":false},{"name":"FSDP","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Go","optional":false},{"name":"Google GKE","optional":false},{"name":"Grafana","optional":false},{"name":"Helm","optional":false},{"name":"HIPAA","optional":false},{"name":"Hugging Face","optional":false},{"name":"huggingface_hub","optional":false},{"name":"Keycloak","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"LangSmith","optional":false},{"name":"LlamaIndex","optional":false},{"name":"LLM","optional":false},{"name":"LLMOps","optional":false},{"name":"LoRA","optional":false},{"name":"Mistral","optional":false},{"name":"Mixtral","optional":false},{"name":"MLFlow","optional":false},{"name":"Next.js","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Prefect","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Qdrant","optional":false},{"name":"QLoRA","optional":false},{"name":"Quantization","optional":false},{"name":"RAG","optional":false},{"name":"Ray","optional":false},{"name":"Ray Serve","optional":false},{"name":"React.js","optional":false},{"name":"RLHF","optional":false},{"name":"Rust","optional":false},{"name":"SFT","optional":false},{"name":"SOC 2","optional":false},{"name":"Terraform","optional":false},{"name":"TGI","optional":false},{"name":"Triton","optional":false},{"name":"Triton Inference Server","optional":false},{"name":"vLLM","optional":false},{"name":"Weaviate","optional":false},{"name":"Weights & Biases","optional":false},{"name":"AWS","optional":true},{"name":"GCP","optional":true},{"name":"JavaScript","optional":true},{"name":"PEFT","optional":true}],"status":"live","first_seen_at":"2025-08-11T01:08:12Z","employer_posted_date":"2025-08-11","last_verified_at":"2026-11-04T14:42:04Z","board_verified":true,"closed_at":null,"days_open":450,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":450},"description":"ML Ops Engineer - Agentic AI Lab (Founding Team)\nLocation: San Francisco Bay Area\nType: Full-Time\nCompensation: Competitive salary + meaningful equity (founding tier)\nBacked by 8VC, we're building a world-class team to tackle one of the industry’s most critical infrastructure problems.\nAbout the Role\nOur AI Lab is pioneering the future of intelligent infrastructure through open-source LLMs, agent-native pipelines, retrieval-augmented generation (RAG), and knowledge-graph-grounded models.\nWe’re hiring an ML Ops Engineer to be the glue between ML research and production systems - responsible for automating the model training, deployment, versioning, and observability pipelines that power our agents and AI data fabric.\nYou’ll work across compute orchestration, GPU infrastructure, fine-tuned model lifecycle management, model governance, and security e\nResponsibilities\nBuild and maintain secure, scalable, and automated pipelines for:\n\nLLM fine-tuning, SFT, LoRA, RLHF, DPO training\n\nRAG embedding pipelines with dynamic updates\n\nModel conversion, quantization, and inference rollout\n\nManage hybrid compute infrastructure (cloud, on-prem, GPU clusters) for training and\ninference workloads using Kubernetes, Ray, and Terraform\n\nContainerize models and agents using Docker, with reproducible builds and CI/CD via\nGitHub Actions or ArgoCD\n\nImplement and enforce model governance: versioning, metadata, lineage, reproducibility,\nand evaluation capture\n\nCreate and manage evaluation and benchmarking frameworks (e.g. OpenLLM-Evals,\nRAGAS, LangSmith)\n\nIntegrate with security and access control layers (OPA, ABAC, Keycloak) to enforce\nmodel policies per tenant\n\nInstrument observability for model latency, token usage, performance metrics, error\ntracing, and drift detection\n\nSupport deployment of agentic apps with LangGraph, LangChain, and custom inference\nbackends (e.g. vLLM, TGI, Triton)\n\nDesired Experience\nModel Infrastructure:\n4+ years in MLOps, ML platform engineering, or infra-focused ML roles\n\nDeep familiarity with model lifecycle management tools: MLflow, Weights & Biases, DVC,\n\nHuggingFace Hub\n\nExperience with large model deployments (open-source LLMs preferred): LLaMA,\n\nMistral, Falcon, Mixtral\n\nComfortable with tuning libraries (HuggingFace Trainer, DeepSpeed, FSDP, QLoRA)\n\nFamiliarity with inference serving: vLLM, TGI, Ray Serve, Triton Inference Server\n\nAutomation + Infra:\nProficient with Terraform, Helm, K8s, and container orchestration\n\nExperience with CI/CD for ML (e.g. GitHub Actions + model checkpoints)\n\nManaged hybrid workloads across GPU cloud (Lambda, Modal, HuggingFace Inference,\n\nSagemaker)\n\nFamiliar with cost optimization (spot instance scaling, batch prioritization, model sharding)\n\nAgent + Data Pipeline Support:\nFamiliarity with LangChain, LangGraph, LlamaIndex or similar RAG/agent orchestration tools\nBuilt embedding pipelines for multi-source documents (PDF, JSON, CSV, HTML)\nIntegrated with vector databases (Weaviate, Qdrant, FAISS, Chroma)\nSecurity & Governance:\nImplemented model-level RBAC, usage tracking, audit trails\nIntegrated with API rate limits, tenant billing, and SLA observability\nExperience with policy-as-code systems (OPA, Rego) and access layers\nPreferred Stack\nLLM Ops: HuggingFace, DeepSpeed, MLflow, Weights & Biases, DVC\n\nInfra: Kubernetes (GKE/EKS), Ray, Terraform, Helm, GitHub Actions, ArgoCD\n\nServing: vLLM, TGI, Triton, Ray Serve\n\nPipelines: Prefect, Airflow, Dagster\n\nMonitoring: Prometheus, Grafana, OpenTelemetry, LangSmith\n\nSecurity: OPA (Rego), Keycloak, Vault\n\nLanguages: Python (primary), Bash, optionally Rust or Go for tooling\n\nMindset & Culture Fit\nBuilder's mindset with startup autonomy: you automate what slows you down\n\nObsessive about reproducibility, observability, and traceability\n\nComfortable with a hybrid team of AI researchers, DevOps, and backend engineers\n\nInterested in aligning ML systems to product delivery, not just papers\n\nBonus: experience with SOC2, HIPAA, or GovCloud-grade model operations\n\nWhat We’re Looking For\nExperience:\n5+ years as a full stack or backend engineer\n\nExperience owning and delivering production systems end-to-end\n\nPrior experience with modern frontend frameworks (React, Next.js)\n\nFamiliarity with building APIs, databases, cloud infrastructure, or deployment workflows at scale\n\nComfortable working in early-stage startups or autonomous roles, prior experience as a founder, founding engineer, or a 0-1 pre-seed startup is a big plus\n\nMindset:\nComfortable with ambiguity, eager to prototype and iterate quickly\n\nStrong sense of ownership - prefers to build systems rather than wait for tickets\n\nEnjoys thinking about architecture, performance, and tradeoffs at every level\n\nClear communicator and pragmatic team player\n\nValues equity and impact over prestige or hierarchy\n\nPrior startup or founding team experience\n\nWhy This Role Matters\nYour work will enable models and agents to be trained, evaluated, deployed, and governed at\nscale - across many tenants, models, and tasks. This is the backbone of a secure, reliable,\nand scalable AI-native enterprise system. If you dream about using AI to solve some really hard\nreal world problems - we would love to hear from you.","description_format":"text","description_chars":5208,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Industrial AI","Supply Chain AI"],"lifecycle":[{"event":"open","at":"2026-09-11T13:57:11Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 1","filings_12m":1,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":167500,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":1}],"liveness":{"score":9,"band":"cold","label":"Long shot","p_open":1,"p_active":0.304,"p_room":0.28,"age_days":450,"expected_fill_days":36,"reasons":["conf:1","urgency","win:tail","crowd:"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/fabrion-ml-ops-engineer-agentic-ai-lab-founding-team","json_url":"https://alion.io/job/fabrion-ml-ops-engineer-agentic-ai-lab-founding-team.json","meta":{"generated_at":"2026-11-04T17:22:11Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":26592,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":720009},"rest":"https://alion.io/mcp/rest/get_company?id=720009"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffabrion-ml-ops-engineer-agentic-ai-lab-founding-team"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffabrion-ml-ops-engineer-agentic-ai-lab-founding-team"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffabrion-ml-ops-engineer-agentic-ai-lab-founding-team"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/fabrion-ml-ops-engineer-agentic-ai-lab-founding-team\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffabrion-ml-ops-engineer-agentic-ai-lab-founding-team"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":745204}},{"tool":"search_jobs","arguments":{"company":"fabrion.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":745204},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}