{"id":683910,"url":"https://alion.io/job/floqast-senior-devops-engineer-ai-platform","title":"Senior DevOps Engineer, AI Platform","company":{"id":673137,"name":"FloQast","domain":"floqast.com","url":"https://alion.io/company/floqast","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"A","score":86,"open_postings":27,"ghost_share":0,"stale_share":0.37,"repost_share":0,"time_to_fill_p50_days":89,"computed_at":"2026-11-04T06:34:25Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Jose, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":145000,"max_usd":279000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1332},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Amazon ECS","optional":false},{"name":"Amazon S3","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"Anthropic","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"AWS Bedrock AgentCore","optional":false},{"name":"AWS Fargate","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Copilot","optional":false},{"name":"Docker","optional":false},{"name":"FinOps","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Grafana","optional":false},{"name":"IAM","optional":false},{"name":"ISO 27001","optional":false},{"name":"KServe","optional":false},{"name":"Least Privilege","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"Node JS","optional":false},{"name":"OpenAI","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Ray Serve","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"SOC 2","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Triton","optional":false},{"name":"TypeScript","optional":false},{"name":"vLLM","optional":false},{"name":"Bazel","optional":true},{"name":"Fine-tuning","optional":true},{"name":"JavaScript","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Progressive Delivery","optional":true},{"name":"Prompt Caching","optional":true},{"name":"Ray","optional":true},{"name":"Snowflake","optional":true},{"name":"Spark","optional":true},{"name":"Turborepo","optional":true}],"status":"live","first_seen_at":"2026-08-24T14:40:44Z","employer_posted_date":"2026-08-24","last_verified_at":"2026-11-04T05:27:11Z","board_verified":true,"closed_at":null,"days_open":71,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":71},"description":"Why this role exists\nFloQast's AI products have outgrown the infrastructure patterns the rest of the platform runs on. Transform, AI Matching, and AutoBuilder are customer-facing products carrying real accounting workloads, and they behave nothing like a CRUD service. They call foundation models in multiple regions, execute generated code in sandboxes, spend money per token rather than per request, and fail in ways a 500-rate dashboard never catches.\nToday, DevOps engineers carry this work alongside the wider fleet. We are making it someone's whole job. You will embed with the Transform and Close AI pods and own the AI runtime the way our other embedded DevOps engineers own their business unit's platform.\nThis is a DevOps role with an AI infrastructure specialization, not a research or modeling role. You will not train models or tune prompts for accuracy. You will make the systems that serve them fast, observable, multi-region, cost-bounded, and auditable.\nThe products you'll support\nTransform. FloQast's data transformation and analytics product: a monorepo of containerized services on AWS, including an agentic LLM thread runtime, a natural-language-to-SQL service, and queue-driven workflow workers. You'll own the foundation-model runtime across our US, EU, and AU regions, sandbox isolation for AI-executed code, autoscaling for the worker fleet, and cost attribution for model spend.\nAI Matching. The automated reconciliation matching stack in our Close product line: LLM-backed match scoring, a matching copilot service family, and a regression harness that guards matching quality. You'll own throughput and unit economics at close-cycle peak, the sandbox for AI-generated code, and keeping the eval harness running in CI so a model or prompt change cannot ship blind.\nAutoBuilder. The Transform capability that generates transformation workflows and scripts for users instead of making them hand-build each one. You'll own generation-queue health and backpressure, triage that distinguishes a model failure from an infrastructure failure, scale-to-demand behavior for spiky load, and the latency budget for a user waiting on a generated artifact.\nWhat You'll Do:\nAI runtime infrastructure. Own our AWS Bedrock and Bedrock AgentCore footprint across US, EU, and AU: model access, provisioned versus on-demand throughput, cross-region inference, quotas and throttles, and region-appropriate model availability. Data residency drives the multi-region design as much as latency does. Define the standard way product teams call a model, retry it, budget it, log it, and trace it, so they stop hand-rolling those primitives.\nSandboxed execution. Operate the execution environments for AI-generated code, with session lifecycle limits, network controls, and least-privilege IAM.\nInfrastructure as code. Write and review Terraform across a multi-account, multi-region AWS estate. Every AI resource lands as code. Nothing is hand-made in a console.\nObservability for AI workloads. Extend our Grafana platform with the signals AI systems need: token consumption, per-model and per-region latency distributions, throttle and retry rates, tool-call failure taxonomy, sandbox session outcomes, generation success rate, and end-to-end agent traces. Define SLOs against critical user journeys, because an AI SLO that only measures HTTP health measures nothing.\nCost engineering. Treat AI spend as a first-class cost line: model inference, serving capacity, sandbox compute, and the telemetry volume these systems generate. Tag everything so per-business-unit, and ideally per-tenant, attribution shows up in our FinOps tooling.\nCI/CD and delivery. Build GitHub Actions pipelines for Node/TypeScript and Python services in NX monorepos. Make model and prompt changes releasable like code: versioned, gated on eval suites, feature-flagged, reversible. A prompt change that silently degrades matching accuracy should be caught by a pipeline, not by a customer.\nReliability and on-call. Join the DevOps on-call rotation, with runbooks you help write for AI-specific failure modes: region-wide model throttling, sandbox exhaustion, silent degradation without errors, poison messages in generation queues. Plan capacity against the accounting calendar; month-end close is the load test.\nSecurity, compliance, and tenancy. Hold the AI stack to our SOC 2 and ISO 27001/42001 evidence bar: audit logging, encryption, least-privilege access, patching, and asset inventory, for model endpoints and sandboxes too. Enforce tenant isolation on every AI path, including prompts, retrieved context, generated code, and logs.\nWhat You'll Bring:\n5+ years in DevOps, SRE, platform, or infrastructure engineering, including production systems you were on call for.\n\nDeep, hands-on AWS: ECS/Fargate, Lambda, SQS, S3, IAM, VPC and networking, ALB/NLB.\n\nTerraform at production scale: modules, state management, multi-region, multi-account.\n\nCI/CD and container ownership: GitHub Actions preferred, Docker, image supply chain, scaling policies.\n\nProduction AI infrastructure: you have operated at least one LLM-backed or ML-serving workload in production and can speak concretely about tokens, latency, throttling, and cost. Managed foundation-model APIs (Bedrock, Vertex, Azure OpenAI, Anthropic), serving platforms (SageMaker, KServe, Ray Serve, vLLM, Triton, TrueFoundry), agent or tool-execution runtimes, and eval harnesses in CI all count.\n\nObservability practice: Grafana, Prometheus, or OpenTelemetry, distributed tracing, and the judgment to define SLOs that measure user experience rather than server aliveness.\n\nWorking fluency in Python or TypeScript/Node.js, at the level of reading a service, debugging it, and sending a real PR, plus the ability to read the other.\n\nNice to have\nMulti-region infrastructure under data-residency constraints (US/EU/AU). The product requires this; prior experience with it moves you to the front of the line.\n\nAI-specific cost and performance work: token accounting, prompt caching, batching, model routing, right-sizing serving capacity.\n\nSandboxed execution of untrusted or generated code.\n\nTerraform orchestration layers (Atmos or comparable) and monorepo build systems (NX, Turborepo, Bazel).\n\nProgressive delivery with feature flags (Harness or similar).\n\nFinOps tooling (CloudZero or similar) and per-tenant cost attribution.\n\nData infrastructure exposure: MongoDB, PostgreSQL, Snowflake, EMR/Spark.\n\nAudit evidence you produced for SOC 2 / ISO 27001, or a cloud-cost reduction you delivered and can explain, including what you traded to get it.\n\nPrior work in a regulated or audited SaaS domain: fintech, accounting, healthcare.\n\nNot required\nModel training, fine-tuning, or research publications.\n\nAn accounting background. We'll teach you the domain, and you'll need enough of it to know what “wrong” looks like.\n\nA PhD or formal ML credential. Production judgment beats coursework here.\n\nWhat to Expect:\n\nThe AI stack\nModel serving: AWS Bedrock and Bedrock AgentCore across US, EU, and AU regions; TrueFoundry as the model-serving and deployment path\nSandboxed execution: AgentCore code-interpreter sessions with session lifecycle limits, network controls, and least-privilege IAM\nAI observability: Grafana AI agent observability: token spend, per-model and per-region latency, throttle and retry rates, tool-call failures, and end-to-end agent traces, tied to journey-based SLOs\nDelivery gates: model and prompt changes versioned, gated on eval and regression suites in CI (GitHub Actions), and rolled out or rolled back with Harness feature flags\nRuns on: multi-region AWS (ECS Fargate and Lambda), defined entirely in Terraform\nYour first 90 days\nDays 1-30, map and instrument. Inventory the AI runtime across all three products: regions, model dependencies, IAM posture, IaC coverage, observability gaps. Establish an honest AI cost baseline attributed by business unit. Ship one visible observability win, such as a token-spend-and-throttle dashboard.\nDays 31-60, close the highest-risk gap. Bring the multi-region model runtime fully under Terraform with no drift. Publish draft journey-based SLOs for the three products, with the pods bought in. Land one delivery-safety improvement: the matching eval suite running as a required CI gate.\nDays 61-90, make it durable. Own the model-serving path end to end: production-ready, documented, and with no single point of knowledge. Write down the AI runtime patterns and runbooks so the next team extends them instead of rebuilding. Propose the next quarter of AI infrastructure work with the reliability or cost impact attached.\nHow we'll measure success at 12 months\nThe multi-region AI runtime is production-grade: deployed and operated across US, EU, and AU, entirely in code, with no drift attributable to AI infrastructure.\n\nJourney-based SLOs are live for Transform, AI Matching, and AutoBuilder, with AI-specific signals (tokens, throttles, tool-call failures, generation success) on the dashboards leadership already reads weekly.\n\nAI spend is attributed and bounded: per-business-unit attribution, a defensible unit-cost metric, and a delivered reduction on the AI line.\n\nModel and prompt changes ship behind gates: eval suites run in CI, changes are flag-controlled and reversible, and silent accuracy regressions are caught before production.\n\nTenant isolation is enforced and evidenced on every AI path, and the AI stack clears its SOC 2 / ISO cycle with evidence ready.\n\nThe runtime patterns are documented and adopted rather than rebuilt, with no single point of knowledge.\n\nInterview process\nAbout four hours of conversation after a 30-minute recruiter screen. We move fast between stages.\nRecruiter screen (30 min). Scope, level, location, compensation.\n\nHiring manager (45 min). The AI infrastructure problem in your own words; what you've owned and what broke.\n\nTechnical deep dive (75 min). A production incident or migration you led, interrogated properly, then hands-on: read an unfamiliar Terraform module and service, diagnose a described failure, propose the change. Use your normal tooling, including AI assistants; we care about how you verify.\n\nAI infrastructure design (60 min). Design the serving, scaling, observability, and cost-control path for an LLM-backed feature under multi-region data-residency constraints. Whiteboard, no coding trivia.\n\nTeam panel (60 min). An engineering lead from Transform or Close AI, a Security or Compliance partner, and a conversation against FloQast's engineering values: Real Artists Ship; Do What Makes the Beer Taste Better; Cross the Water Then Build a Bridge; Look Before You Lock.","description_format":"text","description_chars":10646,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Financial AI","Accounting & Tax Software"],"lifecycle":[{"event":"open","at":"2026-09-10T23:57:02Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 6","filings_12m":6,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":227500,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":4}],"liveness":{"score":53,"band":"ok","label":"Likely open","p_open":1,"p_active":0.89,"p_room":0.6,"age_days":71,"expected_fill_days":89,"reasons":["conf:1","velocity","win:late","crowd:"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/floqast-senior-devops-engineer-ai-platform","json_url":"https://alion.io/job/floqast-senior-devops-engineer-ai-platform.json","meta":{"generated_at":"2026-11-04T07:10:08Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11227,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":673137},"rest":"https://alion.io/mcp/rest/get_company?id=673137"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffloqast-senior-devops-engineer-ai-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffloqast-senior-devops-engineer-ai-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffloqast-senior-devops-engineer-ai-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/floqast-senior-devops-engineer-ai-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffloqast-senior-devops-engineer-ai-platform"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":683910}},{"tool":"search_jobs","arguments":{"company":"floqast.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":683910},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}