{"id":45719,"url":"https://alion.io/job/litera-llm-ops-engineer","title":"LLM Ops Engineer","company":{"id":9081,"name":"Litera","domain":"litera.com","url":"https://alion.io/company/litera","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":90,"open_postings":16,"ghost_share":0,"stale_share":0.188,"repost_share":0,"time_to_fill_p50_days":64,"computed_at":"2026-10-01T05:45:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Denver, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":105000,"max":130000,"currency":"USD","period":"year","gross":null,"usd_annual":130000},"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Anthropic","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"Azure","optional":false},{"name":"LLM","optional":false},{"name":"LLMOps","optional":false},{"name":"OpenAI","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Python","optional":false},{"name":"Vertex AI","optional":false},{"name":"Airflow","optional":true},{"name":"Edge AI","optional":true},{"name":"Fine-tuning","optional":true},{"name":"Kubeflow","optional":true},{"name":"Kubernetes","optional":true},{"name":"MLFlow","optional":true},{"name":"RAG","optional":true}],"status":"live","first_seen_at":"2026-07-28T00:00:00Z","employer_posted_date":"2026-07-28","last_verified_at":"2026-10-01T09:59:44Z","board_verified":true,"closed_at":null,"days_open":66,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":66},"description":"Job Description\nReady to Help Shape the Future of Legal Tech?! \nAt Litera, we don’t just build software, we transform how the world’s top law firms operate. Every day, we Raise TheBar™ for what’s possible through AI, innovation, and solutions that power millions of legal professionals worldwide. If you’re energized by scale, real impact, and meaningful challenges, you’ll feel right at home here.\nWhere You’ll Work \nThis is a hybrid role based in Denver, CO with the expectations to be in office at least 3 days a week for collaboration and connection.\nWhy this Role Matters \nAt Litera, AI is becoming a critical enabler of how we build products, improve customer experiences, and drive innovation. As an LLM Ops Engineer, you will create the secure, scalable, and reliable foundation that allows our engineering teams to leverage AI confidently and efficiently across the business. Your work will ensure that AI capabilities are available, governed, cost-effective, and ready to support production applications at scale. This role is instrumental in accelerating AI adoption while maintaining the performance, security, and resilience required for enterprise software.\nWhatYou’ll Deliver\nBuild and operate a scalable AI platform that enables engineering teams to seamlessly access and deploy models across multiple providers and environments.\n\nEnsure high availability and resiliency of AI services through intelligent routing, failover strategies, and production-grade infrastructure.\n\nEstablish secure and compliant AI operations by protecting model access, safeguarding sensitive data, and enforcing governance standards.\n\nCreate a consistent developer experience through unified APIs, self-service capabilities, tooling, and best practices that accelerate AI adoption.\n\nOptimize AI platform performance, reliability, and cost efficiency through proactive monitoring, analytics, and provider strategy management.\n\nLead the evolution of Litera’s AI operations capabilities by evaluating emerging technologies and recommending scalable solutions.\n\nDeliver observability and operational excellence through dashboards, alerting, quality monitoring, and service-level metrics.\n\nSupport the safe deployment of AI solutions by implementing testing frameworks, quality controls, and production readiness standards.\n\nWe’re committed to creating an inclusive environment. If you needaccommodationsat any point in the process or in the role, we’re here to support you.\nWhat You’ll Bring\nMust-Haves:\n3+ years of experience in DevOps, Platform Engineering, MLOps, or a related field, including hands-on experience operating LLMs in production environments.\n\nExperience deploying, managing, and scaling models across multiple AI providers such as OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, or Google Vertex AI.\n\nStrong expertise in building highly available, secure infrastructure, including load balancing, failover strategies, secrets management, and access controls.\n\nExperience with API management, gateway technologies, and production-grade AI service operations.\n\nStrong Python programming skills with experience developing and supporting scalable systems.\n\nProven ability to solve complex technical challenges and thrive in a fast-paced, evolving environment while collaborating across teams.\n\nNice to Haves:\nExperience fine-tuning or training large language models for domain-specific applications.\n\nFamiliarity with ML orchestration tools and frameworks such as Kubeflow, MLflow, or Apache Airflow.\n\nExperience with LLM evaluation frameworks, retrieval-augmented generation (RAG), vector databases, or inference optimization techniques.\n\nKnowledge of infrastructure-as-code, Kubernetes, compliance frameworks, or large-scale AI cost optimization strategies.\n\nWe know great candidates don’t always check every box. If you’re excited about this role, we encourage you to apply.\nWhat You’ll Experience\nA team that shows up. Work alongside people who collaborate, support one another, and lead with integrity.\n\nGlobal Reach. Partner with teams around the world to solve complex challenges that matter.\n\nReal opportunity for growth. Expand your impact through meaningful stretch opportunities, visibility and career development.\n\nAI-driven innovation. Work at the intersection of legal technology, customer outcomes, and cutting-edge AI.\n\nPay Transparency for Colorado Applicants\nThe base salary range for this role is $105,000 to $130,000 USD. Final compensation will be determined based on experience, skills, education, and other relevant qualifications. This role is also eligible to participate in a company bonus plan.In addition to base salary, Litera offers a comprehensive benefits package, including medical, dental, and vision coverage, a 401(k) with company match, and incentive and recognition programs. Benefits are subject to eligibility requirements.\n#LI-Hybrid\nLiterais an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.","description_format":"text","description_chars":5013,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Professional Services"],"lifecycle":[{"event":"open","at":"2026-07-28T00:00:00Z"}],"liveness":{"score":32,"band":"fade","label":"Fading","p_open":1,"p_active":0.733,"p_room":0.44,"age_days":65,"expected_fill_days":64,"reasons":["conf:6","velocity","win:tail","crowd:"],"computed_at":"2026-10-01T05:45:00Z"},"pay":{"stated_usd_annual":130000,"is_top_pay":false},"html_url":"https://alion.io/job/litera-llm-ops-engineer","json_url":"https://alion.io/job/litera-llm-ops-engineer.json","meta":{"generated_at":"2026-10-02T01:14:29Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":1414,"day_limit":5000,"remaining_today":3586,"minute_limit":60,"resets_at":"2026-10-03T00:00:00Z"}}}