{"id":1842033,"url":"https://alion.io/job/steampunk-senior-llmops-engineer","title":"Senior LLMOps Engineer","company":{"id":3854754,"name":"Steampunk","domain":"steampunk.com","url":"https://alion.io/company/steampunk-5","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"iCIMS","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["McLean, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":145000,"max":185000,"currency":"USD","period":"year","gross":null,"usd_annual":185000},"salary_estimate":null,"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"CloudFormation","optional":false},{"name":"Docker","optional":false},{"name":"FAISS","optional":false},{"name":"FastAPI","optional":false},{"name":"Fine-tuning","optional":false},{"name":"GCP","optional":false},{"name":"Hallucination","optional":false},{"name":"Hugging Face","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangChain","optional":false},{"name":"LlamaIndex","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"LLMOps","optional":false},{"name":"Milvus","optional":false},{"name":"Pinecone","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"RAG","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Terraform","optional":false},{"name":"Transformers","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-10-04T17:11:17Z","employer_posted_date":"2026-10-04","last_verified_at":"2026-10-05T22:47:04Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Overview\nWe are looking for an experienced Senior LLMOps Engineer to design, implement, and maintain production-grade large language model (LLM) pipelines, deployment architectures, and monitoring systems across enterprise environments. The Senior LLMOps Engineer will play a critical role in operationalizing generative AI capabilities, ensuring that LLM-based applications are scalable, secure, reliable, and compliant with emerging AI risk and governance frameworks. This role spans model deployment, orchestration, evaluation, optimization, and Retrieval-Augmented Generation (RAG) pipelines.\nContributions\nArchitect, build, and maintain scalable LLM and Retrieval-Augmented Generation (RAG) pipelines, including model hosting, inference optimization, retrieval layers, and context management frameworks.\n\nLead the design and implementation of secure GenAI infrastructure across cloud environments, ensuring reliability, performance, scalability, and cost efficiency.\n\nBuild and manage automated evaluation systems that assess LLM output quality, safety, latency, and adherence to AI governance requirements.\n\nDevelop CI/CD workflows tailored for LLM- and GenAI-based applications, including dataset versioning, model lineage, and automated testing of prompt and model behaviors.\n\nCollaborate with AI Product Engineers and Data Scientists to productionize LLM-based prototypes into enterprise-grade, maintainable systems.\n\nIntegrate vector databases, model gateways, content filters, and guardrail frameworks into end-to-end LLM and RAG solutions.\n\nImplement observability and monitoring solutions that track performance metrics, hallucination rates, cost profiles, and user interaction patterns.\n\nLead troubleshooting and root-cause analysis for issues related to LLM deployment, inference performance, retrieval pipelines, or overall pipeline reliability.\n\nDevelop and maintain Python-based services, integrations, and automation supporting LLM and RAG pipelines.\n\nStay current with emerging LLM architectures, inference optimizations, fine-tuning techniques, and relevant MLSecOps patterns.\n\nEnsure compliance with data privacy, ethical AI, security, and AI governance frameworks throughout pipeline design and operations.\n\nMentor junior engineers and contribute to AI engineering best practices, tooling, and reusable infrastructure patterns.\n\nYou will contribute to the growth of our AI & Data Exploitation Practice!\n\nQualifications\nAbility to obtain and maintain a U.S. government security clearance.\n\nBachelor’s degree and 10+ years of total experience.\n\n5+ years of experience in software engineering, data engineering, MLOps, or cloud engineering, with 2+ years focused specifically on LLM or GenAI operations.\n\nHands-on experience designing, building, and maintaining Retrieval-Augmented Generation (RAG) pipelines.\n\nFluency in Python.\n\nStrong experience deploying models using frameworks such as Hugging Face Transformers, vLLM, TensorRT-LLM, or similar.\n\nExperience with operational tooling and frameworks such as FastAPI, PyTorch, LangChain, LlamaIndex, and vector databases such as FAISS, Milvus, Pinecone, or similar.\n\nAdvanced knowledge of cloud platforms such as AWS, Azure, or GCP, including model hosting, distributed compute, and secure networking patterns.\n\nHands-on experience building CI/CD pipelines, automated testing frameworks, and environment provisioning for AI/ML workloads.\n\nExperience with Docker, Kubernetes, and infrastructure-as-code tools such as Terraform or CloudFormation.\n\nFamiliarity with MLSecOps, AI governance, model hardening, prompt injection defenses, and content safety monitoring.\n\nStrong understanding of logging, observability, and performance profiling for high-throughput LLM inference systems.\n\nExcellent written and verbal communication skills, with the ability to explain trade-offs and architectural decisions to technical and non-technical stakeholders.\n\nDemonstrated ability to balance long-term platform thinking with hands-on operations and rapid problem solving.\n\nExperience working in Agile development environments and using modern project management tools.\n\nAbout steampunk\nSteampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $145,000 to $185,000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk’s total compensation package for employees. Learn more about additional Steampunk benefits here.\nIdentity Statement\nAs part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.\nSteampunk is a Change Agent in the Federal contracting industry, bringing new thinking to clients in the Homeland, Federal Civilian, Health and DoD sectors. Through our Human-Centered delivery methodology, we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. If you want to learn more about our story, visit http://www.steampunk.com.\nWe are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. Steampunk participates in the E-Verify program.","description_format":"text","description_chars":5585,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-04T17:11:17Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["conf:1","velocity","win:early","comp:brand"],"computed_at":"2026-10-05T05:45:15Z"},"pay":{"stated_usd_annual":185000,"is_top_pay":false},"html_url":"https://alion.io/job/steampunk-senior-llmops-engineer","json_url":"https://alion.io/job/steampunk-senior-llmops-engineer.json","meta":{"generated_at":"2026-10-06T00:25:22Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":502,"day_limit":5000,"remaining_today":4498,"minute_limit":60,"resets_at":"2026-10-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3854754},"rest":"https://alion.io/mcp/rest/get_company?id=3854754"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsteampunk-senior-llmops-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsteampunk-senior-llmops-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsteampunk-senior-llmops-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/steampunk-senior-llmops-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsteampunk-senior-llmops-engineer"}]}