428,619open jobs
14,643companies
61,484added this week
Browse all
Salary
$152k – $313k per year (Estimated)
Location
Remote/Hybrid (United Kingdom)
Seniority
Architect · 5+ years exp
Overview
Company
Impact
Profile match
Headquartered in Vista, California, United States, NewRocket is an IT consulting and software services firm specializing in digital transformation and workflow automation. As an Elite ServiceNow partner, the company provides strategic advisory, human-centered UI/UX design, custom software implementation, platform optimization, and managed IT services.

AI Platform Engineer-Anthropic

AI Foundry | NewRocket

Location: [Location / Hybrid / Remote]

Travel based on client and business needs

Reports to: Global AI Center of Excellence Lead / AI Platform Architect

About NewRocket

NewRocket is the AI-first Elite ServiceNow Partner that activates real value on the Now Platform. As a trusted advisor to enterprise leaders, we combine industry expertise, human-centered design, and enterprise-grade AI to help organizations navigate change and scale with confidence.

With two decades of experience guiding clients to realize the full potential of the ServiceNow AI Platform, NewRocket is one of the largest pure-play ServiceNow partners. We are uniquely focused on enabling enterprises to adopt AI they trust-AI that delivers lasting business value.

NewRocket is proud to be an Anthropic partner/vendor. Through this relationship, we are expanding our ability to help enterprise clients responsibly design, deploy, and scale AI solutions powered by Claude and other leading AI technologies. Our AI Foundry teams apply Anthropic-aligned practices across prompt and context engineering, retrieval-augmented generation (RAG), agentic workflows, tool use, structured outputs, model evaluation, security, governance, and human-in-the-loop controls.

We #GoBeyondWorkflows to create new kinds of experiences for our customers.

Come join our Crew!

Role Overview

NewRocket is seeking an experienced AI Platform Engineer to build, operate, and continuously improve the technical foundations that enable secure, reliable, scalable enterprise AI solutions.

This role combines cloud engineering, platform engineering, DevOps, MLOps/LLMOps, data-platform integration, and applied AI engineering. The AI Platform Engineer will work closely with AI Architects, Forward Deployed AI Engineers, data engineers, ServiceNow teams, product engineering, and customer stakeholders to create reusable platforms, deployment patterns, controls, and operational capabilities for NewRocket’s Anthropic and enterprise AI business.

You will help establish the infrastructure and engineering practices required to move AI solutions from prototype to governed production use. This includes enabling Claude and other LLM-powered applications; supporting RAG and agentic workflows; integrating enterprise data and tools; implementing observability and evaluation; and maintaining strong security, privacy, and governance controls.

The ideal candidate is a hands-on engineer who is comfortable working across cloud infrastructure, APIs, CI/CD, data systems, containers, AI application frameworks, and enterprise security requirements. You are equally motivated by building reusable internal capabilities and solving practical customer-delivery challenges.

Key Responsibilities

AI Platform Architecture & Engineering

  • Design, build, deploy, and maintain scalable platform capabilities that support enterprise AI, machine learning, LLM, RAG, and agentic AI applications.
  • Create reusable reference architectures, infrastructure patterns, deployment templates, integration components, and engineering standards for NewRocket’s AI Foundry.
  • Build platform capabilities that enable AI applications to securely connect to enterprise data, APIs, workflow systems, and authorized tools.
  • Partner with AI Architects and Forward Deployed AI Engineers to translate client needs into reliable, supportable technical platform designs.
  • Support the technical evolution of NewRocket’s AI intellectual property, including the NewRocket Intelligence Platform, Data Intelligence Platform, Value Realization Dashboard, Agent Packs, and reusable AI accelerators.
  • Evaluate and recommend cloud, data, AI, observability, orchestration, and security technologies that improve delivery speed, quality, scalability, and cost efficiency.

Anthropic, Claude & LLM Platform Enablement

  • Build and maintain secure, reusable integrations with the Anthropic API, Claude models, and other approved AI services.
  • Enable LLM-powered applications through standardized patterns for authentication, model access, prompt and context management, structured outputs, tool use, logging, error handling, and rate-limit management.
  • Support Claude-based enterprise use cases involving document analysis, knowledge assistance, workflow automation, agentic task execution, summarization, classification, and decision support.
  • Develop technical patterns for long-context workflows, document processing, RAG, structured data extraction, and model-driven automation.
  • Support secure Model Context Protocol (MCP) and comparable tool-integration patterns that allow AI applications to access approved enterprise systems and data safely.
  • Stay current on Anthropic platform capabilities, product releases, security guidance, technical enablement, and responsible AI practices.
  • Complete relevant Anthropic partner training and enablement as available and help translate learning into reusable NewRocket engineering standards.

LLMOps, MLOps & AI Operations

  • Establish and operate CI/CD pipelines for AI applications, model configurations, prompts, evaluation assets, infrastructure, and integration services.
  • Implement versioning, testing, release-management, rollback, and change-control practices for AI solutions.
  • Build and maintain LLMOps and MLOps capabilities, including model/prompt configuration management, evaluation pipelines, deployment automation, monitoring, and lifecycle management.
  • Develop automated evaluation and regression-testing frameworks to measure AI quality before and after releases.
  • Support production operations for AI services, including incident response, troubleshooting, root-cause analysis, capacity planning, and service-level monitoring.
  • Define and monitor operational metrics such as availability, latency, throughput, token consumption, model cost, tool-call success rates, task-completion rates, and error rates.
  • Improve platform reliability, performance, resilience, and cost efficiency through automation, tuning, and operational improvements.

Cloud Infrastructure, DevOps & Security

  • Design and manage cloud infrastructure across AWS, Microsoft Azure, Google Cloud Platform, or client-approved environments.
  • Build and maintain infrastructure using infrastructure-as-code tools such as Terraform, CloudFormation, Bicep, Pulumi, or comparable technologies.
  • Implement containerized application and AI-service deployments using Docker, Kubernetes, serverless services, and cloud-native application patterns.
  • Develop secure CI/CD workflows using Git-based source control, automated testing, artifact management, secrets management, and policy controls.
  • Implement identity, access, and authentication patterns, including role-based access control, least-privilege access, API security, service accounts, and credential rotation.
  • Partner with security, compliance, and client teams to ensure AI platforms align with enterprise security, privacy, regulatory, and data-residency requirements.
  • Implement logging, monitoring, auditing, vulnerability management, disaster-recovery, and business-continuity practices for production AI services.

Data Platform & RAG Enablement

  • Build and support secure data-ingestion, transformation, indexing, and retrieval pipelines for enterprise AI applications.
  • Design platform patterns for RAG, including document ingestion, parsing, chunking, metadata enrichment, embeddings, vector stores, hybrid search, retrieval, reranking, and source attribution.
  • Integrate AI applications with structured and unstructured enterprise data sources, including databases, data warehouses, document repositories, knowledge bases, ServiceNow, and third-party SaaS platforms.
  • Work with data engineers to establish data-quality, lineage, cataloging, permissions, retention, and governance practices that support trustworthy AI.
  • Enable appropriate data-access controls so AI solutions retrieve and process only data the requesting user or service is authorized to access.
  • Support data platforms and technologies such as Snowflake, Databricks, PostgreSQL, MongoDB, Elasticsearch/OpenSearch, vector databases, and cloud storage services, as appropriate.

Responsible AI, Governance & Observability

  • Implement technical controls that support responsible, secure, and governable AI deployments.
  • Build safeguards for sensitive-data handling, data masking, content filtering, prompt injection, unsafe tool use, unauthorized access, and unintended agent behavior.
  • Enable grounding, output validation, source attribution, confidence thresholds, fallback behavior, approval gates, and human-in-the-loop workflows.
  • Implement AI observability and tracing across prompts, model calls, retrieval pipelines, tool execution, workflow outcomes, latency, errors, costs, and user feedback.
  • Partner with AI Architects and governance stakeholders to document platform standards, risk controls, operating procedures, and solution limitations.
  • Support auditability and compliance requirements through appropriate logging, retention, access reviews, and operational documentation.

Enterprise Integration & ServiceNow Enablement

  • Build and maintain integration patterns between AI platforms, ServiceNow, enterprise APIs, identity providers, workflow tools, collaboration platforms, and line-of-business systems.
  • Support technical enablement for ServiceNow AI and workflow experiences, including IntegrationHub, Flow Designer, Virtual Agent, Now Assist, AI Agents, APIs, and knowledge-management capabilities where applicable.
  • Develop secure APIs, middleware services, event-driven integrations, and automation components that support AI-enabled workflows.
  • Collaborate with Forward Deployed AI Engineers to troubleshoot complex client integrations and transition successful engagement solutions into reusable platform components.

Collaboration & Technical Leadership

  • Work closely with AI Architects, AI/ML Engineers, Data Engineers, Product Engineering, ServiceNow developers, Business Process Consultants, and client technology teams.
  • Provide technical guidance on AI platform engineering, cloud architecture, DevOps, LLMOps, data integration, performance, and security best practices.
  • Contribute to internal playbooks, runbooks, reference architectures, technical documentation, reusable modules, and knowledge-sharing sessions.
  • Identify recurring client requirements and convert them into scalable, productized platform features and accelerators.
  • Participate in technical discovery, architecture reviews, demos, implementation planning, and customer workshops as needed.

What Success Looks Like in the First 6 Months

  • Establish or enhance reusable, secure deployment patterns for Claude-powered and other enterprise AI applications.
  • Deliver reliable cloud, integration, data, and observability capabilities that support multiple AI Foundry client engagements.
  • Implement CI/CD, infrastructure-as-code, monitoring, and LLMOps practices that improve deployment speed, quality, and operational maturity.
  • Enable secure RAG, tool-use, and agentic AI patterns that integrate effectively with ServiceNow and enterprise ecosystems.
  • Help productionize AI solutions through robust testing, evaluation, governance, access controls, and operational support practices.
  • Contribute reusable platform components, reference architectures, and playbooks to the NewRocket Intelligence Platform, Data Intelligence Platform, and Agent Pack ecosystem.
  • Build trusted working relationships across NewRocket engineering, delivery, product, AI, and client teams.

Required Qualifications

  • 5+ years of experience in platform engineering, cloud engineering, DevOps, software engineering, data engineering, systems integration, or related technical roles.
  • Hands-on experience designing and deploying cloud-native applications and services on AWS, Microsoft Azure, and/or Google Cloud Platform.
  • Strong experience with CI/CD, Git-based workflows, automated testing, infrastructure as code, and production release processes.
  • Experience with containerization and orchestration technologies such as Docker, Kubernetes, serverless services, or comparable cloud-native platforms.
  • Proficiency in Python, JavaScript/TypeScript, Java, Go, Bash, or similar programming and scripting languages.
  • Experience designing and consuming REST APIs, integrating enterprise applications, and implementing authentication and authorization patterns.
  • Hands-on experience with LLM-powered applications, generative AI services, AI/ML platforms, RAG systems, AI workflow automation, or related technologies.
  • Familiarity with LLM application concepts, including prompt and context engineering, token management, embeddings, vector search, RAG, structured outputs, tool use/function calling, evaluations, and model monitoring.
  • Experience with observability tools and practices, including logging, metrics, tracing, alerting, and incident management.
  • Strong knowledge of cloud security, identity and access management, secrets management, network security, and secure software-development practices.
  • Experience working with data systems such as relational databases, NoSQL databases, data warehouses, object storage, search platforms, or vector databases.
  • Strong problem-solving, troubleshooting, communication, and documentation skills.
  • Ability to work effectively in a fast-paced, collaborative, customer-oriented environment.

Preferred Qualifications

Anthropic & AI Platform Experience

  • Hands-on experience with Claude, the Anthropic API, Anthropic Console, Claude Code, or Anthropic technical guidance.
  • Completion of Anthropic Academy learning, partner enablement, technical training, or equivalent Claude implementation experience.
  • Experience with Model Context Protocol (MCP), secure tool integrations, agent gateways, or comparable methods for connecting AI applications to enterprise systems.
  • Experience with LLM application frameworks and orchestration tools such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, OpenAI Agents SDK, or comparable technologies.
  • Experience implementing LLM evaluation, prompt/version management, AI tracing, guardrails, and AI observability platforms.
  • Experience operating model gateways, API gateways, or AI-service routing layers.

MLOps, Data & Cloud Engineering

  • Experience with MLOps platforms and tools such as MLflow, SageMaker, Vertex AI, Azure Machine Learning, Databricks, Kubeflow, or comparable services.
  • Experience with data engineering, ETL/ELT, streaming, data orchestration, data-quality testing, data governance, and data-catalog capabilities.
  • Experience with vector databases and enterprise search technologies such as Pinecone, Weaviate, pgvector, OpenSearch, Elasticsearch, Azure AI Search, or similar platforms.
  • Experience with Terraform, Pulumi, CloudFormation, Bicep, Helm, Argo CD, GitHub Actions, GitLab CI/CD, Azure DevOps, Jenkins, or comparable tooling.
  • Experience with Kubernetes operations, service meshes, API management, event-driven architecture, and microservices.
  • Familiarity with FinOps practices and optimization of cloud, model, inference, storage, and data-processing costs.

ServiceNow & Enterprise Delivery

  • Experience with ServiceNow architecture, development, integrations, platform operations, or workflow automation.
  • Familiarity with ServiceNow APIs, IntegrationHub, Flow Designer, Virtual Agent, Now Assist, AI Agents, CMDB, knowledge management, and enterprise data-integration patterns.
  • Experience working in consulting, professional services, enterprise architecture, or client-facing technical delivery environments.

Education

  • Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical discipline; equivalent relevant professional experience will be considered.
  • Relevant certifications in cloud platforms, Kubernetes, DevOps, security, data engineering, ServiceNow, AI/ML, or Anthropic technologies are a plus.

Why This Role Matters

The AI Platform Engineer provides the technical backbone for NewRocket’s AI Foundry and Anthropic business. This role makes it possible for our teams and customers to move beyond isolated AI experiments and into secure, scalable, observable, and governed production solutions.

By creating reusable platforms and engineering standards for Claude-powered AI, agentic workflows, enterprise data access, ServiceNow integrations, and responsible AI operations, you will help NewRocket deliver lasting business value-and scale trusted AI adoption across our clients.

We Take Care of Our People

NewRocket is committed to a diverse and inclusive workplace. We value and celebrate diversity, believing that every employee matters and should be respected and heard. We are proud to be an equal opportunity workplace and affirmative action employer, committed to providing employment opportunity regardless of sex, race, creed, color, gender, religion, marital status, domestic partner status, age, national origin, or ancestry, physical or mental disability, medical condition, sexual orientation, pregnancy, citizenship, military, or Veteran status. For individuals with disabilities who would like to request an accommodation, please contact  [email protected].

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
428,619 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$132k – $212k per year • Remote/Hybrid • Full-Time • Bachelor's Degree • Arlington
JavaScript
Java
TypeScript
SQL
Java
Spring Boot
Databases
PostgreSQL
Oracle
Frontend
Angular
DevOps
CI/CD
Git
Platform Engineering
Twelve-Factor App
Apply
$208k – $305k per year • Equity • Remote/Hybrid • Full-Time • 10+ years exp • United States
Python
JavaScript
SQL
Node JS
Databases
Weaviate
Pinecone
AI/ML
LangGraph
LangChain
LlamaIndex
Fine-tuning
RLHF
Prompt Engineering
Knowledge Distillation
Function Calling
AI Agents
Haystack
CrewAI
LLM
RAG
InfiniBand
Knowledge Graph
Multi-Agent Systems
Tool Use
Model Distillation
Frontend
Vue.js
React.js
DevOps
VMWare
CI/CD
Docker
Kubernetes
Platform Engineering
OpenStack
Vector
Analytics
ETL/ELT
Apply
$13k – $37k per year (Estimated) • In office • 3+ years exp • Bengaluru
JavaScript
TypeScript
SQL
AI/ML
Copilot
Cursor
Claude
Prompt Engineering
LLM
Anomaly Detection
LLM Guardrails
DevOps
GitHub Actions
Kibana
CI/CD
Jenkins
Docker
Kubernetes
Grafana
Self-Healing
GitHub
QA
JMeter
Playwright
k6
SoapUI
Apply
AI Engineer 1 day ago
$23k – $62k per year (Estimated) • In office • 3+ years exp • Bengaluru
Python
TypeScript
AI/ML
Function Calling
LLM
RAG
LLM Evaluation
Tool Use
Apply
$62k – $74k per year • In office • Full-Time • Des Moines • Cedar Rapids
Python
Java
PHP
SQL
Perl
Java
Apache Tomcat
Databases
MySQL
Db2
Oracle
MS SQL
DevOps
Kali Linux
Apache HTTP Server
Cybersecurity
Metasploit
Nessus
Diamond Model
Apply
$80k – $191k per year (Estimated) • Remote • 8+ years exp
Python
JavaScript
TypeScript
SQL
AI/ML
LangGraph
LangChain
Claude
Claude Code
LlamaIndex
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
Semantic Kernel
LLM
RAG
Hallucination
Semantic Search
Anthropic
Human-in-the-Loop
Structured Outputs
Context Engineering
Semantic Search
Agentic Workflows
Tool Use
DevOps
GCP
Azure
CI/CD
Git
AWS
Docker
Vector
Management
ServiceNow
Apply
$96k – $197k per year (Estimated) • Remote • 5+ years exp
Python
JavaScript
TypeScript
SQL
AI/ML
LangGraph
LangChain
Claude
Claude Code
LlamaIndex
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
Semantic Kernel
LLM
RAG
Hallucination
Semantic Search
Anthropic
Human-in-the-Loop
Structured Outputs
Context Engineering
Semantic Search
Agentic Workflows
Tool Use
DevOps
GCP
Azure
CI/CD
Git
AWS
Docker
Vector
Management
ServiceNow
Apply
$34k – $85k per year (Estimated) • Remote • 3+ years exp • Bachelor's Degree
Python
SQL
Databases
MySQL
PostgreSQL
Snowflake
AI/ML
Spark
Vertex AI
Fine-tuning
Scikit-learn
AI Agents
NLP
TensorFlow
Pandas
NumPy
PyTorch
BERT
Sentiment Analysis
Hugging Face
Amazon SageMaker
DevOps
GCP
Azure
AWS
AWS Lambda
Amazon S3
Analytics
Tableau
Power BI
Matplotlib
ETL/ELT
Management
ServiceNow
Microsoft Teams
Apply
$97k – $226k per year (Estimated) • Remote/Hybrid • Freelance • 1+ year exp
Python
JavaScript
TypeScript
SQL
AI/ML
LangGraph
LangChain
Claude
LlamaIndex
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
LLM
RAG
Anthropic
Human-in-the-Loop
Structured Outputs
Context Engineering
Agentic Workflows
Tool Use
DevOps
Rest API
GCP
Azure
Git
AWS
Docker
Management
ServiceNow
Apply
$141k – $247k per year (Estimated) • Remote • 5+ years exp
Python
JavaScript
TypeScript
SQL
AI/ML
LangGraph
LangChain
Claude
Claude Code
LlamaIndex
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
Semantic Kernel
LLM
RAG
Hallucination
Semantic Search
Anthropic
Human-in-the-Loop
Structured Outputs
Context Engineering
Semantic Search
Agentic Workflows
Tool Use
DevOps
GCP
Azure
CI/CD
Git
AWS
Docker
Vector
Management
ServiceNow
Apply
See all jobs
This is one of many
428,619 more open roles from verified company boards, updated every day.