1,813,263open jobs
104,194companies
275,393added this week
Browse all
Salary
$105k – $182k per year
Location
Hybrid (Jersey City, United States)
Seniority
Middle · 3+ years exp
Visa
H-1B filings in 12 months: 399 · for this role: 54 · green card filings: 60
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 17, 2026. First seen by Alion on Oct 9, 2026. NTT DATA scores B on the Alion truth index.

Overview
Company
Impact
Profile match
NTT DATA is a Tokyo system integrator founded in 1988 that spun out of the data communications arm of NTT. It is one of the largest information technology services firms in the world, building banking, public sector and payment systems and operating global consulting and managed services. The company runs the CAFIS payment network used across Japanese retail and banking.

Req ID: 382110

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Prompt Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).

Prompt Engineer

LLM Interaction Design / Prompt Optimization / GenAI Application Quality

Role purpose

Design, test, govern, and continuously improve prompts, system instructions, conversation flows, and interaction patterns for AIRP LLM applications and related citizen-development experiences. The role ensures model outputs are accurate, grounded, safe, consistent, cost-aware, and aligned with business and compliance expectations.

Client-specific emphasis

  • Prompt work must support enterprise business use cases, not generic chatbot experimentation.
  • Reusable prompt patterns should be suitable for AIRP and, where applicable, Copilot Studio / Power Platform citizen-development scenarios.
  • Candidates must understand prompt security, sensitive data handling, citations/grounding, and structured evaluation.

Primary ownership

  • Prompt patterns, system instructions, response templates, and conversation policies for AIRP LLM use cases.
  • Prompt testing, versioning, evaluation, and quality-improvement workflows.
  • Reusable prompt libraries and guardrail patterns for business teams and responsible citizen development where applicable.

Key responsibilities

  • Design prompts for chatbots, copilots, RAG systems, document analysis, summarization, workflow agents, knowledge assistants, and decision-support experiences.
  • Develop system prompts, few-shot examples, tool-use instructions, response formats, escalation logic, citation behavior, and conversation policies.
  • Optimize prompts for KYC support, credit underwriting support, governance tracking, pitch book generation, Banker 360, Customer 360, deal library intelligence, financial crime quality, and sanctions screening use cases.
  • Build reusable prompt libraries and templates aligned to enterprise standards, business domains, AIRP patterns, and citizen-development guardrails.
  • Evaluate prompt performance using metrics such as task success, groundedness, hallucination rate, completeness, safety, user satisfaction, latency, and token cost.
  • Partner with engineers to implement prompt versioning, testing, deployment, and monitoring in production systems and CI/CD workflows.
  • Support RAG quality by assessing retrieval context, chunking quality, source citation behavior, response synthesis, and missing-context behavior.
  • Conduct adversarial testing for prompt injection, jailbreaks, instruction conflicts, sensitive-data leakage, unsafe outputs, and unauthorized tool use.

Basic Qualifications:

  • 3+ years of experience with LLM behavior, prompt design, tokenization, context windows, RAG, embeddings, and model limitations.
  • 3+ years of experience experience with OpenAI APIs, Azure OpenAI, AWS Bedrock, Anthropic, LangChain, LlamaIndex, Semantic Kernel, Copilot Studio, or similar platforms.
  • 3+ years of experience debugging LLM outputs using structured testing, error analysis, and iterative refinement.
  • 3+ years of experience with prompt-security risks including prompt injection, jailbreaks, data leakage, hallucination, and instruction conflicts.
  • 3+ years of experience creating repeatable prompt templates and evaluation evidence suitable for enterprise governance.

Preferred experience

  • Strong writing, analytical, communication, and stakeholder-management skills.
  • Background in NLP, conversational AI, UX writing, technical writing, product design, knowledge management, business analysis, or financial-services operations.
  • Experience in financial services, legal, compliance, risk, operations, customer support, banker productivity, or enterprise knowledge domains.
  • Familiarity with Microsoft Copilot Studio, Power Platform, prompt registries, A/B testing, human review workflows, and evaluation tooling.

NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $104,904 - $182,125 per year. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications. This position may also be eligible for incentive compensation based on individual and/or company performance.

This position is eligible for company benefits including medical, dental, and vision insurance with an employer contribution, flexible spending or health savings account, life and AD&D insurance, short and long term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally-required benefits.

#LI-NorthAmerica, #DataFID

About NTT DATA

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.

Whenever possible, we hire locally to NTT DATA offices or client sites. This ensures we can provide timely and effective support tailored to each client’s needs. While many positions offer remote or hybrid work options, these arrangements are subject to change based on client requirements. For employees near an NTT DATA office or client site, in-office attendance may be required for meetings or events, depending on business needs. At NTT DATA, we are committed to staying flexible and meeting the evolving needs of both our clients and employees. NTT DATA recruiters will never ask for payment or banking information and will only use @nttdata.com, @nttdatafed.com and @talent.nttdataservices.com email addresses. If you are requested to provide payment or disclose banking information, please submit a contact us form, https://us.nttdata.com/en/contact-us.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,813,263 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
Jersey City
$150k – $250k per year • In office • Full-Time • 3+ years exp • PhD • San Francisco
Python
AI/ML
Reinforcement Learning
TensorFlow
PyTorch
SFT
Post-training
Machine Learning
Apply
$200k – $300k per year • In office • Full-Time • 5+ years exp • Bachelor's Degree • San Francisco
Python
Python
FastAPI
Databases
PostgreSQL
AI/ML
Embeddings
NLP
RAG
Machine Learning
Apply
$200k – $320k per year • Remote (United States) • Full-Time
TypeScript
AI/ML
RAG
Machine Learning
Apply
$192k – $305k per year • In office • Full-Time • 4+ years exp • PhD • Westford • Santa Clara
Python
C++
AI/ML
CUDA Toolkit
CUDA
Apply
$192k – $305k per year • In office • Full-Time • 5+ years exp • PhD • Santa Clara • Champaign • Seattle
Python
C++
AI/ML
CUDA Toolkit
CUDA
Recommender Systems
DevOps
HPC
Apply
In office • Almaty
Python
JavaScript
TypeScript
SQL
1C
Python
FastAPI
Celery
Databases
PostgreSQL
Redis
ClickHouse
pgvector
Qdrant
AI/ML
Copilot
Cursor
LangGraph
LangChain
Claude Code
LlamaIndex
Model Context Protocol
Embeddings
Function Calling
AI Agents
LLM
RAG
OpenAI
Anthropic
Structured Outputs
Frontend
React.js
DevOps
Rest API
Docker Compose
CI/CD
Git
Docker
Linux
Analytics
ETL/ELT
Apply
Remote (likely EAEU) • Full-Time • Glubokoye
Python
SQL
Databases
Redis
Apache Kafka
AI/ML
LangChain
CatBoost
LlamaIndex
LoRA
MLFlow
XGBoost
Fine-tuning
Scikit-learn
Function Calling
Computer Vision
AI Agents
NLP
LightGBM
ONNX
TensorRT
PEFT
Transformers
NumPy
PyTorch
LLM
RAG
Hugging Face
NeRF
Human-in-the-Loop
Tool Use
Machine Learning
DevOps
Prometheus
Git
Kubernetes
Grafana
Apply
Senior AI Engineer 1 day ago
≈ $28k – $61k per year (Estimated) • In office • Full-Time • Bengaluru • Palo Alto
Python
Rust
Databases
PostgreSQL
Redis
RabbitMQ
Apache Kafka
AI/ML
LangGraph
AutoGen
Weights & Biases
LangChain
Ray Serve
Model Context Protocol
vLLM
MLFlow
Embeddings
Function Calling
AI Agents
LLM
RAG
Ray
Semantic Search
Triton
Structured Outputs
Semantic Search
ONNX Runtime
Agentic Workflows
Multi-Agent Systems
Tool Use
Agno
DevOps
Terraform
Helm
OpenTelemetry
Prometheus
Pulumi
CI/CD
Docker
Kubernetes
Grafana
Platform Engineering
Apply
Junior AI Engineer 1 day ago
≈ $11k – $28k per year (Estimated) • In office • Full-Time • 3+ years exp • Pune
Python
Java
TypeScript
AI/ML
LangGraph
LangChain
Prompt Engineering
AI Agents
Semantic Kernel
RAG
Hybrid Search
DevOps
CI/CD
Docker
Kubernetes
Apply
$552k – $874k per year • In office • Tokyo
Python
JavaScript
TypeScript
SQL
Node JS
Python
FastAPI
AI/ML
LangGraph
LangChain
Transformers
LLM
RAG
Hugging Face
Frontend
Next.js
React.js
DevOps
GCP
Azure
CI/CD
Git
AWS
Docker
Kubernetes
Apply
$103k – $166k per year • Remote (United States) • Full-Time • 10+ years exp • Bachelor's Degree • Charlotte
Python
Databases
Pinecone
OpenSearch
AI/ML
LangGraph
LangChain
LlamaIndex
Vertex AI
Embeddings
Prompt Engineering
AI Agents
AWS Bedrock
LLM
RAG
OpenAI
Anthropic
LLMOps
Agentic Workflows
DevOps
Rest API
GCP
Azure
AWS
Apply
$186k – $309k per year • Hybrid • Full-Time • 5+ years exp • Bachelor's Degree • Plano
AI/ML
AI Agents
LLMOps
Google AI Studio
DevOps
GCP
Azure
AWS
Apply
ML Specialist 2 days ago
In office • Full-Time • Mangaluru
Python
AI/ML
SHAP
NLP
LIME
TensorFlow
Keras
PyTorch
NLTK
Hugging Face
Interpretability
Machine Learning
DevOps
GCP
Azure
AWS
Apply
≈ $28k – $61k per year (Estimated) • Hybrid • Full-Time • 8+ years exp • Bachelor's Degree • Bengaluru
Python
Databases
OpenSearch
AI/ML
Quantization
Prompt Engineering
Knowledge Distillation
AI Agents
Llama
AWS Bedrock
RAG
Amazon SageMaker
LLMOps
Multi-Agent Systems
Model Distillation
Machine Learning
DevOps
CI/CD
AWS
Docker
Kubernetes
Platform Engineering
Amazon EKS
AWS Lambda
AIOps
Amazon ECS
Management
Agile
Apply
Remote (Romania) • Full-Time • 3+ years exp • Bachelor's Degree • Cluj-Napoca
Python
AI/ML
Copilot
Cursor
Windsurf
AutoGen
LangChain
Claude Code
Prompt Engineering
AI Agents
DeepEval
Promptfoo
CrewAI
LLM
OpenAI
Agentic Workflows
DevOps
Terraform
GitHub Actions
Pulumi
Azure
CI/CD
Pipeline as Code
Bicep
GitHub
Cybersecurity
OWASP Top 10
Least Privilege
SBOM
Management
Gmail
WhatsApp
Apply
$210k – $284k per year • Equity • In office • Full-Time • Bachelor's Degree • Jersey City
AI/ML
LangGraph
LangChain
Fine-tuning
AI Agents
AgentOps
CrewAI
RAG
AWS Strands Agents
Context Engineering
Machine Learning
DevOps
AWS
Apply
$163k – $220k per year • Equity • In office • Full-Time • 5+ years exp • Jersey City
AI/ML
AWS Bedrock
DevOps
AWS
Apply
$105k – $182k per year • Hybrid • Full-Time • 3+ years exp • Master's Degree • Jersey City
Python
Databases
Databricks
AI/ML
MLFlow
Fine-tuning
Embeddings
Scikit-learn
Multimodal AI
Knowledge Distillation
AI Agents
NLP
AWS Bedrock
TensorFlow
PyTorch
RAG
Hallucination
Synthetic Data
Hugging Face
Amazon SageMaker
Interpretability
Agentic Workflows
Model Distillation
Machine Learning
DevOps
AWS
Apply
≈ $124k – $233k per year (Estimated) • In office • 3+ years exp • Bachelor's Degree • Jersey City
Python
AI/ML
LoRA
Fine-tuning
Embeddings
Prompt Engineering
AI Agents
PEFT
Transformers
LLM
RAG
SFT
Context Engineering
Agentic Workflows
Machine Learning
Apply
$85k – $100k per year • In office • Jersey City
Apply
See all jobs
This is one of many
1,813,263 more open roles from verified company boards, updated every day.