368,634open jobs
9,437companies
50,578added this week
Browse all
Salary
$149k – $205k per year
Location
Remote/Hybrid (Jersey City, United States)
Seniority
Principal · 12+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
Mitsubishi UFJ Financial Group (MUFG) is one of Japan's largest financial services holding companies and one of the premier global banking groups. The enterprise provides a broad range of services, including commercial banking, trust banking, securities, credit cards, and asset management to retail, corporate, and institutional clients.

Do you want your voice heard and your actions to count?

Discover your opportunity with Mitsubishi UFJ Financial Group (MUFG), one of the world’s leading financial groups. Across the globe, we’re 150,000 colleagues, striving to make a difference for every client, organization, and community we serve. We stand for our values, building long-term relationships, serving society, and fostering shared and sustainable growth for a better world.

With a vision to be the world’s most trusted financial group, it’s part of our culture to put people first, listen to new and diverse ideas and collaborate toward greater innovation, speed and agility. This means investing in talent, technologies, and tools that empower you to own your career.

Join MUFG, where being inspired is expected and making a meaningful impact is rewarded.

The selected colleague will work at an MUFG office or client sites four days per week and work remotely one day. A member of our recruitment team will provide more details.

Vice President - Technical AI Foundation Model Engineer

Role Summary

The VP, Technical AI Foundation Model Engineer is responsible for designing, building, deploying, and optimizing enterprise-grade AI solutions powered by foundation models, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic AI architectures. The role translates AI concepts into secure, scalable, observable, and production-ready systems suitable for a highly regulated financial services environment.

This individual serves as the technical lead across AI engineering initiatives, partnering closely with Product Management, Enterprise Architecture, Data Engineering, Platform Engineering, Cybersecurity, Risk, and Business stakeholders to deliver transformational AI capabilities.

Key Responsibilities

Foundation Model Engineering

  • Design, build, and optimize enterprise AI solutions leveraging foundation models, LLMs, and agentic AI architectures.
  • Develop and maintain Retrieval-Augmented Generation (RAG) pipelines and semantic search capabilities.
  • Evaluate, benchmark, and recommend foundation models based on performance, cost, security, explainability, and business requirements.
  • Implement model orchestration, prompt engineering, agent frameworks, and AI workflow automation. [MUFG_AI_Ge...ck_Revised | PDF]

AI Platform & Architecture

  • Lead solution architecture for AI applications across cloud and enterprise platforms.
  • Design scalable model-serving architectures and AI APIs.
  • Optimize latency, throughput, resiliency, and cost efficiency of AI workloads.
  • Establish reusable frameworks and engineering patterns for enterprise AI delivery.

LLMOps / MLOps Leadership

  • Own end-to-end model lifecycle management, including:
    • Experimentation
    • Evaluation
    • Deployment
    • Monitoring
    • Rollback
    • Continuous improvement
  • Implement observability, telemetry, and performance monitoring across AI solutions.
  • Define engineering standards and best practices for AI development and operations

Responsible AI & Governance

  • Ensure AI systems comply with enterprise requirements for:
    • Security
    • Privacy
    • Risk Management
    • Compliance
    • Auditability
  • Implement controls for:
    • Hallucination mitigation
    • Prompt security
    • Model safety
    • Data protection
    • Human oversight
  • Partner with Model Risk Management, Legal, and Compliance teams to operationalize Responsible AI principles.

Technical Leadership

  • Lead technical design reviews and architecture decisions.
  • Mentor engineers and establish engineering excellence practices.
  • Guide build-vs-buy evaluations for AI platforms and vendor solutions.
  • Drive innovation through experimentation with emerging AI technologies.

Business & Stakeholder Engagement

  • Translate business requirements into scalable AI architectures.
  • Collaborate with Product Managers and business teams to define solution requirements.
  • Present technical recommendations and tradeoffs to senior leadership.
  • Support executive decision-making regarding AI platform investments.

Required Qualifications

Experience

  • 8-12+ years of experience in:
    • AI/ML Engineering
    • Software Engineering
    • Platform Engineering
    • Applied Machine Learning
  • Demonstrated experience delivering production-grade AI solutions.
  • Previous experience building enterprise-scale AI platforms or AI-enabled products.
  • Experience working in regulated industries such as banking, financial services, insurance, healthcare, or government preferred

Technical Expertise

Strong hands-on expertise in:

AI & Machine Learning

  • Foundation Models
  • Large Language Models (LLMs)
  • Agentic AI Systems
  • Retrieval-Augmented Generation (RAG)
  • Embeddings
  • Semantic Search
  • Vector Databases
  • Prompt Engineering
  • Fine-Tuning Techniques

Engineering Stack

  • Python
  • PyTorch
  • TensorFlow
  • Hugging Face
  • LangChain
  • LlamaIndex
  • Semantic Kernel

Cloud & Platform Engineering

  • AWS and/or Azure
  • Kubernetes
  • Containerized AI Workloads
  • CI/CD Pipelines
  • Model Serving Platforms
  • API Architecture

AI Operations

  • MLOps
  • LLMOps
  • Model Monitoring
  • Evaluation Frameworks
  • Performance Optimization
  • Cost Optimization

Leadership Competencies

  • Strong architecture and systems-thinking mindset.
  • Ability to influence across engineering, product, architecture, and risk organizations.
  • Executive communication skills.
  • Strong problem-solving and decision-making capability.
  • Ability to balance innovation with governance requirements.
  • Experience leading technical teams and mentoring engineers.

Success Metrics

The VP, Technical AI Foundation Model Engineer will be measured on:

Platform & Engineering Outcomes

  • Production AI deployments
  • Platform reliability and scalability
  • Performance optimization
  • Engineering productivity

AI Quality Metrics

  • Model accuracy
  • Retrieval effectiveness
  • Hallucination reduction
  • User adoption and satisfaction

Operational Metrics

  • AI platform utilization
  • Cost efficiency
  • Time-to-production
  • Technical debt reduction

Governance Metrics

  • Compliance adherence
  • Security posture
  • Responsible AI control effectiveness
  • Audit readiness

Education:

  • Bachelor's degree in Computer Science or a closely-related discipline, or an equivalent combination of formal education and experience

“Visa sponsorship/support is based on business needs. We do not anticipate providing visa sponsorship/support for this position.”

The typical base pay range for this role is as follows:

  • New York / New Jersey: $149-205K
  • Non-New York / New Jersey: $149-188K

depending on job-related knowledge, skills, experience and location. This role may also be eligible for certain discretionary performance-based bonus and/or incentive compensation. Additionally, our Total Rewards program provides colleagues with a competitive benefits package (in accordance with the eligibility requirements and respective terms of each) that includes comprehensive health and wellness benefits, retirement plans, educational assistance and training programs, income replacement for qualified employees with disabilities, paid maternity and parental bonding leave, and paid vacation, sick days, and holidays. For more information on our Total Rewards package, please click the link below.

Our hybrid work schedule is four days on-site and work remotely one day per week.

We will consider for employment all qualified applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws (including (i) the San Francisco Fair Chance Ordinance, (ii) the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, (iii) the Los Angeles County Fair Chance Ordinance, and (iv) the California Fair Chance Act) to the extent that (a) an applicant is not subject to a statutory disqualification pursuant to Section 3(a)(39) of the Securities and Exchange Act of 1934 or Section 8a(2) or 8a(3) of the Commodity Exchange Act, and (b) they do not conflict with the background screening requirements of the Financial Industry Regulatory Authority (FINRA) and the National Futures Association (NFA). The major responsibilities listed above are the material job duties of this role for which the Company reasonably believes that criminal history may have a direct, adverse and negative relationship potentially resulting in the withdrawal of conditional offer of employment, if any.The above statements are intended to describe the general nature and level of work being performed. They are not intended to be construed as an exhaustive list of all responsibilities duties and skills required of personnel so classified.We are proud to be an Equal Opportunity Employer and committed to leveraging the diverse backgrounds, perspectives and experience of our workforce to create opportunities for our colleagues and our business. We do not discriminate on the basis of race, color, national origin, religion, gender expression, gender identity, sex, age, ancestry, marital status, protected veteran and military status, disability, medical condition, sexual orientation, genetic information, or any other status of an individual or that individual’s associates or relatives that is protected under applicable federal, state, or local law.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,634 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Jersey City
$23k – $57k per year (Estimated) • Remote • Full-Time • 6+ years exp
Python
Databases
OpenSearch
DevOps
AIOps
ArgoCD
AWS
Azure
CI/CD
Datadog
Docker
Dynatrace
GCP
GitHub Actions
Grafana
Incident Management
Jaeger
Jenkins
Kubernetes
New Relic
OpenTelemetry
Platform Engineering
Prometheus
SLI/SLO/SLA
Splunk
Terraform
GitHub
Apply
$21k per year • In office • Contractor • Yekaterinburg
Python
SQL
Python
FastAPI
Flask
AI/ML
Claude
Claude Code
Embeddings
Function Calling
LLM
RAG
OpenAI
OpenAI Codex
Structured Outputs
DevOps
Docker
Git
Apply
$98k – $132k per year • Remote • Full-Time • 5+ years exp • Bachelor's Degree
Python
R
SQL
Databases
Databricks
Snowflake
AI/ML
Embeddings
LangChain
LangGraph
LLM
NumPy
Pandas
Scikit-learn
Spark
TensorFlow
Transformers
Hugging Face
RAG
Analytics
Matplotlib
Seaborn
Apply
$98k – $132k per year • Remote • Full-Time • 5+ years exp • Bachelor's Degree
Python
R
SQL
Databases
Databricks
Snowflake
AI/ML
Embeddings
LangChain
LangGraph
LLM
NumPy
Pandas
Scikit-learn
Spark
TensorFlow
Transformers
Hugging Face
RAG
Analytics
Matplotlib
Seaborn
Apply
$98k – $132k per year • Remote • Full-Time • 5+ years exp • Bachelor's Degree
Python
R
SQL
Databases
Databricks
Snowflake
AI/ML
Embeddings
LangChain
LangGraph
LLM
NumPy
Pandas
Scikit-learn
Spark
TensorFlow
Transformers
Hugging Face
RAG
Analytics
Matplotlib
Seaborn
Apply
In office • Full-Time • 5+ years exp • Seoul
SQL
Visual Basic
C#
C#
.NET
Apply
$118k – $252k per year (Estimated) • In office • Full-Time • 8+ years exp • Singapore
Python
SQL
Analytics
Power BI
Tableau
Apply
$40k – $91k per year (Estimated) • In office • Full-Time • 1+ year exp • Singapore
Python
AI/ML
Copilot
Prompt Engineering
Apply
$94k – $158k per year • Remote • Full-Time • 1+ year exp • Bachelor's Degree • New York
Management
ServiceNow
Apply
$90k – $153k per year • Remote/Hybrid • Full-Time • 4+ years exp • Bachelor's Degree • Jersey City
Bash
JavaScript
PowerShell
Python
AI/ML
LLM
LLM Guardrails
Red Teaming
Function Calling
Cybersecurity
MITRE ATT&CK
Apply
$115k – $153k per year • Remote/Hybrid • Full-Time • 3+ years exp • Bachelor's Degree • Jersey City
Cybersecurity
CIS Benchmarks
GDPR
Apply
Lead IAM Engineer 3 hours ago
$117k – $254k per year (Estimated) • In office • Full-Time • 10+ years exp • Jersey City
DevOps
AWS
Azure
Docker
GCP
IAM
Kubernetes
Cybersecurity
GDPR
HIPAA
Okta
Ping Identity
SOC 2
Zero Trust
Apply
$142k – $213k per year • Remote/Hybrid • Full-Time • 6+ years exp • Bachelor's Degree • Jersey City
Java
Python
SQL
TypeScript
JavaScript
Java
Spring Boot
Python
Asyncio
FastAPI
AI/ML
AI Agents
Claude
Claude Code
Copilot
Cursor
Devin
Fine-tuning
Gemini
Google ADK
Hybrid Search
Knowledge Graph
LangChain
LangGraph
RAG
Frontend
Angular
DevOps
CI/CD
Docker
Kubernetes
Rest API
Apply
$177k – $265k per year • Remote/Hybrid • Full-Time • 6+ years exp • Bachelor's Degree • Jersey City • Tampa
Java
Python
Databases
Apache Kafka
Databricks
Snowflake
DevOps
AWS
Azure
GCP
QA
Pact
Apply
$142k – $213k per year • Remote/Hybrid • Full-Time • 6+ years exp • Jersey City
Python
Python
Django
FastAPI
Flask
AI/ML
Hugging Face
NumPy
Pandas
Scikit-learn
DevOps
AIOps
CI/CD
Apply
See all jobs
This is one of many
368,634 more open roles from verified company boards, updated every day.