368,657open jobs
9,442companies
50,883added this week
Browse all
Salary
$250k – $350k per year
Location
Remote/Hybrid (Jersey City, United States)
Seniority
Principal · 15+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
Mitsubishi UFJ Financial Group (MUFG) is one of Japan's largest financial services holding companies and one of the premier global banking groups. The enterprise provides a broad range of services, including commercial banking, trust banking, securities, credit cards, and asset management to retail, corporate, and institutional clients.

Do you want your voice heard and your actions to count?

Discover your opportunity with Mitsubishi UFJ Financial Group (MUFG), one of the world’s leading financial groups. Across the globe, we’re 150,000 colleagues, striving to make a difference for every client, organization, and community we serve. We stand for our values, building long-term relationships, serving society, and fostering shared and sustainable growth for a better world.

With a vision to be the world’s most trusted financial group, it’s part of our culture to put people first, listen to new and diverse ideas and collaborate toward greater innovation, speed and agility. This means investing in talent, technologies, and tools that empower you to own your career.

Join MUFG, where being inspired is expected and making a meaningful impact is rewarded.

The selected colleague will work at an MUFG office or client sites four days per week and work remotely one day. A member of our recruitment team will provide more details.

Director, Distinguished Engineer, Enterprise AI Platforms

Position Summary

MUFG Americas is building the foundational AI platforms, data and knowledge capabilities, governance patterns, and reusable engineering services needed to scale AI safely across the enterprise. The Director, Principal AI Platform Architect / Distinguished AI Engineer will be a senior hands-on technical leader responsible for architecting and evolving enterprise AI platforms that enable business-specific AI solutions to be built in a federated manner on common, governed, reusable foundations.

This role will lead core AI platform capabilities including LLM gateways, model-provider abstraction, agent runtime, orchestration, RAG and knowledge integration, AI observability, evaluation frameworks, security guardrails, FinOps, and reusable engineering patterns. The successful candidate will combine deep engineering expertise, architectural judgment, product thinking, and strategic leadership to help MUFG move from early AI experimentation to governed, enterprise-grade AI adoption.

This Director-level technical leadership role requires the ability to set technical direction, influence senior stakeholders, mentor engineering teams, advise on build-versus-buy decisions, and translate emerging AI capabilities into reliable, secure, compliant, and reusable enterprise platforms.

Role Purpose

The purpose of this role is to build the enterprise AI foundation that allows MUFG to centralize hard-to-build, reusable, and control-intensive capabilities while enabling business and technology teams to innovate faster at the edge.

The role will help ensure AI solutions are not built as isolated point solutions, but instead leverage shared services, trusted data, common governance controls, reusable components, and scalable engineering patterns. It supports MUFG’s layered AI strategy across common AI services, trusted data and knowledge, and AI Hub / marketplace capabilities for collaboration and reuse.

Key Responsibilities

1. Enterprise AI Platform Architecture

  • Lead the architecture and evolution of MUFG’s enterprise AI platform capabilities, including LLM gateways, model routing, provider abstraction, agent runtime, orchestration, prompt/context management, observability, and FinOps.
  • Define reusable architecture patterns for AI applications, RAG pipelines, agentic workflows, AI-assisted automation, model connectivity, and embedded AI services.
  • Design platform services that support multiple model providers, cloud patterns, data sources, business domains, risk tiers, and AI consumption models, including tech-built, citizen-built, vendor-enabled, and embedded AI solutions.
  • Partner with Enterprise Architecture, Security, Infrastructure, Data Architecture, AI Governance, and application teams to ensure platforms are secure, scalable, resilient, auditable, and aligned with enterprise standards.

2. Engineering Leadership and Hands-on Delivery

  • Serve as a hands-on technical leader who reviews architecture, guides engineering decisions, develops prototypes, and helps teams solve complex design and implementation challenges.
  • Lead development of reusable AI platform components, including model gateways, agent frameworks, tool registries, prompt libraries, evaluation pipelines, data connectors, orchestration patterns, and SDKs/APIs.
  • Establish production-grade engineering patterns for resilience, observability, latency, rate limiting, failover, caching, tenant fairness, usage attribution, cost optimization, CI/CD, automated testing, and production readiness.
  • Create implementation blueprints that enable engineering teams and approved business builders to “compose, not rebuild.”

3. AI Governance by Design

  • Embed governance, risk, security, privacy, monitoring, auditability, and human oversight into AI platform architecture from the start.
  • Partner with AI Governance, Operational Risk, Model Risk, Compliance, Legal, Privacy, Cybersecurity, and Data Governance teams to translate policy expectations into practical platform controls.
  • Define technical control patterns for access control, data classification, entitlement-aware retrieval, model usage monitoring, prompt/output logging, content filtering, human-in-the-loop workflows, exception handling, and audit trails.
  • Support AI use-case intake and routing by assessing technical feasibility, reusability, architecture fit, risk implications, and platform readiness.

4. Data, Knowledge, and Context Engineering

  • Architect AI solutions that use trusted enterprise data, metadata, documents, ontologies, context graphs, and knowledge layers to improve relevance, explainability, and business usefulness.
  • Partner with Data Architecture and Data Governance teams to ensure AI solutions use high-quality, governed, lineage-aware, entitlement-controlled data.
  • Define patterns for RAG, hybrid search, semantic retrieval, vector stores, knowledge graphs, metadata enrichment, document intelligence, and structured/unstructured data integration.
  • Shape how AI Ready Data, data products, metadata, and enterprise knowledge are exposed safely and consistently to AI applications and agents.

5. Strategic Technical Direction

  • Create and maintain architecture roadmaps for enterprise AI capabilities, including agentic AI, multi-agent orchestration, enterprise knowledge graphs, evaluation at scale, self-service developer tooling, and platform interoperability.
  • Advise senior technology and business leaders on build-versus-buy decisions, balancing speed, cost, control, reuse, vendor risk, and long-term enterprise economics.
  • Evaluate emerging AI technologies, including LLM providers, open-weight models, AI frameworks, agent orchestration tools, evaluation platforms, observability products, vector databases, and AI security solutions.
  • Establish technical principles, reference architectures, design standards, and reusable patterns that reduce fragmented experimentation and promote governed enterprise adoption.

6. Cross-functional Influence and Enablement

  • Partner with business AI leads, product owners, engineers, data teams, architects, risk partners, and platform teams to convert business demand into scalable AI capabilities.
  • Mentor senior engineers, architects, and solution teams on AI platform design, GenAI engineering patterns, and enterprise-grade production practices.
  • Communicate complex AI architecture concepts clearly to executives, business sponsors, risk partners, and technical teams.
  • Act as a senior technical voice in architecture forums, AI governance forums, platform prioritization discussions, and strategic vendor evaluations.

Required Experience

  • 15+ years of experience in enterprise software engineering, platform engineering, architecture, data platforms, distributed systems, or related technology leadership roles.
  • Hands-on experience architecting and delivering production-grade AI, GenAI, LLM, data, or enterprise platform capabilities.
  • Experience designing enterprise AI platform services such as LLM gateways, model routing, provider abstraction, RAG services, agentic workflows, AI observability, model evaluation, prompt/context management, and AI guardrails.
  • Strong background in cloud-native architecture, APIs, microservices, event-driven systems, containerization, CI/CD, infrastructure automation, and production operations.
  • Deep understanding of enterprise data architecture, data governance, metadata, lineage, structured/unstructured data integration, data quality, and access-control patterns.
  • Experience with security, resilience, monitoring, auditability, cost optimization, and operational controls in regulated environments.
  • Proven ability to influence architecture and engineering direction across multiple teams, with strong executive communication skills.

Preferred Technical Skills

  • AI platform and LLMOps experience, including model gateways, provider abstraction, prompt management, observability, evaluation, guardrails, agent runtime, and AI cost management.
  • Familiarity with GenAI frameworks and tools such as LangChain, LangGraph, CrewAI, LiteLLM, Ragas, Hugging Face, PyTorch, TensorFlow, SageMaker, or comparable platforms.
  • Experience with model providers such as OpenAI, Anthropic, AWS Bedrock, Azure OpenAI, Google/Gemini, open-weight models, and enterprise integration patterns.
  • Experience with data and knowledge platforms such as Snowflake, Databricks, Spark, Kafka, Airflow, vector search, OpenSearch/Elasticsearch, knowledge graphs, metadata platforms, and document intelligence.
  • Strong engineering experience with Java, Python, Scala, JavaScript/TypeScript, SQL, Spring, FastAPI, Node.js, GraphQL, REST/OpenAPI, AWS, Kubernetes, Docker, Terraform, GitHub, and CI/CD.
  • Understanding of governance and control patterns, including access controls, entitlements, data privacy, audit logging, model monitoring, AI inventory, model risk, secure-by-design reviews, and policy-as-code.

Education and Certifications

  • Bachelor’s degree in Computer Science, Engineering, Data Science, Information Systems, or related field required.

“Visa sponsorship/support is based on business needs. We do not anticipate providing visa sponsorship/support for this position.”

The typical base pay range for this role is as follows:

  • New York / New Jersey: $ 250-350K
  • Non-New York / New Jersey: $ 250-300K

depending on job-related knowledge, skills, experience and location. This role may also be eligible for certain discretionary performance-based bonus and/or incentive compensation. Additionally, our Total Rewards program provides colleagues with a competitive benefits package (in accordance with the eligibility requirements and respective terms of each) that includes comprehensive health and wellness benefits, retirement plans, educational assistance and training programs, income replacement for qualified employees with disabilities, paid maternity and parental bonding leave, and paid vacation, sick days, and holidays. For more information on our Total Rewards package, please click the link below.

Our hybrid work schedule is four days on-site and work remotely one day per week.

We will consider for employment all qualified applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws (including (i) the San Francisco Fair Chance Ordinance, (ii) the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, (iii) the Los Angeles County Fair Chance Ordinance, and (iv) the California Fair Chance Act) to the extent that (a) an applicant is not subject to a statutory disqualification pursuant to Section 3(a)(39) of the Securities and Exchange Act of 1934 or Section 8a(2) or 8a(3) of the Commodity Exchange Act, and (b) they do not conflict with the background screening requirements of the Financial Industry Regulatory Authority (FINRA) and the National Futures Association (NFA). The major responsibilities listed above are the material job duties of this role for which the Company reasonably believes that criminal history may have a direct, adverse and negative relationship potentially resulting in the withdrawal of conditional offer of employment, if any.The above statements are intended to describe the general nature and level of work being performed. They are not intended to be construed as an exhaustive list of all responsibilities duties and skills required of personnel so classified.We are proud to be an Equal Opportunity Employer and committed to leveraging the diverse backgrounds, perspectives and experience of our workforce to create opportunities for our colleagues and our business. We do not discriminate on the basis of race, color, national origin, religion, gender expression, gender identity, sex, age, ancestry, marital status, protected veteran and military status, disability, medical condition, sexual orientation, genetic information, or any other status of an individual or that individual’s associates or relatives that is protected under applicable federal, state, or local law.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,657 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Jersey City
$230k – $260k per year • Equity • Remote • Internship • Bachelor's Degree
Python
DevOps
Amazon EKS
AWS
Azure
CI/CD
GCP
Helm
Kubernetes
Terraform
Cybersecurity
FedRAMP
Orca Security
Apply
$25k – $42k per year • Equity 0–0.2% • Remote • Full-Time • 3+ years exp
Bash
Go
JavaScript
Python
TypeScript
DevOps
AWS
Azure
CI/CD
Datadog
Docker
GCP
GitHub Actions
GitLab CI
Grafana
Incident Management
Kubernetes
Platform Engineering
Prometheus
Terraform
Amazon CloudWatch
GitHub
GitLab
IAM
Cybersecurity
Least Privilege
Apply
$100k – $210k per year • Equity 0–0.5% • Remote • Full-Time • 3+ years exp • San Francisco
Bash
Go
JavaScript
Python
TypeScript
DevOps
AWS
Azure
CI/CD
Datadog
Docker
GCP
GitHub Actions
GitLab CI
Grafana
Incident Management
Kubernetes
Platform Engineering
Prometheus
Terraform
Amazon CloudWatch
GitHub
GitLab
IAM
Cybersecurity
Least Privilege
Apply
$123k – $251k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Dallas • Denver • Birmingham
Java
SQL
Java
Gradle
Hibernate
Maven
Spring Boot
Spring Framework
Databases
Apache Kafka
MySQL
Redis
DevOps
CI/CD
Dynatrace
Jenkins
Kubernetes
OpenShift
Cybersecurity
SonarQube
Apply
$22k – $52k per year (Estimated) • In office • 8+ years exp • Bachelor's Degree • Bengaluru
Python
SQL
DevOps
AWS
Azure
GCP
Analytics
Power BI
Tableau
ETL/ELT
Apply
In office • Full-Time • 5+ years exp • Seoul
SQL
Visual Basic
C#
C#
.NET
Apply
$118k – $252k per year (Estimated) • In office • Full-Time • 8+ years exp • Singapore
Python
SQL
Analytics
Power BI
Tableau
Apply
$40k – $91k per year (Estimated) • In office • Full-Time • 1+ year exp • Singapore
Python
AI/ML
Copilot
Prompt Engineering
Apply
$94k – $158k per year • Remote • Full-Time • 1+ year exp • Bachelor's Degree • New York
Management
ServiceNow
Apply
$90k – $153k per year • Remote/Hybrid • Full-Time • 4+ years exp • Bachelor's Degree • Jersey City
Bash
JavaScript
PowerShell
Python
AI/ML
LLM
LLM Guardrails
Red Teaming
Function Calling
Cybersecurity
MITRE ATT&CK
Apply
$135k – $217k per year • In office • Full-Time • 10+ years exp • Bachelor's Degree • Charlotte • Plano • Jersey City • Chicago
DevOps
Azure
Management
Confluence
Jira
Apply
$145k – $193k per year • In office • Full-Time • 7+ years exp • Bachelor's Degree • Chicago • Washington • Denver • Jersey City • Boston
Python
AI/ML
AI Agents
Anomaly Detection
Embeddings
Fine-tuning
Function Calling
Hugging Face
LangChain
LLM
LLM Evaluation
LLM Guardrails
PyTorch
RAG
Red Teaming
Scikit-learn
Vertex AI
DevOps
Azure
GCP
Cybersecurity
Threat Modeling
Apply
$115k – $153k per year • Remote/Hybrid • Full-Time • 3+ years exp • Bachelor's Degree • Jersey City
Cybersecurity
CIS Benchmarks
GDPR
Apply
Lead IAM Engineer 4 hours ago
$117k – $254k per year (Estimated) • In office • Full-Time • 10+ years exp • Jersey City
DevOps
AWS
Azure
Docker
GCP
IAM
Kubernetes
Cybersecurity
GDPR
HIPAA
Okta
Ping Identity
SOC 2
Zero Trust
Apply
$142k – $213k per year • Remote/Hybrid • Full-Time • 6+ years exp • Bachelor's Degree • Jersey City
Java
Python
SQL
TypeScript
JavaScript
Java
Spring Boot
Python
Asyncio
FastAPI
AI/ML
AI Agents
Claude
Claude Code
Copilot
Cursor
Devin
Fine-tuning
Gemini
Google ADK
Hybrid Search
Knowledge Graph
LangChain
LangGraph
RAG
Frontend
Angular
DevOps
CI/CD
Docker
Kubernetes
Rest API
Apply
See all jobs
This is one of many
368,657 more open roles from verified company boards, updated every day.