372,956open jobs
9,661companies
50,233added this week
Browse all
Salary
$120k – $218k per year
Location
In office (Boston)
Seniority
Architect · 10+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
State Street is a major American financial services and bank holding company headquartered in Boston, Massachusetts. As one of the world's largest custodian banks and asset managers, it provides comprehensive asset servicing, fund administration, foreign exchange, and investment management through its State Street Global Advisors division.

Who We Are Looking For

We are seeking an AI Solution Architect, Vice President to serve as a senior technology leader responsible for shaping and driving the AI strategy for our Internal Audit function. In this role, you will provide architectural leadership to design, build, and operate production-grade AI systems that deliver conversational, predictive, and generative capabilities at enterprise scale

This is a hands-on architectural leadership role requiring deep expertise in Generative AI, large language models (LLMs), retrieval-augmented generation (RAG), AI orchestration frameworks, and enterprise integration patterns. You will partner closely with Internal Audit SMEs, data engineering, security, and infrastructure teams to ensure AI solutions are explainable, secure, compliant, and operationally resilient, while materially improving audit quality, productivity, and insight generation.

What You Will Be Responsible For

AI Architecture & Platform Strategy

  • Lead the end-to-end architecture for AI-enabled platforms supporting Internal Audit, integrating LLMs, machine learning models, enterprise data platforms, and core systems
  • Define scalable, reusable architectural patterns for conversational assistants, generative insights, predictive analytics, and continuous auditing use cases
  • Act as the technical authority for AI architecture within Internal Audit Technology, setting standards and guiding architectural decisions across initiatives

AI Engineering & Orchestration

  • Lead the design and implementation of AI orchestration frameworks to enable scalable, multi-step reasoning and agent-based workflows
  • Architect solutions using frameworks such as LangChain (or equivalent) and cloud-native capabilities (e.g., managed AI/agent services)
  • Design workflows incorporating:
    • Retrieval-augmented generation (RAG) across structured and unstructured data
    • Guardrails, validation layers, and hallucination-mitigation techniques
  • Define and own model selection, evaluation, and benchmarking frameworks, balancing performance, cost, latency, explainability, and risk

Build & Production Operations

  • Lead delivery of production-ready AI systems, including model deployment, APIs, orchestration pipelines, and enterprise integrations
  • Establish and mature LLMOps / MLOps practices, including versioning, monitoring, evaluation, logging, rollback strategies, and cost controls
  • Ensure platforms meet enterprise standards for availability, scalability, performance, resilience, and reliability

Governance, Risk & Controls

  • Embed AI governance and model risk management into system design
  • Implement safeguards for data privacy, security, bias detection, explainability, and auditability
  • Partner with Internal Audit, Risk, Compliance, and Legal teams to align solutions with regulatory and internal policy requirements

Use Case Enablement & Innovation

  • Translate audit and risk challenges into high-impact AI use cases (e.g., control testing automation, issue identification, narrative generation, continuous auditing)
  • Guide experimentation and proof-of-concepts while ensuring a clear path to production
  • Stay current on emerging AI technologies and recommend pragmatic adoption strategies

What We Value

The skills that will help you succeed in this role include:

  • End-to-end AI architecture and solution design for enterprise, production-grade systems
  • Hands-on expertise with Generative AI, including LLMs, prompt engineering, embeddings, RAG, and agent-based workflows
  • AI orchestration and workflow design skills for multi-step reasoning, validation, and automation
  • Strong engineering and operational skills to deliver scalable, reliable platforms with robust LLMOps/MLOps practices
  • Responsible AI and governance skills, including model risk management, security, privacy, explainability, and auditability
  • Data engineering and integration skills, leveraging enterprise data platforms, APIs, and distributed systems
  • Analytical problem-solving skills to translate audit and risk challenges into high-impact AI use cases
  • Stakeholder partnership and influence skills across audit, risk, security, and technology teams
  • Clear technical communication and mentoring skills for technical and non-technical audiences
  • Continuous learning mindset to stay current with evolving AI technologies and best practices

Education & Preferred Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field
  • 10+ years of experience designing and delivering enterprise software or data platforms, with 3+ years focused on AI / ML solutions
  • Hands-on experience with large language models and modern AI frameworks (prompt engineering, embeddings, RAG, agents)
  • Strong background in cloud platforms (Azure or AWS) and microservices-based architectures
  • Experience operationalizing AI systems with MLOps / LLMOps tooling and practices
  • Solid understanding of data engineering, APIs, and distributed systems
  • Proven ability to design systems with security, privacy, and regulatory considerations

Nice to Have

  • Experience supporting Internal Audit, Legal, or Risk Corporate functions
  • Familiarity with model risk management or AI governance frameworks
  • Experience with vector databases, semantic search, or enterprise data catalogs
  • Exposure to process mining, control testing automation, or continuous auditing
  • Cloud or AI/ML certifications

Salary Range:

$120,000 - $217,500 Annual

The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

For a full overview, visit https://hrportal.ehr.com/statestreet/Home.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Job Application Disclosure:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
372,956 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Boston
$94k – $237k per year (Estimated) • In office • Full-Time • 3+ years exp • Singapore
Python
AI/ML
Computer Vision
Hallucination
Knowledge Distillation
LangChain
LlamaIndex
LLM
Multimodal AI
PyTorch
Quantization
RAG
TensorRT
TensorRT-LLM
Triton
Triton Inference Server
vLLM
LLM Evaluation
LLM Guardrails
AI Agents
DevOps
AWS
Azure
CI/CD
Docker
GCP
Kubernetes
Apply
$30k – $71k per year (Estimated) • Remote/Hybrid • Full-Time • 10+ years exp • Bachelor's Degree • Pune
Java
Python
SQL
Java
Spring Boot
Python
FastAPI
Flask
pySpark
Databases
Apache Kafka
Oracle
Presto
Trino
AI/ML
AI Agents
ChatGPT
Claude
Copilot
DeepEval
Google ADK
Human-in-the-Loop
Knowledge Graph
LangChain
LangGraph
LLM Guardrails
Model Context Protocol
Prompt Engineering
RAG
Ragas
TruLens
Spark
DevOps
AppDynamics
CI/CD
Docker
GitHub
Grafana
gRPC
Jenkins
Kubernetes
OpenShift
Prometheus
Red Hat
Splunk
Management
Confluence
Jira
Apply
$265k – $375k per year • Remote • Full-Time • 10+ years exp
AI/ML
Embeddings
LLM
LLM Guardrails
Semantic Search
Semantic Search
Apply
$155k – $220k per year • In office • Full-Time • 12+ years exp • United States
Python
AI/ML
Gemini
LangGraph
LLM
Prompt Engineering
RAG
Vertex AI
LangChain
AI Agents
Google ADK
Human-in-the-Loop
TPU
DevOps
GCP
Apply
$26k – $65k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Pune
PowerShell
Python
AI/ML
AI Agents
LLM
LLM Guardrails
Model Context Protocol
DevOps
AWS
Azure
CI/CD
GCP
Git
Rest API
Splunk
Cybersecurity
Crowdstrike
Microsoft Entra ID
Microsoft Sentinel
MITRE ATT&CK
Okta
SentinelOne
Apply
$90k – $158k per year • In office • Full-Time • Quincy
Cybersecurity
Zero Trust
Apply
$76k – $163k per year (Estimated) • In office • Full-Time • 5+ years exp • London
Analytics
ETL/ELT
Apply
$110k – $185k per year • In office • Full-Time • 3+ years exp • Bachelor's Degree • Quincy
DevOps
Azure
IAM
Rest API
Cybersecurity
Least Privilege
Microsoft Entra ID
Management
Confluence
ServiceNow
Apply
$66k – $160k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Kilkenny
Databases
Databricks
DevOps
AWS
Azure
Datadog
Incident Management
Platform Engineering
Splunk
Cybersecurity
IBM QRadar
Management
Confluence
Jira
ServiceNow
Apply
$30k – $75k per year (Estimated) • In office • Full-Time • 15+ years exp • Hyderabad
AI/ML
Claude
AI Agents
Cybersecurity
Defense in Depth
Zero Trust
Apply
AI Applied Scientist 2 hours ago
$219k – $246k per year • In office • Full-Time • 3+ years exp • Master's Degree • Boston • Mountain View
Python
AI/ML
AI Agents
Edge AI
LangGraph
LLM
Multimodal AI
NLP
NVIDIA NeMo
Pre-training
Prompt Engineering
PyTorch
TensorFlow
LangChain
Apply
$94k – $266k per year • Remote/Hybrid • Full-Time • 12+ years exp • Associate's Degree • Boston • Milwaukee • Dallas • Columbus • Kirkland
Python
AI/ML
Claude
Claude Code
CoreWeave
CUDA
CUDA Toolkit
NCCL
DevOps
Ansible
Configuration Management
HPC
Incident Management
Kubernetes
Rest API
SLURM
Terraform
Apply
$94k – $266k per year • Remote/Hybrid • Full-Time • 5+ years exp • Associate's Degree • Chicago • Milwaukee • Dallas • Columbus • Kirkland
Databases
Databricks
Google BigQuery
SAP HANA
Snowflake
AI/ML
Knowledge Graph
DevOps
Azure
Apply
$133k – $366k per year • Remote/Hybrid • Full-Time • 12+ years exp • Associate's Degree • Chicago • Milwaukee • Dallas • Columbus • Kirkland
JavaScript
Python
TypeScript
AI/ML
Anthropic
Edge AI
Gemini
OpenAI
Management
ServiceNow
Marketing
Salesforce
Apply
$172k – $237k per year • Remote • Full-Time • 10+ years exp • PhD • Charlotte • Louisville • Tampa • Fort Lauderdale • Washington
Databases
Databricks
Snowflake
AI/ML
Claude
Claude Code
Copilot
AI Agents
DevOps
AWS
Azure
GCP
Cybersecurity
HIPAA
Apply
See all jobs
This is one of many
372,956 more open roles from verified company boards, updated every day.