2,291,628open jobs
145,599companies
270,740added this week
Browse all
Location
In office (Bengaluru)
Seniority
Staff · 5+ years exp
Visa
Sponsors visas in United States, Ireland; no register of this country names it

Confirmed on the employer's own hiring board on Nov 16, 2026. First seen by Alion on Nov 16, 2026. JPMorganChase scores A on the Alion truth index.

Overview
Company
Impact
Profile match
JPMorganChase is the largest bank in the United States by assets and one of the most systemically important financial institutions in the world, with a lineage running back through more than a thousand predecessor firms to the 1799 founding of the Bank of the Manhattan Company. It combines a dominant investment bank and markets business with Chase, the largest retail banking franchise in America, plus commercial banking and asset and wealth management. Headquartered in New York, the group is unusual among banks for the scale of its technology spending, running one of the largest engineering organisations of any financial institution and deploying its own internal AI platform across the firm.

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorganChase within the Commercial & Investment Bank, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.

Job responsibilities

  • Execute creative LLM assisted software solutions, design, develop, and troubleshoot LLM powered applications and services (e.g., retrieval augmented generation, agent workflows, structured extraction, classification) with a willingness to think beyond routine approaches to break down technical problems and deliver measurable outcomes and think in the novel Agentic AI way.
  • Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
  • Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
  • Develop data quality rules and controls using LLM, define and enforce guardrails for prompts, retrieved context, model inputs/outputs, and post processing, including PII redaction, toxicity/safety filters, hallucination mitigation, output schema validation, and policy compliance.
  • Provide Level 3 (L3) support for LLM assisted production systems, own complex incidents, model and prompt rollouts/rollbacks, dependency issues (vector stores, embeddings, feature stores), and ensure high availability, reliability, and adherence to SLAs including latency and cost budgets.
  • Support BAU operations for Markets businesses: maintain and evolve LLM use cases supporting markets workflows with disciplined change management, canary releases, A/B tests, and close partnership with product, controls, and operations.Create secure, high quality production code: implement LLM assisted micro services, synchronous and asynchronous inference pipelines (streaming where appropriate), deterministic fallbacks, circuit breakers, and observability for reliability in production.
  • Produce architecture and design artifacts, deliver model cards, system/data lineage, RAG/agent reference architectures, prompt libraries and versioning strategies, evaluation plans, and control evidence ensuring design constraints and regulatory expectations are met during development.
  • Identify hidden problems and patterns, use telemetry, error analysis, prompt and context analytics, and drift detection to improve model selection, prompt strategies, retrieval quality, chunking/embedding strategies, and system architecture.Drive LLM Ops best practices, integrate models, prompts, and evaluation into CI/CD, enforce approvals, segregation of duties, and reproducibility, automate regression and guardrail tests and manage lifecycle across environments.
  • Ensure that model strengths, limitations, and risk profiles are understood, documented, and appropriately applied across different classes of software work, and maintain deep understanding of the strengths, limitations, and risk characteristics of approved LLMs (e.g., Claude, ChatGPT, and successor models), including safety profiles, context limits, determinism strategies, and fine tuning vs. prompt only tradeoffs, design multi agent workflows that incorporate LLM driven analysis, code generation, testing, and review with explicit human approval gates and segregation of duties.
  • Ensure LLM driven systems meet enterprise reliability and resilience expectations, including disaster recovery, fallback behaviors, regional resiliency, and performance SLOs.

Required qualifications, capabilities, and skills

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Strong coding skills in Java/Python and SQL, applied to building LLM enabled micro services, retrieval pipelines, evaluators, and data tooling; solid understanding of data structures, algorithms, and object oriented programming as applied to LLM latency, caching, and throughput.
  • Hands on experience with AWS and cloud data management (e.g., Redshift, Dynamo DB, Aurora, Data bricks), plus experience integrating managed model endpoints and embedding/vector services; familiarity with secure secret management, networking, and least privilege access.
  • Proficiency in automation, CI/CD, and agile methodologies with LLM Ops extensions: prompt and config versioning, automated evaluations, canary releases, and rollback strategies.
  • Experience in system design, application development, and operational stability for LLM architectures, including retrieval layers, vector stores, caching, observability, rate limiting, and backpressure strategies.
  • Strong analytical, problem solving, and communication skills, including the ability to explain model behaviors, tradeoffs, and control decisions to both technical and non technical stakeholders.
  • Provide L3 and BAU support for Markets by leveraging LLMs for incident triage, run book retrieval, and pre approved auto remediation, with on call coverage for LLM services and dependencies.
  • Expert-level knowledge of how large language models work and hands-on experience training and fine-tuning approved models (e.g., Claude, Chat GPT and successors), with a proven track record integrating LLMs as controlled, reliable components of the software engineering lifecycle in regulated environments, ensuring determinism, reproducibility, safety, and traceability
  • Strong understanding of data modeling challenges in big data and LLM contexts, embeddings, chunking strategies, vector similarity nuances, retrieval quality measures, and document lineage.
  • Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices

Preferred qualifications, capabilities, and skills

  • Define model usage guidelines outlining which models are appropriate for requirements analysis, code generation and refactoring, test generation, documentation and explanation, and lead the use of LLMs for structured requirements analysis, translating business and regulatory requirements into clear technical specifications and control implementations.
  • Establish best practices for prompt driven design and development, treating prompts and system instructions as versioned, reviewable engineering artifacts and ensuring change control and traceability, ensure prompt strategies support determinism, reproducibility, and traceability in regulated environments (e.g., seeded examples, constrained decoding, output schemas, and canonical evaluation sets), and oversee prompt libraries and reusable patterns aligned with enterprise coding and architectural standards, including shared retrieval components and guardrail policies.
  • Ability to continuously learn the new developments happening in Agentic AI and LLM driven software coding. An engineer who is self-motivated, take full ownership of every task given, and act without waiting to be asked. Accountability is key for this role: one'll be expected to spot problems early, see each one through to the fix.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,291,628 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
Bengaluru
Staff Engineer 2 months ago
In office · Full-Time · 4+ years exp · Bengaluru
Python
JavaScript
TypeScript
PowerShell
C#
Node JS
C#
.NET
Node JS
Nest.JS
Databases
PostgreSQL
Databricks
DynamoDB
MS SQL
ElasticSearch
Apache Kafka
OpenSearch
Amazon DocumentDB
AI/ML
Fine-tuning
Prompt Engineering
NLP
LLM
RAG
Frontend
Angular
React.js
DevOps
Splunk
Azure DevOps
GitHub Actions
Datadog
Azure
CI/CD
ArgoCD
AWS
Docker
Kubernetes
Amazon EKS
AWS Lambda
Amazon EC2
Amazon S3
IAM
Amazon ECS
API Gateway
Apply
Staff Engineer 1 month ago
In office · Full-Time · Bengaluru
JavaScript
TypeScript
C#
Node JS
C#
.NET
Databases
DynamoDB
AI/ML
AI Agents
NLP
Context Engineering
LLM Guardrails
Frontend
GraphQL
Next.js
React.js
DevOps
Rest API
Datadog
CI/CD
AWS
Kubernetes
Amazon EKS
AWS Lambda
Progressive Delivery
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
Amazon EventBridge
AWS Step Functions
API Gateway
Cybersecurity
Threat Modeling
Apply
Technical Lead - Java 2 hours ago
In office · Full-Time · Bachelor's Degree · Ahmedabad
JavaScript
Java
TypeScript
SQL
Java
Spring Boot
Hibernate
Databases
Redis
DynamoDB
Apache Kafka
Frontend
Angular
Mobile
JUnit
DevOps
Rest API
CI/CD
Jenkins
Git
AWS
Docker
Kubernetes
Management
Agile
Apply
In office · Full-Time · 8+ years exp · Bachelor's Degree · Hyderabad
Python
Go
JavaScript
TypeScript
Node JS
Node JS
Express
Databases
PostgreSQL
pgvector
Pinecone
FAISS
OpenSearch
AI/ML
Copilot
Cursor
LangGraph
AutoGen
LangChain
Embeddings
Prompt Engineering
Function Calling
AI Agents
LangSmith
AWS Bedrock
CrewAI
LLM
RAG
Hallucination
OpenAI
Anthropic
Amazon SageMaker
LLM Guardrails
Agentic Workflows
Frontend
Redux
GraphQL
Next.js
React.js
Material UI
Ant Design
Sass
Emotion
Redux Toolkit
React Router
Mobile
State Management
DevOps
Rest API
GitHub Actions
CloudFormation
WebSockets
CI/CD
Jenkins
Git
AWS
Docker
Kubernetes
Amazon EKS
AWS Fargate
AWS Lambda
Amazon S3
Amazon ECS
Amazon CloudWatch
Management
Agile
QA
Cypress
Playwright
Jest
Pytest
Apply
Hybrid · 8+ years exp · Bengaluru
Go
Java
Rust
SQL
Databases
MySQL
PostgreSQL
Cassandra
RabbitMQ
Apache Kafka
Azure Cosmos DB
DevOps
GCP
Istio
Linkerd
Prometheus
Azure
AWS
Docker
Kubernetes
Grafana
Chaos Engineering
Service Mesh
Cybersecurity
Zscaler
Zero Trust
Apply
Hybrid · 7+ years exp · Bengaluru
JavaScript
Java
Java
Spring Boot
Spring MVC
Databases
Apache Kafka
AI/ML
LLM
Frontend
React.js
DevOps
Rest API
CI/CD
Git
Docker
Kubernetes
Management
Agile
Scrum
Apply
Website Developer 1 day ago
In office · 1+ year exp · Bengaluru
Python
JavaScript
PHP
TypeScript
Node JS
PHP
WordPress
Databases
MySQL
PostgreSQL
Frontend
Vue.js
Angular
React.js
DevOps
Rest API
Azure
CI/CD
Git
AWS
Apply
In office · 3+ years exp · Bengaluru
Apply
Backend Architect 1 day ago
In office · 11+ years exp · Bengaluru
Java
Java
Spring Boot
Databases
Snowflake
Databricks
Apache Kafka
DevOps
Rest API
Analytics
ETL/ELT
Apply
In office · 10+ years exp · Bengaluru
Java
Java
Spring Boot
Databases
Apache Kafka
AI/ML
Hadoop
Flink
DevOps
Rest API
GCP
Azure
AWS
Analytics
ETL/ELT
Apply
See all jobs
This is one of many
2,291,628 more open roles from verified company boards, updated every day.