{"id":2917500,"url":"https://alion.io/job/jpmorganchase-sr-principal-software-engineer-llm-engineering-2","title":"SR Principal Software Engineer - LLM Engineering","company":{"id":257,"name":"JPMorganChase","domain":"jpmorganchase.com","url":"https://alion.io/company/jpmorganchase","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":{"grade":"A","score":95,"open_postings":741,"ghost_share":0.009,"stale_share":0.333,"repost_share":0.09,"time_to_fill_p50_days":8,"computed_at":"2026-10-21T05:46:15Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Seattle, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":219000,"max_usd":448000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":730},"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Amazon EKS","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Falcon","optional":false},{"name":"GCP","optional":false},{"name":"GNN","optional":false},{"name":"Hugging Face","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Kubeflow","optional":false},{"name":"Llama","optional":false},{"name":"LLM","optional":false},{"name":"LLMOps","optional":false},{"name":"Mistral","optional":false},{"name":"MLFlow","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Quantization","optional":false},{"name":"TensorFlow","optional":false},{"name":"Transformers","optional":false},{"name":"Triton Inference Server","optional":false},{"name":"Vertex AI","optional":false},{"name":"vLLM","optional":false},{"name":"CloudFormation","optional":true},{"name":"Docker","optional":true},{"name":"Kubernetes","optional":true},{"name":"Terraform","optional":true},{"name":"TPU","optional":true}],"status":"live","first_seen_at":"2026-08-24T14:52:10Z","employer_posted_date":"2026-08-24","last_verified_at":"2026-10-21T21:01:13Z","board_verified":true,"closed_at":null,"days_open":58,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":58},"description":"We’re looking for a tech leader ready to take their career to new heights. Join the ranks of top talent at one of the world’s most influential companies.\nAs a Senior Principal Software Engineer at JPMorganChase within the Commercial & Investment Bank Trust & Safety Fraud Prevention team, you provide deep engineering expertise and work across agile teams to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Leverage your deep expertise to consistently challenge the status quo, innovate for business impact, lead the strategic development behind new and existing products and technology portfolios, and remain at the forefront of industry trends, best practices, and technological advances.\nJob responsibilities\nAdvises and leads on the strategy, architecture, and development of model serving solutions for different model architectures (including LLMs & GNNs) across cloud and on-premises environments, aligning initiatives to business outcomes.\nDefines and implements MLOps and LLMOps strategies for end-to-end model lifecycle management, including training, versioning, deployment, monitoring, and governance.\nDrives optimization of model inferencing for high throughput and low latency using quantization, model parallelism, intelligent batching, and hardware acceleration for all model architectures.\nSets strategy and operating standards for agentic AI-enabled engineering across a portfolio (using enterprise-authorized tools within the work environment) to drive measurable improvements in delivery speed, reliability, and code quality (e.g., AI-orchestrated SDLC/TLM automation, release readiness gating, incident triage/root-cause acceleration, and large-scale refactoring/test modernization), while defining guardrails for validation, security, resiliency, and reuse across teams and functions.\nApplies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation at scale.\nCreates durable, reusable software and platform frameworks to standardize ML Engineering services, enabling scale across teams and functions.\nEstablishes best practices for automation, CI/CD, and infrastructure-as-code using containerization and orchestration technologies.\nPartners closely with data science, platform engineering, and SRE teams to productionize models on AWS, ensuring observability, reliability, and cost efficiency.\nLeads deployment and optimization using model inference servers such as Triton Inference Server and vLLM for high-throughput, low-latency serving at scale.\nOversees production operations for AI workloads, including monitoring, incident response, security, and compliance, with continuous improvement.\nTranslates complex technical concepts and emerging trends into actionable strategies, influencing senior stakeholders and cross-functional partners to prioritize and deliver AI/ML capabilities that drive measurable business impact while promoting a culture of diversity, opportunity, inclusion, and respect.\n Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 10+ years of applied experience.\n8+ years of AI/ML engineering experience with significant expertise in LLMs, GNNs and other model architectures (e.g., GPT, Llama, Falcon, Mistral).\nDemonstrated success architecting and deploying LLM & GNN solutions on AWS (e.g., SageMaker, Bedrock, EKS) at enterprise scale; experience with Azure ML or GCP Vertex AI.\nExperience building LLM and GNN serving platforms in large-scale environments typical of major tech firms.\nHands-on experience building LLM inference engines using Triton Inference Server and vLLM, including autoscaling, caching, and throughput optimization.\nAdvanced proficiency in Python and optimization techniques applied to deep learning frameworks (PyTorch, TensorFlow, Hugging Face Transformers).\nDeep understanding of LLMOps/MLOps (e.g., MLflow, SageMaker Pipelines, Kubeflow) with a track record of implementing best practices at scale.\nDemonstrated experience designing and scaling agentic AI-enabled development patterns (using enterprise-authorized tools within the work environment) across teams/functions, including establishing governance for human-in-the-loop validation, traceability/auditability, and secure handling of sensitive inputs/outputs.\nStrong understanding of responsible AI use and control expectations at scale, including security/resiliency implications, data sensitivity, and risk-based governance; ability to advise senior leaders on safe adoption, reuse, and measurable outcomes.\nExpertise in inference optimization and distributed systems for large models focused on high-throughput, low-latency applications, including system design, testing, and operational stability for enterprise AI platforms.\nExcellent communication skills with proven collaboration with SRE to implement observability, incident response, and SLIs/SLOs for LLM services, and the ability to influence both technical and non-technical stakeholders to deliver value across functions at scale..\nPreferred qualifications, capabilities, and skills\nMaster’s or PhD in Computer Science, Engineering, or a related field (or equivalent experience).\nPractical cloud-native experience, including containerization (Docker), orchestration (Kubernetes), and infrastructure-as-code (Terraform, CloudFormation).\nExpertise in security, compliance, and governance for AI/ML deployments in regulated environments.\nExperience in trust and safety or fraud prevention domains; familiarity with payments platforms is a plus.\nTrack record of contributions to open-source LLM projects or peer-reviewed research and/or experience presenting at industry conferences or leading technical communities.\nFamiliarity with hardware acceleration strategies across GPUs, TPUs, and specialized inference runtimes.\nExperience in building java based applications\nThis position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase’s review of criminal conviction history, including pretrial diversions or program entries.","description_format":"text","description_chars":6286,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commercial & Retail Banks","Wealth Management & Financial Advisors","Asset Management & Funds","Investment Banking & M&A Advisory"],"lifecycle":[{"event":"open","at":"2026-10-20T10:56:53Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 3,429 · green card filings: 933","filings_12m":3429,"filings_prev_12m":3601,"green_card_filings_12m":933,"median_offered_wage_usd":160366,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":2086}],"liveness":{"score":7,"band":"cold","label":"Long shot","p_open":1,"p_active":0.264,"p_room":0.28,"age_days":57,"expected_fill_days":8,"reasons":["conf:0","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/jpmorganchase-sr-principal-software-engineer-llm-engineering-2","json_url":"https://alion.io/job/jpmorganchase-sr-principal-software-engineer-llm-engineering-2.json","meta":{"generated_at":"2026-10-21T22:23:07Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":31906,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":257},"rest":"https://alion.io/mcp/rest/get_company?id=257"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fjpmorganchase-sr-principal-software-engineer-llm-engineering-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fjpmorganchase-sr-principal-software-engineer-llm-engineering-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fjpmorganchase-sr-principal-software-engineer-llm-engineering-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/jpmorganchase-sr-principal-software-engineer-llm-engineering-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fjpmorganchase-sr-principal-software-engineer-llm-engineering-2"}]}