{"id":4459780,"url":"https://alion.io/job/fidelity-investments-lead-software-engineer-5","title":"Lead Software Engineer","company":{"id":21095,"name":"Fidelity Investments","domain":"fidelity.com","url":"https://alion.io/company/fidelity","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":100,"open_postings":43,"ghost_share":0.023,"stale_share":0.047,"repost_share":0.14,"time_to_fill_p50_days":19,"computed_at":"2026-11-17T05:47:56Z"}},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Anthropic","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"Azure","optional":false},{"name":"Embeddings","optional":false},{"name":"Function Calling","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"OpenAI","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"RAG","optional":false},{"name":"Agentic Workflows","optional":true},{"name":"CI/CD","optional":true},{"name":"CrewAI","optional":true},{"name":"Docker","optional":true},{"name":"Fine-tuning","optional":true},{"name":"FinOps","optional":true},{"name":"GCP","optional":true},{"name":"Go","optional":true},{"name":"Java","optional":true},{"name":"Kubernetes","optional":true},{"name":"LangChain","optional":true},{"name":"LangGraph","optional":true},{"name":"LlamaIndex","optional":true},{"name":"LLMOps","optional":true},{"name":"LoRA","optional":true},{"name":"Milvus","optional":true},{"name":"PEFT","optional":true},{"name":"pgvector","optional":true},{"name":"Pinecone","optional":true},{"name":"Platform Engineering","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Python","optional":true},{"name":"Quantization","optional":true},{"name":"TGI","optional":true},{"name":"TypeScript","optional":true},{"name":"vLLM","optional":true},{"name":"Weaviate","optional":true}],"status":"live","first_seen_at":"2026-11-17T13:08:32Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-17T13:08:32Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Job Description:\nJob Title: Senior AI/ML Engineer\nThe Purpose of This Role\nAs a Lead GenAI Engineer, you will design and build the core building blocks of this platform: a provider-agnostic LLM gateway, guardrails and governance, retrieval and agentic infrastructure, evaluation harnesses, and the observability and cost-attribution systems that make GenAI viable at enterprise scale. You will work alongside a team of platform engineers, set technical direction, and raise the engineering bar through hands-on work and mentorship.\nThis is a platform and infrastructure role, not an applied / prompt-engineering role. Your users are internal engineering teams and business teams; your product is the platform they build on.\nThe Value You Deliver\nYou will collaborate with partners, iterate on requirements, follow Fidelity best practices / methodologies, have thorough understanding of the technology roadmap, advancement to design / development process.\nEngineering excellence is a collective set of choices we make as technologists, whether to increase code coverage or ship a product, investing in developer productivity vs saving $$$. You will consistently make culture choices that positively impact all of engineering.\nYou do not compromise for the sake of social acceptance and demonstrate conviction and drive to operate in highly ambiguous situations thriving in uncertainty while keeping your eyes on the long-term vision.\nYou lead by example and by your code - set engineering standards, review designs and PRs, and grow the capability of the wider team.\nYou will drive technical discussions, arbitrate, and recommend optimal path forward in a room of highly opinionated engineers and work towards ensuring platform offerings are scalable, resilient, and secure.\nThe Skills that are Key to this role\nKey Responsibilities\nOwn foundational platform capabilities - design, build, and operate core services such as an LLM gateway / router, a normalized multi-provider API contract, and shared SDKs that abstract away provider differences (OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure OpenAI, and self-hosted / open models).\nBuild guardrails and governance - implement per-tenant policies, rate limiting, PII / data-leakage controls, content safety filters, and prompt-injection defenses as reusable platform primitives.\nDesign retrieval and agentic infrastructure - build shared RAG components (embedding pipelines, vector store integrations, chunking / indexing services) and tool-calling / agent-orchestration infrastructure (function calling, MCP, multi-agent frameworks).\nDeliver observability and cost management - instrument the platform for latency, token usage, and quality metrics; build chargeback / showback and usage-attribution so teams see and own their consumption.\nEstablish evaluation frameworks - create automated, repeatable evals for quality, safety, and regression, so model and prompt changes can be shipped with confidence.\nDrive architecture and technical direction - make build-vs-buy decisions, define the API contracts other teams depend on, and ensure the platform is scalable, resilient, and secure.\nLead through code and mentorship - set engineering standards, review designs and PRs, and grow the capability of the wider team.\nPartner with stakeholders - translate the needs of platform consumers, security, and leadership into a clear roadmap and well-specified deliverables.\nEstablish best practices for token optimization, context window management, prompt compression, caching strategies, and cost-efficient AI inference.\nPreferred Qualifications\nPlatform Engineering experience with a strong foundation in building and operating production backend / distributed systems (not just notebooks or POCs). Knowledge of AI governance, security, responsible AI, and compliance requirements. Demonstrated ability to proliferate GenAI capabilities at scale in a safe, secure and integrable way.\nMust Have\nDeep proficiency in Python (and comfort with at least one of Go / Java / TypeScript for services and tooling).\nHands-on experience building LLM-powered systems in production - integrating LLM APIs, RAG pipelines, prompt orchestration, and / or agentic workflows.\nSolid API and platform design skills: designing clean, versioned, provider-agnostic interfaces that other teams consume.\nPractical experience with cloud platforms (AWS / GCP / Azure), containerization (Docker, Kubernetes), and CI/ CD.\nWorking knowledge of the GenAI ecosystem - vector databases (pgvector, Pinecone, Milvus, Weaviate), orchestration frameworks (LangGraph, LangChain, CrewAI, LlamaIndex), and evaluation tooling.\nStrong grasp of LLMOps / MLOps concerns: observability, cost control, versioning, rollout strategies, and reliability.\nA security- and reliability-first mindset - you think about guardrails, data governance, failure modes, and blast radius by default.\nStrong understanding of Model parameters and tuning , Prompt strategies , Cost, latency, and quality optimization , Model selection and benchmarking methodologies\nDemonstrated technical leadership: driving architecture and delivering complex systems end-to-end.\nNice-to-Haves\nExperience building internal developer platforms, API gateways, or multi-tenant infrastructure.\nExposure to model serving / inference optimization (vLLM, TGI, quantization, GPU scheduling) or selfhosting open-weight models.\nFamiliarity with fine-tuning / adapters (LoRA), embeddings model selection, and evaluation methodology.\nExperience with cost governance, chargeback / showback, or FinOps for AI workloads.\nContributions to open-source GenAI tooling or frameworks.\nDomain experience in a regulated industry (fintech, healthcare) where data governance is critical.\nHow Your Work Impacts the Organization\nThe Technology Foundations (TF) group provides ready-to-use solutions composed of a standard technology stack, development frameworks, reusable software components and services. The ideal candidate must be a solid team player with a strong understanding of the application delivery cycle: design, development, build, and deployment. The candidate will play an important role in developing integrable, cohesive GenAI platform capabilities working on one of our Technology Foundations Products, Opinionated Deployment Pipelines, Gen AI Foundation and Services.\nBU Overview -\nAsset Management Technology (AMT) supports the Information Technology needs of several investment management organizations within Fidelity Investments, including FMRCo, FIL Investment Management, Pyramis, and Strategic Advisors. There are several technology teams in US / India which work together as a delivery team in providing solutions to the business. ATF (Architecture Technology Foundation) is a technology horizontal for AMT that provides shared technology solution and services by working closely with the IT partner teams and understanding their business requirements.\nLocation: Bangalore - Manyata\nShift timings: 11:00 pm - 8:00pm\nCertifications:\nCategory:\nInformation Technology","description_format":"text","description_chars":7036,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Wealth Management & Financial Advisors","Asset Management & Funds","Online Brokerage & Trading Platforms"],"lifecycle":[{"event":"open","at":"2026-11-17T13:08:32Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":19,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-17T14:28:10Z"},"pay":null,"html_url":"https://alion.io/job/fidelity-investments-lead-software-engineer-5","json_url":"https://alion.io/job/fidelity-investments-lead-software-engineer-5.json","meta":{"generated_at":"2026-11-17T14:28:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":25314,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":21095},"rest":"https://alion.io/mcp/rest/get_company?id=21095"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffidelity-investments-lead-software-engineer-5"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffidelity-investments-lead-software-engineer-5"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffidelity-investments-lead-software-engineer-5"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/fidelity-investments-lead-software-engineer-5\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffidelity-investments-lead-software-engineer-5"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4459780}},{"tool":"search_jobs","arguments":{"company":"fidelity.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4459780},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}