{"id":1910745,"url":"https://alion.io/job/bny-senior-vice-president-ai-machine-learning-software-engineer-3","title":"Senior Vice President, AI / Machine Learning Software Engineer","company":{"id":1764503,"name":"BNY","domain":"bny.com","url":"https://alion.io/company/bny","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":{"grade":"A","score":85,"open_postings":121,"ghost_share":0,"stale_share":0.62,"repost_share":0,"time_to_fill_p50_days":57,"computed_at":"2026-10-28T05:59:10Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"head","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Jersey City, United States","New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":120000,"max":200000,"currency":"USD","period":"year","gross":null,"usd_annual":200000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Feature Store","optional":false},{"name":"Incident Management","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangChain","optional":false},{"name":"LlamaIndex","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"MLFlow","optional":false},{"name":"RAG","optional":false},{"name":"Platform Engineering","optional":true}],"status":"live","first_seen_at":"2026-10-05T12:16:27Z","employer_posted_date":"2026-10-05","last_verified_at":"2026-10-29T02:53:10Z","board_verified":true,"closed_at":null,"days_open":23,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":23},"description":"At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world’s investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide.\nRecognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance - and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary.\nRole Overview\nWe are seeking a senior-level engineer to design, build, and operate production -grade GenAI and Retrieval - Augmented Generation (RAG) platforms at scale. This role focuses on industrializing LLM-based systems with strong guardrails, observability, evaluation frameworks, and operational rigor, ensuring reliability, safety, and cost efficiency across the full AI lifecycle. This role is located in Jersey City, NJ.\nKey Responsibilities\nDesign and build production -ready RAG pipelines, including retrieval, ranking, prompt orchestration, and response generation, with comprehensive guardrails, tracing, and observability.\nImplement offline and online evaluation frameworks for prompts, models, and datasets, including quality, safety, latency, and cost metrics.\nOwn end -to -end lifecycle management for GenAI systems, covering prompt versions, model versions, datasets, and configurations.\nEstablish and maintain CI/CD pipelines for prompts, models, and data, enabling safe, repeatable, and auditable releases.\nImplement cost and performance monitoring, including token usage, inference latency, throughput, and spend optimization.\nBuild and enforce safety mechanisms, such as content filtering, policy enforcement, red-teaming feedback loops, and abuse detection.\nDefine and operationalize incident management workflows, including alerting, triage, rollback mechanisms, and post-incident analysis.\nPartner closely with product, platform, and governance teams to ensure GenAI solutions meet enterprise reliability, security, and compliance standards.\nMentor engineers and influence best practices for building scalable, trustworthy AI systems.\nRequired Qualifications\nStrong experience building and operating production ML or GenAI systems in enterprise environments.\nDeep hands-on expertise with LLM orchestration frameworks, such as LangChain and/or LlamaIndex.\nExperience with model registries and experiment tracking, such as MLflow or equivalent.\nSolid understanding of Kubernetes -based deployments and cloud-native architectures.\nFamiliarity with feature stores, data pipelines, and retriever/index lifecycle management.\nProven experience implementing telemetry, logging, metrics, and distributed tracing for ML/AI workloads.\nStrong knowledge of CI/CD practices for ML, GenAI, and data-driven systems.\nPreferred Qualifications\nExperience operating LLM systems at scale, including multi-model or multi-provider strategies.\nExposure to AI safety, governance, and compliance frameworks in regulated environments.\nBackground in SRE, platform engineering, or MLOps, with a reliability-first mindset.\nAbility to translate ambiguous GenAI use cases into robust, production -grade architectures.\nWhat Success Looks Like\nGenAI systems that are observable, measurable, and resilient, not “black boxes.”\nSafe and cost-efficient RAG pipelines running reliably in production.\nFast iteration cycles with strong controls, enabling teams to ship GenAI features with confidence.\nAt BNY, our culture speaks for itself, check out the latest BNY news at:\nBNY Newsroom\nBNY LinkedIn\nHere’s a few of our recent awards:\nAmerica’s Most Innovative Companies, Fortune, 2025\nWorld’s Most Admired Companies, Fortune 2025\n“Most Just Companies”, Just Capital and CNBC, 2025\nOur Benefits and Rewards:\nBNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life’s journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.\nBNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.\nBNY assesses market data to ensure a competitive compensation package for our employees. The base salary for this position is expected to be between $120,000 and $200,000 per year at the commencement of employment. However, base salary if hired will be determined on an individualized basis, including as to experience and market location, and is only part of the BNY total compensation package, which, depending on the position, may also include commission earnings, discretionary bonuses, short and long-term incentive packages, and Company-sponsored benefit programs.\nThis position is at-will and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation) at any time, including for reasons related to individual performance, change in geographic location, Company or individual department/team performance, and market factors.","description_format":"text","description_chars":5534,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Financial Services","Natural Language Processing","Wealth Management & Financial Advisors","Property & Casualty Insurance"],"lifecycle":[{"event":"open","at":"2026-10-05T14:32:36Z"}],"visa":[],"liveness":{"score":57,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":0.9,"age_days":22,"expected_fill_days":57,"reasons":["conf:2","stale_co","velocity","win:mid","comp:brand"],"computed_at":"2026-10-28T05:59:10Z"},"pay":{"stated_usd_annual":200000,"is_top_pay":false},"html_url":"https://alion.io/job/bny-senior-vice-president-ai-machine-learning-software-engineer-3","json_url":"https://alion.io/job/bny-senior-vice-president-ai-machine-learning-software-engineer-3.json","meta":{"generated_at":"2026-10-29T05:52:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9037,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1764503},"rest":"https://alion.io/mcp/rest/get_company?id=1764503"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbny-senior-vice-president-ai-machine-learning-software-engineer-3"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbny-senior-vice-president-ai-machine-learning-software-engineer-3"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbny-senior-vice-president-ai-machine-learning-software-engineer-3"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/bny-senior-vice-president-ai-machine-learning-software-engineer-3\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbny-senior-vice-president-ai-machine-learning-software-engineer-3"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1910745}},{"tool":"search_jobs","arguments":{"company":"bny.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1910745},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}