{"id":3148621,"url":"https://alion.io/job/citi-forward-deployed-engineer-avp","title":"Forward Deployed Engineer - AVP","company":{"id":7841,"name":"Citi","domain":"citi.com","url":"https://alion.io/company/citi","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":100,"open_postings":512,"ghost_share":0.006,"stale_share":0.131,"repost_share":0.072,"time_to_fill_p50_days":9,"computed_at":"2026-10-31T05:58:55Z"}},"role":"Solutions","role_family":"Solutions","seniority":"head","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":109000,"max_usd":242000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":291},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"Docker","optional":false},{"name":"Git","optional":false},{"name":"gRPC","optional":false},{"name":"Hallucination","optional":false},{"name":"Jenkins","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Pydantic","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Tekton","optional":false},{"name":"Kubernetes","optional":true}],"status":"live","first_seen_at":"2026-10-21T00:00:00Z","employer_posted_date":"2026-10-21","last_verified_at":"2026-10-31T06:57:21Z","board_verified":true,"closed_at":null,"days_open":10,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":10},"description":"About the Team:\nBuild the next generation of agentic AI.\n\nThe Applied AI and Agents Factory brings together ambitious engineers to turn advanced AI capabilities into production-ready solutions. Working directly with business and technology teams, you’ll tackle complex engineering challenges, build intelligent agents and take ideas from initial concept through to live deployment.\nThis is an opportunity to work at the cutting edge of AI engineering, developing systems that go beyond conversational tools to reason, plan and execute multi-step workflows. You’ll build reliable agent workflows, integrate AI with enterprise systems and ensure solutions perform securely and consistently in production.\nWith a strong focus on hands-on engineering, collaboration and rapid delivery, the Factory gives you the opportunity to solve challenging technical problems, develop your expertise and contribute reusable tools and engineering practices that support AI adoption across Citi.\nIf you want to do more than experiment with AI - and build, deploy and scale systems that deliver real business value - this is where you can make your mark.\nAbout the Role:\nThe Forward Deployed Engineer is an intermediate-level software engineering position responsible for constructing automated evaluation harnesses, curating regression testbeds, optimizing prompts and output schemas, and automating testing pipelines within embedded LOB delivery pods. The overall objective of this role is to ensure the reliability, accuracy, and safety of production AI agents by building rigorous evaluation suites in Agentflow Studio and driving automated CI/CD test execution.\nResponsibilities:\nConducts tasks related to the construction, calibration, and execution of automated evaluation test suites using Agentflow Studio, measuring agent task completion, tool call correctness, latency, and hallucination metrics.\nCurates and maintains domain-specific golden datasets, synthetic benchmarks, and regression testbeds in collaboration with LOB domain experts and senior engineers.\nOptimizes prompt templates, system instructions, few-shot examples, and structured JSON output parsers (Pydantic/JSON Schema) to maximize deterministic agent behavior.\nAuthors and maintains automated test execution and deployment pipelines within Lightspeed CI/CD, enforcing continuous evaluation gates prior to staging and production rollout.\nUtilizes in-depth specialty knowledge of Python applications development to analyze complex agent errors, evaluate system performance, and recommend advanced coding and prompt solutions.\nRecommends and implements security measures and Lakera Guardrail policies in post-implementation analysis of agent usage to ensure safe functionality.\nMonitors and controls evaluation test cycles, providing operational support, performance metrics, and prompt diagnostic reporting to business stakeholders and squad leads.\nHas the ability to operate with a limited level of direct supervision, exercising independence of judgement and autonomy while acting as an evaluation SME to pod team members.\nAppropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.\nQualifications:\nRelevant software engineering or systems analysis experience or a specialized focus in Python and Generative AI application development).\nSolid Python programming proficiency, with practical experience integrating REST/gRPC APIs, Docker containers, and Git workflows.\nStrong working knowledge of AI evaluation frameworks, benchmarking methodologies (BLEU, ROUGE, semantic similarity, LLM-as-a-judge), and automated testing suites.\nExperience in managing and implementing automated test pipelines in CI/CD environments (Lightspeed, Tekton, Jenkins).\nAbility to work effectively under pressure, managing tight sprint deadlines and unexpected changes in model outputs or LOB requirements.\nGood written and verbal communication skills with a methodical, detail-oriented approach to software quality and data integrity.\nEducation:\nBachelor’s/University degree or equivalent experience in Computer Science, Data Science, or related quantitative discipline.\nWhat we’ll provide you\nThis is a unique role that will put you in the position to be part of a new venture and actively drive change. Every day there will be new challenges that will help you develop new skills that can drive your career.\nBy joining Citi London, you will not only be part of a business casual workplace with a hybrid working model (up to 2 days working at home per week), but also receive a competitive base salary (which is annually reviewed), and enjoy a whole host of additional benefits such as:\n27 days annual leave (plus bank holidays)\nA discretional annual performance related bonus\nPrivate Medical Care & Life Insurance\nEmployee Assistance Program\nPension Plan\nPaid Parental Leave\nSpecial discounts for employees, family, and friends \nVisit our Global Benefits page to learn more.\nAlongside these benefits Citi is committed to ensuring our workplace is where everyone feels comfortable coming to work as their whole self, every day. We want the best talent around the world to be energized to join us, motivated to stay and empowered to thrive.\n#LI-AH4\n------------------------------------------------------\nJob Family Group:\nTechnology------------------------------------------------------\nJob Family:\nApplications Development------------------------------------------------------\nTime Type:\nFull time------------------------------------------------------\nMost Relevant Skills\nPlease see the requirements listed above.------------------------------------------------------\nOther Relevant Skills\nFor complementary skills, please see above and/or contact the recruiter.------------------------------------------------------\nCiti is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.\nIf you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.\nView Citi’s EEO Policy Statement and the Know Your Rights poster.","description_format":"text","description_chars":6645,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Annual leave","Hybrid work","Life insurance","Parental leave"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cards & Card Issuing","Wealth Management & Financial Advisors","Payment Processing & Gateways","Investment Banking & M&A Advisory"],"lifecycle":[{"event":"open","at":"2026-10-23T11:19:44Z"}],"visa":[],"liveness":{"score":49,"band":"ok","label":"Likely open","p_open":1,"p_active":0.882,"p_room":0.55,"age_days":10,"expected_fill_days":9,"reasons":["conf:3","velocity","win:tail","comp:brand"],"computed_at":"2026-10-31T05:58:55Z"},"pay":null,"html_url":"https://alion.io/job/citi-forward-deployed-engineer-avp","json_url":"https://alion.io/job/citi-forward-deployed-engineer-avp.json","meta":{"generated_at":"2026-10-31T10:43:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":16483,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7841},"rest":"https://alion.io/mcp/rest/get_company?id=7841"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fciti-forward-deployed-engineer-avp"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fciti-forward-deployed-engineer-avp"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fciti-forward-deployed-engineer-avp"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/citi-forward-deployed-engineer-avp\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fciti-forward-deployed-engineer-avp"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3148621}},{"tool":"search_jobs","arguments":{"company":"citi.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3148621},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}