{"id":47899,"url":"https://alion.io/job/state-street-agentic-ai-engineer-assistant-manager","title":"Generative AI Quality Engineer– Tech Lead","company":{"id":1806,"name":"State Street","domain":"statestreet.com","url":"https://alion.io/company/state-street","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":97,"open_postings":338,"ghost_share":0.015,"stale_share":0.24,"repost_share":0.047,"time_to_fill_p50_days":21,"computed_at":"2026-10-17T05:46:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":17000,"max_usd":44000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":34},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Jira","optional":false},{"name":"LLM","optional":false},{"name":"OpenAI Evals","optional":false},{"name":"Postman","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Ragas","optional":false},{"name":"Red Teaming","optional":false},{"name":"Selenium","optional":false},{"name":"CI/CD","optional":true},{"name":"Git","optional":true},{"name":"Jenkins","optional":true},{"name":"JMeter","optional":true},{"name":"Machine Learning","optional":true},{"name":"SoapUI","optional":true}],"status":"live","first_seen_at":"2026-08-08T00:00:00Z","employer_posted_date":"2026-10-14","last_verified_at":"2026-10-17T02:12:17Z","board_verified":true,"closed_at":null,"days_open":70,"trust":{"level":"ok","repost_count":1,"flags":[],"days_open":70},"description":"Senior Associate - Gen AI Quality Engineer\nAbout the Role\nWho we are looking for\nWe are looking for Software Quality Assurance Testers with 3-8 years of experience, with exposure or interest in LLM (Large Language Model) testing and Agents testing. This role involves analyzing business and technical specifications, defining and executing test cases, and capturing and tracking defects.\nYou will work on Artificial Intelligence initiatives within a multidisciplinary team focused on emerging trends, cutting-edge technologies, and their application in financial services for our clients.\nThis role supports a hybrid work model, allowing you to balance work from home and office based on your needs and role requirements.\nWhat you will be responsible for\nAs an SQA Tester, you will:\nAnalyze business and technical specifications.\nWrite functional test cases and perform regression testing.\nReport bugs, verify fixes, and maintain the bug tracking system (e.g., Jira).\nMaintain and execute automated tests using Selenium with Python.\nCreate automated test scripts using the Pytest framework.\nAutomate web services using Postman and/or Python.\nExecute test plans for Large Language Models (LLMs), including prompt validation, accuracy checks, and basic safety evaluation.\nSupport Agents testing for AI-driven workflows to ensure reliability, robustness, and integration quality.\n\nWhat we value\nThese skills will help you succeed in this role:\nAbility to understand customer/business user needs and translate them into test scenarios.\nStrong analytical, technical, and problem-solving skills with attention to detail.\nAbility to manage time effectively and prioritize tasks while working within deadlines.\nExperience with BDD & TDD (Gherkin).\nExperience using Jira as an agile management tool.\nExperience in using Selenium with Python for test automation.\nExperience in testing LLMs, including prompt-response validation and evaluation of model accuracy and relevance.\nExposure to red teaming for identifying vulnerabilities and edge cases in LLMs (preferred but not mandatory at junior level).\nFamiliarity with evaluation tools such as OpenAI Evals, Ragas, or custom benchmarking suites (good-to-have).\n\nEducation & Preferred Qualifications\n3-8 years of software quality assurance testing experience.\nExperience with tools like PyCharm, VS Code, Git, Fiddler, Postman, SoapUI, JMeter, Jenkins, Jira.\nExperience in CI/CD-based projects.\nHands-on experience or strong exposure to LLM testing and Agents testing is highly preferred.\n\nAdditional Requirements\nBasic understanding of artificial intelligence and machine learning concepts is preferred.\nFamiliarity with AI governance, bias detection, and safety validation will be an added advantage.\n\nWork Schedule\nOn-premise\nAbout State Street\nAcross the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.\nWe are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.\nAs an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.\nDiscover more information on jobs at StateStreet.com/careers\nRead our CEO Statement","description_format":"text","description_chars":3963,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Hybrid work"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Asset Management & Funds","Custody & Fund Administration"],"lifecycle":[{"event":"open","at":"2026-08-08T00:00:00Z"},{"event":"close","at":"2026-08-10T18:52:36Z"},{"event":"reopen","at":"2026-10-14T07:24:40Z"}],"visa":[],"liveness":{"score":15,"band":"cold","label":"Long shot","p_open":1,"p_active":0.544,"p_room":0.28,"age_days":70,"expected_fill_days":21,"reasons":["conf:3","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/state-street-agentic-ai-engineer-assistant-manager","json_url":"https://alion.io/job/state-street-agentic-ai-engineer-assistant-manager.json","meta":{"generated_at":"2026-10-17T08:10:05Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11023,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1806},"rest":"https://alion.io/mcp/rest/get_company?id=1806"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fstate-street-agentic-ai-engineer-assistant-manager"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fstate-street-agentic-ai-engineer-assistant-manager"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fstate-street-agentic-ai-engineer-assistant-manager"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/state-street-agentic-ai-engineer-assistant-manager\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fstate-street-agentic-ai-engineer-assistant-manager"}]}