{"id":35226,"url":"https://alion.io/job/sony-interactive-entertainment-sr-software-development-engineer-in-test-aiml","title":"Sr. Software Development Engineer in Test, AI/ML","company":{"id":51674,"name":"Sony Interactive Entertainment","domain":"sonyinteractive.com","url":"https://alion.io/company/sony-interactive-entertainment","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":84,"open_postings":31,"ghost_share":0,"stale_share":0.645,"repost_share":0,"time_to_fill_p50_days":56,"computed_at":"2026-10-20T05:45:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Mateo, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":183000,"max":274600,"currency":"USD","period":"year","gross":null,"usd_annual":274600},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Appium","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Cypress","optional":false},{"name":"Docker","optional":false},{"name":"GCP","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Hallucination","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Java","optional":false},{"name":"Jenkins","optional":false},{"name":"JUnit","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Playwright","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Selenium","optional":false},{"name":"Databricks","optional":true},{"name":"JavaScript","optional":true},{"name":"KServe","optional":true},{"name":"Node JS","optional":true},{"name":"Ray","optional":true},{"name":"Ray Serve","optional":true},{"name":"React.js","optional":true},{"name":"Seldon Core","optional":true}],"status":"live","first_seen_at":"2026-06-04T17:18:31Z","employer_posted_date":"2026-09-17","last_verified_at":"2026-10-20T17:57:29Z","board_verified":true,"closed_at":null,"days_open":138,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":138},"description":"Why Sony Interactive Entertainment?\nSony Interactive Entertainment isn’t just the Best Place to Play - it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity.\nSenior Software Development Engineer In Test, ML/AI\nAt SIE, we believe in making play safer for everyone. Within our Information Security team, we protect our people, platforms, and products with smart, scalable, and thoughtful solutions. Our mission is to provide clear, actionable risk and security insights that guide the business and enable amazing player experiences.\nWe’re building a team that thrives on collaboration, curiosity, and delivering real value. Come help us make a difference!\nOverview\nWe are hiring a Sr Software Engineer in Test specializing in ML/AI quality, including automation for model evaluation, LLM-assisted test generation, and validation of AI-powered workflows. The role includes guiding quality strategy and developing automation frameworks. You will also manage implementation for complex, cross-functional, machine learning-powered products and services. This role involves more than test development. You will lead quality initiatives from start to finish, ensuring teams stay synchronized, dependencies are managed, and releases are delivered confidently. You will work closely with ML, engineering, product, and infrastructure teams. You will shape how quality is built, monitored, and expanded while leading embedded QE efforts within projects.\nWhat you’ll do\nDefine and complete quality strategies, test plans, and automation coverage for ML-powered services and platform components.\nUse LLMs and other AI-assisted techniques to generate, expand, and maintain high-value test cases for ML-powered workflows.\nDesign scenario-based test suites for AI features, including adversarial prompts, edge cases, ambiguous inputs, and underrepresented user scenarios.\nLead QE efforts for multi-functional projects, driving risk assessment, dependency management, and release readiness.\nDesign, develop, and maintain scalable automation frameworks for backend services, APIs, and ML inference systems using Python and/or Java.\nBuild automated validation for ML and LLM outputs, including ranking behavior, score distributions, prompt/response quality, hallucination indicators, and probabilistic model evaluation.\nDebug test failures, service anomalies, model inconsistencies, and AI behavior regressions to identify root causes and drive resolution.\nPerform functional, integration, regression, API, end-to-end, performance, and reliability testing for distributed systems.\nImprove automation reliability, reduce flakiness, and optimize execution efficiency.\nPartner with engineering and ML teams to integrate automated testing into CI/CD pipelines and release workflows.\nCollaborate across teams to establish scalable quality standards, tooling, and guidelines.\nRequired qualifications\nBachelor’s degree in Computer Science or equivalent\n5+ years of experience as an SDET or QE engineer focused on backend and distributed systems.\nExperience using LLMs to generate, transform, and prioritize test cases for AI-powered experiences.\nExperience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows.\nStrong experience testing RESTful APIs, microservices, and distributed architectures.\nProficiency in Python, Java, JS or similar languages for automation development.\nHands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium.\nExperience with CI/CD systems and test pipelines (Jenkins, GitHub Actions, etc.).\nExperience with cloud and container technologies (AWS, GCP, Kubernetes, Docker).\nFamiliarity with databases, monitoring, and observability tools.\nStrong understanding of SDLC, Agile methodologies, and release processes.\nExcellent problem-solving, debugging, and communication skills.\nPreferred qualifications\nExperience validating ML outputs using statistical analysis or scenario-based testing approaches.\nFamiliarity with ML infrastructure, data pipelines, or model-serving platforms (Seldon, KServe, Ray Serve, etc.).\nPrior work in content moderation ML, security, fraud detection, or adversarial ML.\nExperience testing high-scale, low-latency online services.\nExperience with Databricks or similar ML platform tooling.\nFamiliarity with Node.js, React, or modern frontend technologies.\nExperience testing mobile, console, or other non-PC platforms.\nWhat sets you apart\nStrong combination of automation engineering and delivery ownership.\nAbility to drive quality across complex cross-functional initiatives.\nPractical understanding of how to test non-deterministic AI systems and separate model variance from quality regressions.\nProven risk management and dependency coordination skills.\nAbility to influence engineering teams and promote quality guidelines.\nPassion for scalable, reliable, and maintainable automation systems.\nAt SIE, we consider several factors when setting each role’s base pay range, including the competitive benchmarking data for the market and geographic location.\nPlease note that the base pay range may vary in line with our hybrid working policy and individual base pay will be determined based on job-related factors which may include knowledge, skills, experience, and location. \nIn addition, this role is eligiblefor SIE’s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time off, wellness program and coveted employee discounts for Sony products. This role also may be eligible for a bonus package.Click here to learn more.\nThe estimated base pay range for this role is listed below.\n$183,000—$274,600 USD\nPlease note, Sony Interactive Entertainment conducts background checks at the offer stage for all new employees (which may include criminal background checks for some roles) and will need to process personal information to support these checks.\nPlease refer to our Candidate Privacy Notice for more information about what personal information we collect, how we use it, who we share it with, and your data protection rights.\nEqual Opportunity Statement:\nSony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy, maternity or parental status, trade union membership or membership in any other legally protected category.\nWe strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond. \nSony Interactive Entertainment is a Fair Chance employer and qualified applicants with arrest and conviction records will be considered for employment.","description_format":"text","description_chars":7439,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Hybrid work"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Gaming","Console Games","Gaming Consoles","Game Development"],"lifecycle":[{"event":"open","at":"2026-06-04T17:18:31Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 113 · green card filings: 2","filings_12m":113,"filings_prev_12m":189,"green_card_filings_12m":2,"median_offered_wage_usd":176804,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":63}],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":1,"p_active":0.384,"p_room":0.28,"age_days":137,"expected_fill_days":56,"reasons":["conf:0","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-20T05:45:00Z"},"pay":{"stated_usd_annual":274600,"is_top_pay":true},"html_url":"https://alion.io/job/sony-interactive-entertainment-sr-software-development-engineer-in-test-aiml","json_url":"https://alion.io/job/sony-interactive-entertainment-sr-software-development-engineer-in-test-aiml.json","meta":{"generated_at":"2026-10-20T19:56:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":23041,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":51674},"rest":"https://alion.io/mcp/rest/get_company?id=51674"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsony-interactive-entertainment-sr-software-development-engineer-in-test-aiml"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsony-interactive-entertainment-sr-software-development-engineer-in-test-aiml"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsony-interactive-entertainment-sr-software-development-engineer-in-test-aiml"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sony-interactive-entertainment-sr-software-development-engineer-in-test-aiml\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsony-interactive-entertainment-sr-software-development-engineer-in-test-aiml"}]}