{"id":1352091,"url":"https://alion.io/job/sounds-profitable-senior-product-manager-tech-experimentation-failure","title":"Senior Product Manager - Tech, Experimentation & Failure","company":{"id":1775161,"name":"Sounds Profitable","domain":"soundsprofitable.com","url":"https://alion.io/company/soundsprofitable","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Teamtailor","truth_index":null},"role":"Product","role_family":"Product","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":87000,"max_usd":160000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":37},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"A/B Testing","optional":true}],"status":"closed","first_seen_at":"2026-08-03T13:53:07Z","employer_posted_date":"2026-08-03","last_verified_at":"2026-10-12T11:46:03Z","board_verified":false,"closed_at":"2026-10-12T11:46:03Z","days_open":69,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":69},"description":"SENIOR PRODUCT MANAGER - TECH, EXPERIMENTATION & FAILURE\nCOMPANY:STEVEN.COM\nREPORTING TO:CITO\nLOCATION: LONDON\nABOUTSTEVEN.COM\nSteven.com is building the operating system for the creator economy, forecast to pass a trillion dollars by the early 2030's. This industry is currently held back by fragmented tools and a lack of professional infrastructure.Steven.com is the unlock. We are the end-to-end Operating System designed to scale what is irreplaceably human.\nWe have built proprietary technology and obsessed teams to identify and scale the highest-potential creators across our core pillars:\nCreator Media: Amplifying reach, influence, and trust\n\nCreator Community: Transforming audiences into connected tribes\n\nCreator Products: Providing creators with the infrastructure to build and back aligned products and ventures\n\nPowered by Creator Tech & Intelligence: A proprietary data and technology suite that fuels smarter decisions and drives innovation across the entire flywheel.\n\nOur Experimentation & Failure team has one of the most strategically important and unusual mandates at Steven.com: increase the rate of failure. As Steven Bartlett puts it: \"the path to the correct answer is out-failing your competition.\" This isn't a growth team or an optimisation function. It's the team that exists to make sure we learn faster than anyone else.\nROLE MISSION\nLead the Experimentation & Failure team, reporting to the CITO. You'll out-experiment and out-fail the competition - running high-velocity, rigorous experiments across every show, creator, piece of content, and commercial bet at Steven.com, while building a team and a culture that treats deliberate failure as the primary learning mechanism. This is deeply hands-on: you'll be setting hypotheses, isolating variables, checking statistical power, reading results, and moving to the next test - not directing from a distance.\nKEY OUTCOMES\nOwn and drive the experimentation agenda across every show, creator, and IP property in the FlightStory portfolio - from podcast topic selection and episode structure through to thumbnail design and social tile copy. No detail too small to test.\n\nLead hypothesis formation for every experiment, with clear success, failure, and inconclusive criteria defined in advance - and enforce single-variable discipline across the board.\n\nEnsure every experiment is adequately powered before launch: sample sizes calculated, measurement windows defined, results interpretable by design.\n\nSystematically increase experimentation velocity and build the intake process that makes high-volume testing the default across FlightStory and Steven.com.\n\nBuild institutional memory - a searchable, structured record of every experiment run, what was learned, and what was decided - as a compounding organisational asset.\n\nPartner with the VP of Engineering & Applied AI to apply AI tooling to experiment design, analysis, and reporting, and to ensure infrastructure supports testing at this velocity.\n\nCORE COMPETENCIES\nDeep, first-principles command of experimentation mathematics: statistical significance, power, sample size calculation, p-values, confidence intervals, Type I/II errors, and the difference between statistical and practical significance.\n\nGenuine mastery of the scientific method applied to product and content - hypothesis formation, single-variable isolation, measurement design, and result interpretation.\n\nA track record of building experimentation culture, not just running tests - creating an environment where the whole team experiments and failure is rewarded.\n\nComfortable querying data and working shoulder-to-shoulder with engineers and data scientists at implementation depth.\n\nStrong written and verbal communication - able to write a hypothesis an engineer respects and explain a result a producer will act on.\n\nExperience operating at pace, in high-volume testing environments where speed of learning is the competitive edge.\n\nYOU'LL THRIVE HERE IF\nYou think in hypotheses, not features.\n\nYou isolate one variable at a time, and understand viscerally why changing five things at once makes a result meaningless.\n\nYou give a null or inconclusive result the same intellectual respect as a win - you know how to extract the signal either way.\n\nYou're obsessive about measurement: an experiment that can't be measured is just a change, not an experiment.\n\nYou're deeply sceptical of your own results, and design experiments to prove yourself wrong rather than confirm what you already believe.\n\nYou move fast, expect others to move fast, and don't wait for perfect conditions to run a test.\n\nYou believe failure is feedback, feedback is knowledge, and knowledge is power - and you build systems to generate that knowledge at the highest possible rate.\n\nIDEAL BACKGROUND\nDemonstrable experience leading (not just participating in) product or content experimentation programs at a technology, media, or creator-economy company - owning the methodology, volume, and culture.\n\nStrong advantage: experience with algorithmic platforms and how to design experiments against platform-specific metrics; podcasting, video, social, or creator-economy background; familiarity with YouTube/Spotify/social analytics (CTR, retention, watch time, audience behaviour).\n\nNice to have: experience building an experimentation platform from scratch; familiarity with causal inference beyond standard A/B testing (holdouts, quasi-experiments, diff-in-diff); experience experimenting on AI/ML systems or prompt variations in production; a background in statistics, maths, CS, economics, or a natural science; exposure to early-stage environments where you had to build the experimentation infrastructure yourself.","description_format":"text","description_chars":5706,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Media & Entertainment","Broadcasting"],"lifecycle":[{"event":"open","at":"2026-09-27T19:35:03Z"},{"event":"close","at":"2026-10-12T11:46:03Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/sounds-profitable-senior-product-manager-tech-experimentation-failure","json_url":"https://alion.io/job/sounds-profitable-senior-product-manager-tech-experimentation-failure.json","meta":{"generated_at":"2026-10-23T10:08:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15446,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1775161},"rest":"https://alion.io/mcp/rest/get_company?id=1775161"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsounds-profitable-senior-product-manager-tech-experimentation-failure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsounds-profitable-senior-product-manager-tech-experimentation-failure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsounds-profitable-senior-product-manager-tech-experimentation-failure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sounds-profitable-senior-product-manager-tech-experimentation-failure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsounds-profitable-senior-product-manager-tech-experimentation-failure"}]}