{"id":3824812,"url":"https://alion.io/job/zillow-principal-data-scientist","title":"Principal Data Scientist","company":{"id":7010,"name":"Zillow","domain":"zillow.com","url":"https://alion.io/company/zillow","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":98,"open_postings":48,"ghost_share":0,"stale_share":0.271,"repost_share":0.042,"time_to_fill_p50_days":19,"computed_at":"2026-11-06T05:58:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":182100,"max":290900,"currency":"USD","period":"year","gross":null,"usd_annual":290900},"salary_estimate":null,"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"A/B Testing","optional":false},{"name":"AI Agents","optional":false},{"name":"Braintrust","optional":false},{"name":"LLM","optional":false},{"name":"NLP","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Time Series","optional":false},{"name":"LLM Evaluation","optional":true},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2026-11-05T18:08:56Z","employer_posted_date":"2026-11-05","last_verified_at":"2026-11-06T10:00:44Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About the team\nAt Zillow Group, our mission is to help more people get home. The CoreTech Org delivers on this mission by building the foundational platforms, data, and developer capabilities that power every consumer, partner, and employee experience at Zillow.You will work most closely with the Connections Platform (CP) - the engine that turns consumer interest into a connection with the right partner, owning the conversational experience, the lead funnel and follow-up workflows, and the shared agent services that sit underneath both. Increasingly, that experience is powered by LLM-based and agentic systems: agents that qualify leads, summarize and extract intelligence from conversations for partner teams, and drive proactive outreach. Beyond CP, you will be a measurement partner for the broader CoreTech Org - the foundational platforms every consumer, partner, and employee experience at Zillow is built on - wherever a hard data science problem needs an owner.\nThese are platforms with hundreds of touchpoints and dozens of dependent teams - and they have historically been among the hardest places at Zillow to measure well. CP itself is mid-transformation, shifting from NLP to LLM and agent-based systems, with agents increasingly built and relied on in production but no rigorous way to evaluate them yet. That combination - high dependency, hard-to-measure, and changing fast - is exactly where rigorous measurement creates the most leverage.\nAbout the role\nWe are seeking a Principal Data Scientist to be a measurement and impact partner in CoreTech. This is a senior individual-contributor role embedded with the Data & Infrastructure Platform team and who will partner tightly with Product leadership.\nYou will own four outcomes: (1) make the impact of platform work legible - quantifying what shipped, what moved, and what didn’t, in terms leaders can act on; (2) define the metrics that matter for CP and the other platforms you take on - what belongs on a progress dashboard, what is a leading vs. lagging indicator, and what is vanity; (3) build the evaluation layer CP is missing - standing up rigorous, repeatable evals for its LLM and agentic systems (including LLM-as-a-judge) so the team can tell whether an agent actually works, not just that it shipped; and (4) operationalize and instrument those metrics and evals in partnership with engineering - getting the events emitted, the pipelines stable, the dashboards live, and the data trusted.\nThe defining challenge of this role is twofold. The first is measuring causal impact: CP has live, expensive, executive-facing questions that hinge on making a credible impact claim when a clean A/B test isn’t available - conversational and agent-driven flows that span a lead’s journey across sessions and channels, and changes that roll out to everyone at once. The second is establishing an evaluation feedback loop: much of CP now runs on LLM-based and agentic systems that were built by engineers with no rigorous way to measure whether they actually work. You will own how we evaluate these systems - defining the signals that matter, standing up eval and experimentation frameworks (including LLM-as-a-judge), and separating activity and adoption from genuine quality and outcomes. The same question recurs across CoreTech in many different areas, and you will need to help prove whether new features or infrastructure actually pay off, rather than trusting activity or adoption as proof. Owning these questions is the heart of the job.\nThis is a high-leverage, cross-Zillow role: your work will set the measurement bar for platforms every product team at Zillow depends on, and your point of view will directly shape how Data & Infrastructure Platform OKRs are written and reviewed at the executive level.\nYou will:\n\nDefine and operationalize the measurement strategy for the Connections Platform and the broader Data & Infrastructure Platform team - owning the throughline from raw events to executive dashboards and causal inference attribution.\nOwn the evaluation of CP’s LLM-based and agentic systems: design the evals, define the quality signals, and build the frameworks (including LLM-as-a-judge and using tooling such as Braintrust) that tell us whether an agent is actually working.\nOwn the causal inference and experimentation program for these teams: design and analyze A/B tests where you can, and where you can’t, build the quasi-experimental causal inference design (switchbacks, difference-in-difference, synthetic control, interrupted time-series) that produces a defensible estimate of impact. Know which method the situation calls for, what assumptions it rests on, and make the call for the best method to answer each hard question. \nBe the credible authority on “what to measure” and “what to experiment on” for these teams - pushing back on vanity metrics, identifying the leading indicators we’ve been missing, and knowing which signals actually reflect the customer experience.\nOwn the impact dimension that platform measurement usually lacks - connecting adoption of CP’s agents and other platform investments to business and revenue outcomes, not just activity, speed, and quality signals.\nPartner with engineering ICs to instrument the metrics: events, schemas, and pipelines needed to get quality measurements. Engineers will wire up the engine; you make the data infrastructure for these surfaces something teams can trust, and you shape what gets emitted in the first place.\nTranslate complex measurement realities into clear narratives for VP and C-level partners, including the trade-offs they need to consider.\nSet the bar for how data science is practiced inside platform teams at Zillow , treating the platform itself as a product whose adoption, quality, and impact get measured as rigorously as any consumer product (Platform-as-a-Product measurement). \nHelp decipher the impact of product changes that are multi-dimensional at once - touching consumers, partners, and developers, and carrying real business and revenue stakes. \nThis role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice, which must be identified to the Company. U.S. employees may live in any of the 50 United States, with limited exceptions.In California, Connecticut, Maryland, Massachusetts, New Jersey, New York, Washington state, and Washington DC the standard base pay range for this role is $182,100.00 - $290,900.00 annually. This base pay range is specific to these locations and may not be applicable to other locations.\n\nIn Colorado, Hawaii, Illinois, Maine, Minnesota, Nevada, Ohio, Rhode Island, Vermont, and Virginia the standard base pay range for this role is $173,000.00 - $276,400.00 annually. The base pay range is specific to these locations and may not be applicable to other locations.In addition to a competitive base salary this position is also eligible for equity awards based on factors such as experience, performance and location. Actual amounts will vary depending on experience, performance and location. Employees in this role will not be paid below the salary threshold for exempt employees in the state where they reside.Who you are\nSenior data scientist with internal-customer and/or platform measurement experience. 10+ years in Data Science, UX Research, or Applied Science, including meaningful time measuring products where the customer is a developer, an internal team, or a platform. You have led the measurement of platform products - where adoption, partner teams, and downstream outcomes all matter - and you know why that’s harder, not easier.\nFluent in evaluating complex user-facing systems. You have designed evals for products where quality is hard to pin down - using the right tool for the job, from labeled test sets and human review to LLM-as-a-judge. You can separate adoption and activity from genuine quality, turning “the experience feels better” into a defensible number.\nCausal-inference and experimentation-fluent. You have owned the design and analysis of A/B tests and causal inference methodology in production - and you’ve expertly made the call between which method is the most appropriate to answer a hard question. \nMetric architect, not dashboard operator. You have deep experience designing primary metrics, KPIs, OKR metric definitions, and leading and lagging indicator systems from scratch. You can tell the difference between a measurement problem and an instrumentation problem, and you fix the right one first.\nEngineering-credible operator. You can sit with a staff engineer and design the event taxonomy, debug the methodology, and push back on the schema - not hand a spec over the wall. You write your own Python and SQL, and you’ve shipped instrumentation others can build on - repeatable, reliable, and documented enough that another team could adopt it - not just consumed what someone else produced. \nExecutive translator. You can land a measurement narrative with a VP or Senior Director without losing rigor - and you know which assumptions to surface up and which to keep in the appendix.\nBuilder-mentality individual contributor. You write your own code, model your own data, and prototype your own evals and dashboards. You raise the bar that the team’s daily work is rigorous and repeatable, and you make the ICs around you better by doing it visibly.\nPreferred qualifications:\n PhD and 4+ years, MS and 6+ years, or BS and 8+ years of experience in Statistics, Econometrics, Data Science, User Experience Research, Machine Learning, Operations Research, or a related quantitative field.\nDirect experience measuring complex, production user-facing systems - for example, non-deterministic ones such as conversational, LLM-based, or agentic products (chat and voice assistants, lead or conversation funnels, agent-driven workflows). \nFluency with modern evaluation methods and the judgment to know which signals to trust - approaches like LLM-as-a-judge and offline/online eval harnesses, or adjacent evaluation experience.\nExperience measuring the impact of AI or agentic tooling on real outcomes - separating adoption and activity from genuine productivity or quality gain, and reasoning about ROI against spend.\nExperience operating inside a Platform-as-a-Product model with internal teams as customers.\nFluency with quasi-experimental and causal inference methods for when randomization isn’t possible - difference-in-difference, synthetic control, interrupted time-series, and switchback or interleaved designs - including the discipline to state assumptions explicitly and be clear about what you can and cannot measure.\nGet to know us\nAt Zillow, we’re reimagining how people move-through the real estate market and through their careers. As the most-visited real estate platform in the U.S., we help people navigate buying, selling, financing and renting with greater ease and confidence. Whether you're working in tech, sales, operations, or design, you’ll be part of a company reshaping an industry and helping more people make home a reality.\nHow we work is a key part of that transformation. Through Cloud HQ, our strategic approach to distributed work, most employees have the flexibility to work from wherever they’re most productive-enabling us to move fast, stay connected and deliver on our people promise.\nZillow is honored to be recognized among the best workplaces in the U.S. Zillow was named one of FORTUNE 100 Best Companies to Work For® in 2026, and included on TIME’s America’s Best Companies 2026 list, reflecting our commitment to creating an innovative, inclusive, and engaging culture where employees are empowered to grow.\nNo matter where you sit in the organization, your work will help drive innovation, support our customers, and move the industry-and your career-forward, together.\nZillow Group is an equal opportunity employer committed to fostering an inclusive,...","description_format":"text","description_chars":13508,"description_truncated":true,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Property Management","PropTech","Real Estate Brokerage","Mortgage Lending & Brokers"],"lifecycle":[{"event":"open","at":"2026-11-05T18:08:56Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 94 · green card filings: 26","filings_12m":94,"filings_prev_12m":150,"green_card_filings_12m":26,"median_offered_wage_usd":171833,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":18}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":19,"reasons":["conf:1","velocity","win:early","comp:brand"],"computed_at":"2026-11-06T05:58:05Z"},"pay":{"stated_usd_annual":290900,"is_top_pay":true},"html_url":"https://alion.io/job/zillow-principal-data-scientist","json_url":"https://alion.io/job/zillow-principal-data-scientist.json","meta":{"generated_at":"2026-11-06T11:37:44Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"assistant_verified","counted_by":"address","units_charged":1,"used_today":3771,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7010},"rest":"https://alion.io/mcp/rest/get_company?id=7010"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fzillow-principal-data-scientist"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fzillow-principal-data-scientist"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fzillow-principal-data-scientist"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/zillow-principal-data-scientist\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fzillow-principal-data-scientist"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3824812}},{"tool":"search_jobs","arguments":{"company":"zillow.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3824812},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}