2,355,882open jobs
147,442companies
284,636added this week
Browse all
Salary
$130k – $150k per year
Location
Hybrid (Boston, United States)
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 18, 2026. First seen by Alion on Nov 10, 2026.

Overview
Company
Impact
Profile match
Workshop Ventures is a venture studio that invests and builds alongside founders in climate and education. Its portfolio includes Medley Learning, an AI instructional support tool for multilingual learners, and it hires firmware, hardware test and mobile engineers. The company is headquartered in Austin, Texas, United States.

About Medley Learning

Medley is an instructional support tool for multilingual learners that helps students access grade-level content. Our browser extension layers individualized reading and writing scaffolds directly onto the digital materials schools already use, including curriculum platforms, Google Docs, websites, and PDFs. Supports are tailored to a student's English proficiency level and home language, so students get the help they need in real time while staying engaged with the same rigorous content as their peers. Medley is grounded in research-backed practices and is already being used by over 50 districts across the US.

The Opportunity

We're hiring a Technical Product Manager, Pedagogy & AI Quality to ensure that Medley’s AI-powered instructional scaffolds continue to meet our high bar for quality and user experience. You'll tighten our rubrics for what high-quality scaffolds look like for reading and writing support in the areas of both multilingual learning and special education, and across various subjects. You’ll expand upon our metrics, build upon our robust evals systems, and review processes that hold our AI to that bar.

This is a hybrid role at the intersection of pedagogy and AI product work. You'll write and test prompts, label and analyze model outputs, dig through traces and error reports, and partner closely with engineering to ship quality improvements. You will also learn and leverage the research around scaffolding high-quality instructional materials for multilingual learners at different proficiency levels, as well as accommodations and supports for students with receptive and expressive language disabilities and neurodivergent students.

You'll work closely with our head of product and engineers to ensure that Medley consistently serves teachers and students in our partner districts with scaffolds that meet the highest levels of quality. Over time, you’ll own the quality and usability of our scaffolds suite as it continues to grow to support more students with diverse needs, prioritizing product improvements and new features to better support teachers and drive student outcomes.

What You'll Do

  • Define what "excellent" looks like. Translate research-based practice in literacy, special education, and multilingual learner instruction into clear, usable quality standards for Medley scaffolds, and set targets for AI output quality.

  • Track and monitor quality with a robust evals system. Build and maintain datasets, rubrics, and eval suites and conduct regular error analysis and trace review, combining human labeling, LLM-as-judge and rule-based evals.

  • Refine prompts and models as needed. Write, test, and refine prompts; run model comparisons and regression tests, making changes as needed to ensure outputs are consistently meeting target metrics and passing quality thresholds.

  • Stay close to our users and represent their voice in product decisions. Regularly review signals from educators, data from support tickets, product analytics, and conduct user research with students and teachers to inform product decisions.

  • Prioritize and ship AI quality and scaffold-related product improvements. Maintain a prioritized backlog of AI quality and scaffold UX issues; write clear specs, and work with engineering to scope, build and verify fixes, product updates and new features.

What We're Looking For

  • Pedagogical expertise, especially in scaffolding literacy instruction for struggling readers, special education, and/or multilingual learner education, and ideally from classroom teaching, intervention, instructional coaching or curriculum design.

  • Hands-on experience with AI evals, including human labeling, LLM-as-judge rubric design, AI metrics targets definition, and error analysis of LLM outputs.

  • AI product fluency: you use LLMs daily and have experience designing complex AI systems for products.

  • Experience defining new features and collaborating with engineers to deliver them: you can clearly communicate a problem and solution, and work through technical tradeoffs and UX questions.

  • Strong initiative, sharp judgment, and clear writing: you take action when you spot a problem, make swift decisions grounded in data and instincts, and communicate clearly to both technical and non-technical audiences.

Nice to Have

  • Graduate degree and/or significant direct experience in special education, reading/literacy, ESL/ELD or bilingual education.

  • Familiarity with AI eval and observability tools (e.g., LangSmith, Braintrust, Arize, Langfuse) or annotation platforms.

  • Proficiency in a language other than English.

  • Prior work at an edtech company, or on content quality, assessment design or psychometrics.

  • Familiarity with accessibility standards (e.g., WCAG) and assistive technology.

Why Join Medley

Medley is building products for multilingual learners and students with disabilities, populations that together represent more than 20% of U.S. K-12 students and have historically been underserved by edtech.

You'll join early, work directly with founders and engineering leadership, own meaningful technical and design decisions, and help shape a product that improves access to learning for students nationwide.

We are committed to creating a diverse and inclusive work environment. We welcome applicants from all backgrounds and experiences.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,355,882 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Product
Remote, many countries
Similar stack
Same company
Boston
$177k – $207k per year · Equity · In office · Full-Time · 2+ years exp · Master's Degree · Palo Alto
Python
Apply
In office · 3+ years exp · Bachelor's Degree · Austin
Management
Confluence
Jira
Agile
Apply
$205k – $278k per year · In office · Full-Time · 6+ years exp · Mountain View
Management
QuickBooks
Apply
In office · 7+ years exp · Bachelor's Degree · Chicago
AI/ML
AI Agents
Human-in-the-Loop
Analytics
A/B Testing
Management
Miro
Jira
Agile
Apply
$129k – $172k per year · Equity · Hybrid · Full-Time · 3+ years exp · Bachelor's Degree · Austin
Management
Confluence
Jira
Agile
Apply
$5.8k – $13k per year · Remote (EAEU) · Moscow
AI/ML
ChatGPT
Claude Code
OpenAI Codex
Apply
$42k – $62k per year (gross) · Remote (EU, United Kingdom, Switzerland, Iceland) · Contractor · 3+ years exp · Bachelor's Degree · Tallinn
Python
SQL
Python
pySpark
Databases
Snowflake
AI/ML
Spark
DevOps
AWS
Management
Agile
Scrum
Apply
$46k – $70k per year (gross) · Remote (EU, United Kingdom, Switzerland, Iceland) · Contractor · 3+ years exp · Bachelor's Degree · Tallinn
Python
SQL
Python
pySpark
Databases
Snowflake
AI/ML
Spark
DevOps
AWS
Management
Agile
Scrum
Apply
Remote (likely EAEU) · Moscow
Python
AI/ML
Cursor
Claude Code
OpenAI Codex
Apply
Remote (likely EAEU) · 3+ years exp
AI/ML
Cursor
Claude Code
Model Context Protocol
AI Agents
LLM
Management
Bitrix24
n8n
Agile
Scrum
Kanban
Apply
In office · Full-Time · PhD · London
Python
SQL
AI/ML
LLM
Analytics
Power BI
Microsoft Excel
Apply
$72k – $103k per year · Equity · In office · 1+ year exp · Bachelor's Degree · Englewood
Python
AI/ML
Claude Code
Model Context Protocol
AI Agents
LLM
RAG
Streamlit
OpenAI Codex
Analytics
Tableau
Power BI
Management
Airtable
Jira
QA
Pytest
Apply
$113k – $193k per year · Hybrid · 12+ years exp · Bachelor's Degree · Eden Prairie
Python
AI/ML
Model Context Protocol
Vertex AI
AI Agents
Arize Phoenix
Langfuse
LangSmith
Gemini
LLM
Google ADK
Human-in-the-Loop
Agentic Workflows
Multi-Agent Systems
DevOps
Splunk
Terraform
GCP
OpenTelemetry
Prometheus
CI/CD
Docker
Grafana
Platform Engineering
Self-Healing
Google Cloud Run
FinOps
AIOps
Incident Management
SLI/SLO/SLA
IAM
Cybersecurity
OWASP Top 10
HIPAA
Sigstore
Apply
In office · Full-Time · 10+ years exp · Charlotte · Chattanooga · Raleigh · Columbia · Charleston
Python
SQL
Databases
Snowflake
Databricks
AI/ML
LLM
Analytics
Tableau
Power BI
ETL/ELT
Dimensional Modeling
Management
Oracle ERP
Apply
Tax Senior Manager 4 days ago
In office · Full-Time · 7+ years exp · Bachelor's Degree · Charlotte · Chattanooga · Raleigh · Columbia · Charleston
AI/ML
LLM
Apply
$65k – $85k per year · Remote (United States) · Full-Time
Apply
Software Engineer 2 months ago
$140k – $170k per year · Remote (United States) · Full-Time · Boston
JavaScript
TypeScript
Node JS
AI/ML
LLM
Frontend
React.js
DevOps
AWS
Design
Figma
Apply
$120k – $145k per year · Equity · In office · Full-Time · Austin
Apply
$170k – $200k per year · Equity · In office · Full-Time · 5+ years exp · Bachelor's Degree · Austin
Python
DevOps
RTOS
Prometheus
Cortex
Apply
$129k – $229k per year · In office · Full-Time · 7+ years exp · Boston
Management
Agile
Apply
$140k – $185k per year · In office · 10+ years exp · Bachelor's Degree · Boston
Python
SQL
Databases
Snowflake
Amazon Redshift
DevOps
AWS
Analytics
Tableau
Power BI
A/B Testing
Looker
Marketing
Salesforce
Marketo
Apply
$140k – $185k per year · In office · 7+ years exp · Bachelor's Degree · Boston · Des Moines
Python
SQL
Databases
Snowflake
Amazon Redshift
DevOps
AWS
Analytics
Tableau
Power BI
Apply
$147k – $261k per year · Hybrid · Full-Time · Austin · Chicago · Raleigh · Dallas · New York
Analytics
Power BI
Microsoft Excel
Apply
$70k – $100k per year · In office · 2+ years exp · Boston
Apply
See all jobs
This is one of many
2,355,882 more open roles from verified company boards, updated every day.