{"id":69491,"url":"https://alion.io/job/kaizo-data-scientist","title":"Data Scientist","company":{"id":40616,"name":"Kaizo","domain":"kaizo.com","url":"https://alion.io/company/kaizo","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Recruitee","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"junior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Amsterdam, Netherlands"],"countries":["NL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":40000,"max_usd":120000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":434},"experience_years_min":null,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"BigQuery","optional":false},{"name":"ElasticSearch","optional":false},{"name":"Function Calling","optional":false},{"name":"GCP","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangSmith","optional":false},{"name":"LLM","optional":false},{"name":"LLMOps","optional":false},{"name":"RAG","optional":false},{"name":"Synthetic Data","optional":false},{"name":"Tool Use","optional":false},{"name":"Docker","optional":true},{"name":"Fine-tuning","optional":true},{"name":"NumPy","optional":true},{"name":"Pandas","optional":true},{"name":"Python","optional":true},{"name":"Speech Recognition","optional":true},{"name":"SQL","optional":true}],"status":"live","first_seen_at":"2026-07-14T15:49:53Z","employer_posted_date":"2026-07-14","last_verified_at":"2026-10-08T20:54:50Z","board_verified":true,"closed_at":null,"days_open":86,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":86},"description":"Do you want to work out how you actually measure whether an AI system is doing a good job, and then make it better? We're looking for a sharp, analytical data scientist to own the evaluation and quality loop of our AutoQA product. You can be early in your career (recent graduates with strong LLM fundamentals are welcome), we have room and a clear path for you to grow.\nIn a nutshell\nJoin a fast-growing SaaS company in an international environment (steep learning curve guaranteed).\n\nOwn a high-impact problem: making LLM-powered quality assurance measurably accurate at scale.\n\nSit at the intersection of AI and CX, working directly with enterprise customers and their real-world QA rubrics.\n\nGrow into a Senior Data Scientist, AI Engineer, or ML Engineer role. We invest in progression.\n\nEnjoy the perks: flexible hours, open holiday policy, an office in the heart of Amsterdam with hybrid flexibility, visa sponsorship, great gear, workations, and team events.\n\nAbout Kaizo\nAt Kaizo, we build a performance development and quality platform for customer support teams. Our AutoQA product uses LLMs to review support conversations against each customer's own quality rubric, automatically and at scale. Behind it sits a microservices-based stream processing platform handling over 200 million events per day (Kafka, Kubernetes on Google Cloud, ElasticSearch, MongoDB, BigQuery), and an LLMOps stack built around LangSmith for experimentation, prompt management, and tracing.\nThe hard part isn't calling an LLM. It's knowing, with evidence, how well the system performs on every customer's unique rubric, and having a reliable, repeatable way to improve it. That's where you come in.\nWhat you'll focus on\nTranslate customer rubrics into AutoQA instructions. Work with real customer quality criteria and turn them into precise, testable instructions that LLMs can score reliably.\n\nRun experiments that move accuracy. Design and execute evaluation experiments on large, representative datasets using LangSmith and BigQuery, and track quality with our performance metrics.\n\nBuild the datasets that make evaluation possible. Curate raw production data into golden datasets with balanced coverage, and generate synthetic data to cover the rare cases that matter most. QA is a discipline of rare occurrences: distributions are skewed, positives are scarce, and resourcefulness beats volume.\n\nBuild LLM-as-a-judge pipelines to assess system quality internally and make evaluation repeatable.\n\nMake results actionable. Your experiments should end in a decision: change a prompt, adjust which tools the system uses, surface context the AI is missing, or flag where new capabilities are needed. You'll work with the AI team to ship those decisions.\n\nEvaluate across the full stack. Beyond scoring quality, you'll help validate retrieval (RAG/IR), tool calling, and speech pipelines (transcription and diarization quality).\n\nJoin customer calls with the team to understand how QA leaders define quality, and feed what you learn back into the product.\n\nWhat you'll grow into\nShaping how customers monitor quality themselves, catch drift, and keep their AutoQA setup improving over time.\n\nSmarter categorization and routing of conversations to power analytics and get the right tickets to the right evaluation.\n\nRequirements\nA solid understanding of how LLMs work and hands-on experience prompting them for accuracy (coursework, thesis, internships, or side projects all count; production experience is a bonus).\n\nGood applied statistics: experiment design, classifier evaluation, precision/recall trade-offs, and working with heavily imbalanced data.\n\nStrong Python skills and fluency with the standard data toolkit (Pandas, NumPy, Jupyter). SQL is a plus.\n\nAn analytical, evidence-first mindset: you'd rather measure than assume.\n\nProduct sense and empathy for end users. You'll be building for QA managers and support agents, not just for benchmarks.\n\nExcellent written and verbal communication. You'll present findings to the team and join customer conversations.\n\n0 to 2 years of industry experience. Recent graduates with strong relevant work are encouraged to apply.\n\nA team player who's comfortable wearing multiple hats. We're an early-stage company and things move fast.\n\nBonus points for:\nExperience with LangSmith or similar LLMOps/evaluation tooling\n\nGoogle Cloud Platform, BigQuery, Docker, or Kubernetes\n\nSpeech/audio processing or ASR evaluation\n\nFine-tuning or building synthetic datasets for LLMs\n\nWho you'll work with\nYou'll join our AI team (two data scientists, an AI engineer, and an ML engineer) and collaborate closely with our data engineers, frontend engineers, designer, product manager, and CX teams. You'll have mentorship from day one and real ownership fast.\nWhat's in it for you?\nAn office in the heart of Amsterdam, with the flexibility of hybrid working\n\nVisa sponsorship available for eligible candidates\n\nGreat office gear: MacBook, tools, desk, chair, whatever you need\n\nFlexible working schedule and an open holiday policy\n\nFun workations and team events\n\nA clear growth path into Senior Data Scientist, AI Engineer, or ML Engineer roles","description_format":"text","description_chars":5164,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":["Apple Macbook","Flexible schedule","Hybrid work"],"hiring_locations":[{"name":"Netherlands","iso":"NL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Customer Support & Help Desk Software"],"lifecycle":[{"event":"open","at":"2026-07-14T15:49:53Z"}],"visa":[{"country":"NL","licensed_sponsor":true,"evidence":"Recognised sponsor of the Dutch immigration service (IND)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Highly skilled migrants and regular labour","cap_exempt":false,"checked_at":"2026-10-03T21:10:06+00:00","sources":["IND: public register of recognised sponsors (work)"],"filings_for_role_12m":0}],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.288,"p_room":0.28,"age_days":85,"expected_fill_days":16,"reasons":["conf:0","win:tail","crowd:junior"],"computed_at":"2026-10-08T05:49:30Z"},"pay":null,"html_url":"https://alion.io/job/kaizo-data-scientist","json_url":"https://alion.io/job/kaizo-data-scientist.json","meta":{"generated_at":"2026-10-09T00:30:36Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":643,"day_limit":5000,"remaining_today":4357,"minute_limit":60,"resets_at":"2026-10-10T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":40616},"rest":"https://alion.io/mcp/rest/get_company?id=40616"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fkaizo-data-scientist"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fkaizo-data-scientist"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fkaizo-data-scientist"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/kaizo-data-scientist\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fkaizo-data-scientist"}]}