{"id":1173989,"url":"https://alion.io/job/monday-com-data-scientist-ai-infra-evaluation-foundations","title":"Data Scientist– AI Infra & Evaluation Foundations","company":{"id":2215,"name":"monday.com","domain":"monday.com","url":"https://alion.io/company/monday-com","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Tel Aviv, Israel"],"countries":["IL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":82000,"max_usd":225000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":782},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Edge AI","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"Monday.com","optional":false},{"name":"CI/CD","optional":true},{"name":"GitHub","optional":true},{"name":"Langfuse","optional":true},{"name":"LangSmith","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-09-24T09:36:14Z","employer_posted_date":"2026-09-24","last_verified_at":"2026-10-13T15:41:16Z","board_verified":true,"closed_at":null,"days_open":19,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":19},"description":"About monday.com:\nmonday.com is the AI work platform powering the most ambitious teams. 250,000+ customers across departments use us to bring people, workflows, and AI agents together on one flexible platform where AI doesn't just assist, it executes. We move fast, build things that matter, and foster an ownership-driven culture where you're empowered to shape how organizations work and outpace their competition.\nAbout the team\nThe AI Infra group builds the foundations, tools, and platforms that every team at monday relies on to ship intelligent, agentic features. We own the core infrastructure-including the AI Gateway and our centralized Evals framework-ensuring every AI feature deployed to production is secure, resilient, cost-effective, and above all, trustworthy.\nOur focus is on the frontier of agentic AI: dissecting complex agent trajectories, building robust evaluation frameworks, and turning subjective notions of \"good AI\" into rigorous, actionable metrics. As a Data Scientist on this team, you will bridge the gap between AI research and production infrastructure. You'll partner closely with engineering and product teams across monday to design the judges, metrics, and error analysis workflows that allow us to ship cutting-edge AI agents with speed and confidence.\n This position is based at our Tel Aviv office (Headquarters).\nAbout the role:\nAs a Data Scientist in AI Infra, your goal goes far beyond simply building an evaluation framework-you will own the organizational impact of how monday evaluates and trusts AI. You will define how teams measure quality, influence engineering decisions across R&D, and turn fuzzy notions of \"good AI\" into numbers product teams rely on to ship with confidence.\nOwn the evaluation methodology: Design metrics, pipelines, and methodology that teams across monday trust and adopt as their source of truth.\n\nTransform the AI agent lifecycle: Standardize how AI agents are built, regression-tested, and maintained across the org, embedding continuous evaluation into everyday engineering workflows and post-deployment monitoring.\n\nDrive organizational impact & enablement: Partner with AI feature teams across monday to translate domain expectations into meaningful datasets, test suites, and continuous evaluation pipelines-leveling up engineers and product managers along the way.\n\nBuild hands-on tools: Prototype and stand up eval pipelines end-to-end, bridging the gap between ambiguous, high-level product requirements into clear, quantifiable evaluation standards that become central to how features are greenlit for production\n\nAnticipate future failure modes: Stay ahead of evolving agent architectures by proactively designing next-generation evaluation strategies.\n\nRequirements:\nAgentic Systems & Architecture:\n3+ years of experience as a Data Scientist in non-academic settings working with complex production running AI systems. Familiarity with current agentic frameworks like LangGraph, LangChain, and SoTA SDKs.\n\nDeep, practical understanding of how agents operate - models, context, capabilities and harnesses. Deep experience with agentic evaluation methodologies\n\nExecution, Code & Trace-First Mindset:\nProduction-grade coding skills with a track record of building, prototyping, and shipping end-to-end data or eval pipelines,\n\nA \"trace-first\" diagnostic mindset-comfortable diving into raw agent execution logs, inspecting failure modes, and constructing qualitative error taxonomies.\n\nProduct & Organizational Impact:\nStrong product intuition and exceptional communication skills to translate complex evaluation data into clear, actionable guidelines.\n\nProven ability to partner closely with software engineers and product teams, taking ownership of driving adoption and raising the quality bar across the organization.\n\nPreferred Qualifications\nDirect experience designing evaluation strategies for complex agentic systems in production\n\nPrior experience working within centralized platform/infra teams that support multiple product verticals.\n\nExperience contributing to modern microservice architectures, GitHub workflows, and automated production CI/CD pipelines\n\nFamiliarity with modern agent and eval tooling and observability stacks (e.g., LangSmith, Langfuse, or custom internal platforms).\n\nKnowledge of TypeScript or experience working within modern platform architectures.\n\nMaster’s degree in Computer Science, Data Science, Statistics, Engineering, or a related quantitative field.","description_format":"text","description_chars":4480,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Israel","iso":"IL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Project & Work Management Software","Low-Code & No-Code Platforms"],"lifecycle":[{"event":"open","at":"2026-09-24T10:14:03Z"}],"visa":[],"liveness":{"score":77,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.852,"p_room":0.9,"age_days":18,"expected_fill_days":33,"reasons":["conf:1","velocity","win:mid"],"computed_at":"2026-10-13T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/monday-com-data-scientist-ai-infra-evaluation-foundations","json_url":"https://alion.io/job/monday-com-data-scientist-ai-infra-evaluation-foundations.json","meta":{"generated_at":"2026-10-13T17:30:02Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":26765,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2215},"rest":"https://alion.io/mcp/rest/get_company?id=2215"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmonday-com-data-scientist-ai-infra-evaluation-foundations"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmonday-com-data-scientist-ai-infra-evaluation-foundations"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmonday-com-data-scientist-ai-infra-evaluation-foundations"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/monday-com-data-scientist-ai-infra-evaluation-foundations\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmonday-com-data-scientist-ai-infra-evaluation-foundations"}]}