{"id":2169214,"url":"https://alion.io/job/fundamental-studio-ltd-evaluations-team-lead","title":"Evaluations Team Lead","company":{"id":308943,"name":"Fundamental Studio Ltd.","domain":"fundamental.bg","url":"https://alion.io/company/fundamental-2","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"D","score":54,"open_postings":22,"ghost_share":0.773,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-21T05:46:15Z"}},"role":"Management","role_family":"Management","seniority":"lead","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_regions","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["DE","FR","GB","AT","BE","BG","HR","CZ","DK","FI","HU","IE","IL","IT","NL","NO","PL","RO","ES","SE","CH","EE","GR","IS","LV","LI","LT","LU","MT","PT","SK","SI"],"hiring_countries_total":32,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Python","optional":false},{"name":"Scikit-learn","optional":false},{"name":"SQL","optional":false},{"name":"Databricks","optional":true},{"name":"Snowflake","optional":true}],"status":"live","first_seen_at":"2026-10-09T09:21:56Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-21T16:23:24Z","board_verified":true,"closed_at":null,"days_open":12,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":11},"description":"About Fundamental\nFundamental is an AI research lab pioneering the future of enterprise decision-making. Our flagship model, NEXUS is the world's most powerful Large Tabular Model (LTM) - purpose-built for the structured records that contain trillions of dollars in business value. With $275m in funding from leading investors and trusted by Fortune 100 companies, Fundamental is giving businesses the Power to Predict.\nAt Fundamental, you'll work on unprecedented technical challenges in foundation model development and build technology that transforms how the world's largest companies make decisions. This is your opportunity to be part of a category-defining company from the ground-up. Join the team defining the future of enterprise AI.\nAbout the role\nNEXUS is already in production, and we are working to substantially improve its predictive quality, latency, and cost efficiency. You will lead the team that owns how NEXUS is measured, building the shared evaluation platform that engineering, research, and Applied AI all rely on: consistent benchmarks, curated datasets, and standards for metrics, data splits, leakage prevention, and benchmark contamination that hold up under scrutiny.\nResearch needs to trust results before committing compute to it, engineering needs regressions caught before they reach production, and when a customer's own data science team benchmarks NEXUS against their own models, your platform is what Applied AI relies upon. You will benchmark NEXUS against competing approaches, using fair tuning budgets, data access, and latency measurement protocols, and turn what you find into research priorities and release recommendations.\nThis is a player-coach role: you will hire and manage a small team while staying hands-on with the code, the experiment design, and the methodology yourself. There is no evaluation function to inherit here - what you build becomes the standard the rest of the company measures NEXUS against.\nKey responsibilities\nBuild a shared evaluation platform for engineering, research, and Applied AI. Continuously add and maintain models and curated datasets so teams can run benchmarks and investigate results independently.\n\nDefine evaluation standards for metrics, data splits, leakage prevention, calibration, uncertainty, and benchmark contamination.\n\nBuild reproducible pipelines with versioned inputs and artifacts, and integrate regression checks into research and release workflows.\n\nBenchmark NEXUS against competing approaches using fair tuning budgets, data access, compute, and latency measurement protocols.\n\nSupport Applied AI’s customer POC evaluations with tooling, methodological guidance, and analysis.\n\nMeasure predictive quality, latency, and cost across deployment configurations, task types, and dataset characteristics.\n\nTurn findings into research priorities, release recommendations, and evidence-backed customer improvement plans.\n\nHire and develop the team, set priorities, and stay hands-on with code and experimental design.\n\nAbout the role\nExperience owning evaluation for tabular ML systems used in production or consequential customer decisions.\n\nStrong statistical judgment: choosing metrics and validation schemes, estimating uncertainty, comparing models across datasets, and accounting for repeated experimentation.\n\nPractical experience finding leakage in preprocessing, feature construction, joins, temporal dependencies, and related entities across splits.\n\nStrong Python and SQL skills, familiarity with scikit-learn and gradient-boosted trees, and experience building reliable ML tooling or platforms used by other teams.\n\nExperience designing fair model comparisons, including hyperparameter search, resource budgets, and end-to-end latency measurement.\n\nPrior people management experience, including hiring, technical coaching, and performance feedback, while remaining technically involved.\n\nClear written and spoken communication with researchers, engineers, and customer data scientists, including the willingness to challenge claims the evidence does not support.\n\nNice to have\nExperience evaluating tabular foundation models or AutoML systems.\n\nExperience measuring how model optimisations affect predictive quality and inference performance.\n\nExperience with relational or multi-table data, and Snowflake or Databricks environments.\n\nExperience evaluating automated or agent-driven ML workflows, including failures that aggregate metrics can hide.\n\nBenefits\nCompetitive compensation with salary and equity\n\nComprehensive health coverage for you and your dependents\n\nPaid parental leave for all new parents, inclusive of adoptive and surrogate journeys\n\nRelocation support for employees moving to join the team in one of our office locations\n\nA mission-driven, low-ego culture that values diversity of thought, ownership, and bias toward action","description_format":"text","description_chars":4854,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Parental leave"],"hiring_locations":[{"name":"Germany","iso":"DE","kind":"region"},{"name":"France","iso":"FR","kind":"region"},{"name":"United Kingdom","iso":"GB","kind":"region"},{"name":"Austria","iso":"AT","kind":"region"},{"name":"Belgium","iso":"BE","kind":"region"},{"name":"Bulgaria","iso":"BG","kind":"region"},{"name":"Croatia","iso":"HR","kind":"region"},{"name":"Czech Republic","iso":"CZ","kind":"region"},{"name":"Denmark","iso":"DK","kind":"region"},{"name":"Finland","iso":"FI","kind":"region"},{"name":"Hungary","iso":"HU","kind":"region"},{"name":"Ireland","iso":"IE","kind":"region"},{"name":"Israel","iso":"IL","kind":"country"},{"name":"Italy","iso":"IT","kind":"region"},{"name":"Netherlands","iso":"NL","kind":"region"},{"name":"Norway","iso":"NO","kind":"region"},{"name":"Poland","iso":"PL","kind":"region"},{"name":"Romania","iso":"RO","kind":"region"},{"name":"Spain","iso":"ES","kind":"region"},{"name":"Sweden","iso":"SE","kind":"region"},{"name":"Switzerland","iso":"CH","kind":"region"},{"name":"Estonia","iso":"EE","kind":"region"},{"name":"Greece","iso":"GR","kind":"region"},{"name":"Iceland","iso":"IS","kind":"region"},{"name":"Latvia","iso":"LV","kind":"region"},{"name":"Liechtenstein","iso":"LI","kind":"region"},{"name":"Lithuania","iso":"LT","kind":"region"},{"name":"Luxembourg","iso":"LU","kind":"region"},{"name":"Malta","iso":"MT","kind":"region"},{"name":"Portugal","iso":"PT","kind":"region"},{"name":"Slovakia","iso":"SK","kind":"region"},{"name":"Slovenia","iso":"SI","kind":"region"}],"hiring_excludes":[],"relocation_offered":true,"industries":["UI/UX Design","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-09T11:25:18Z"}],"visa":[],"liveness":{"score":49,"band":"ok","label":"Likely open","p_open":1,"p_active":0.547,"p_room":0.9,"age_days":11,"expected_fill_days":28,"reasons":["conf:3","stale_co","win:mid"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/fundamental-studio-ltd-evaluations-team-lead","json_url":"https://alion.io/job/fundamental-studio-ltd-evaluations-team-lead.json","meta":{"generated_at":"2026-10-21T16:56:02Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":23869,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":308943},"rest":"https://alion.io/mcp/rest/get_company?id=308943"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffundamental-studio-ltd-evaluations-team-lead"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffundamental-studio-ltd-evaluations-team-lead"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffundamental-studio-ltd-evaluations-team-lead"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/fundamental-studio-ltd-evaluations-team-lead\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffundamental-studio-ltd-evaluations-team-lead"}]}