{"id":431,"url":"https://alion.io/job/constructor-senior-machine-learning-engineer-search-quality","title":"Senior Machine Learning Engineer: Search Quality","company":{"id":716274,"name":"Constructor","domain":"constructor.com","url":"https://alion.io/company/constructor-3","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":94,"open_postings":39,"ghost_share":0,"stale_share":0,"repost_share":0.077,"time_to_fill_p50_days":72,"computed_at":"2026-10-17T05:46:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["DE"],"hiring_countries_total":1,"salary":{"min":80000,"max":120000,"currency":"USD","period":"year","gross":null,"usd_annual":120000},"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"A/B Testing","optional":false},{"name":"AI Agents","optional":false},{"name":"Fine-tuning","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Recommender Systems","optional":false},{"name":"Reranking","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2026-06-02T18:54:43Z","employer_posted_date":"2026-06-02","last_verified_at":"2026-10-17T08:16:38Z","board_verified":true,"closed_at":null,"days_open":136,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":136},"description":"About us\nLaunched in 2019, Constructor is an AI-first ecommerce search and discovery platform that helps shoppers find the right products at the right time and enables leading global e-commerce brands to drive meaningful revenue and conversion gains.\nAs a Senior Machine Learning Engineer in the Search Quality team, you will improve the e-commerce experience for hundreds of millions of users across the world by building the systems that power relevance for global retailers - from fashion and grocery to electronics and hardware.\nThe mission is to measure search quality, push it higher, and catch degradations before the user does. You will achieve this through a blend of fine-tuned LLMs for relevance judgment, real-time models, and deep offline analysis of query logs.\nAbout the Job\nYour primary focus will be relevance evaluation and quality improvements:\nLLM-based evaluation. We fine-tune our own models to assess relevance. This involves teaching the model to understand query intent, represent items from messy catalog data, and align model judgments with real user behavior.\n\nReal-time quality in production. Reranking, filtering, signal computation. Latency is a strict requirement, so quality vs speed tradeoff is constant.\n\nAutomated quality monitoring and agentic insights. Pipelines to detect degradations and find underperforming patterns. Agent-based systems that generate actionable recommendations for the product data and search configurations.\n\nWhat makes this interesting\nMulti-domain, multi-language, at scale - 40+ languages, 20+ domains. The models need to generalize across all of them - without per-customer rules or overrides.\n\nNo universal ground truth. A grocery retailer and a fashion retailer may have different perceptions on what \"relevant\" means.\n\nEfficiency at scale. Optimizing and scaling LLM inference across our entire customer base.\n\nRequirements\n4+ years shipping production ML systems\n\nExperience with search, information retrieval, or recommendation systems\n\nHands-on experience with fine-tuning, evaluation frameworks, and scaling LLM deployments\n\nStrong Python and PyTorch. Fluency in SQL and data orchestration tools (Spark, Airflow)\n\nExperience designing and running A/B tests to validate model impact\n\nExcellent English communication skills\n\nExperience collaborating in cross-functional teams (ranking, product, data engineering)\n\nBenefits\nWork with smart and empathetic people who will help you grow and make a meaningful impact.\n\nRegular team offsite events to connect and collaborate.\n\nFully remote team - choose where you live.\n\nUnlimited vacation time - we strongly encourage all of our employees take at least 3 weeks per year.\n\nWork from home stipend! We want you to have the resources you need to set up your home office.\n\nApple laptops provided for new employees.\n\nTraining and development budget for every employee, refreshed each year.\n\nMaternity & Paternity leave for qualified employees.\n\nBase salary: $80k-$120K USD, depending on knowledge, skills, experience, and interview results\n\nStock options - offered in addition to the base salary\n\nDiversity, Equity, and Inclusion at Constructor\nAt Constructor.io we are committed to cultivating a work environment that is diverse, equitable, and inclusive. As an equal opportunity employer, we welcome individuals of all backgrounds and provide equal opportunities to all applicants regardless of their education, diversity of opinion, race, color, religion, gender, gender expression, sexual orientation, national origin, genetics, disability, age, veteran status or affiliation in any other protected group.\nStudies have shown that women and people of color may be less likely to apply for jobs unless they meet every one of the qualifications listed. Our primary interest is in finding the best candidate for the job. We encourage you to apply even if you don’t meet all of our listed qualifications.\nHow we handle your data. By submitting this application, you acknowledge that Constructor will collect and process the personal data you provide for the purpose of evaluating your candidacy for this role. If you are not selected, we will retain your data for a limited period as described in our Recruitment Privacy Notice. After that period your data will be deleted or anonymized.","description_format":"text","description_chars":4295,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":["Equity","Home office","Stock options"],"hiring_locations":[{"name":"Germany","iso":"DE","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Commerce","Recommendation Systems","AI Search","Retail & Commerce AI"],"lifecycle":[{"event":"open","at":"2026-06-02T18:54:43Z"}],"visa":[],"liveness":{"score":20,"band":"cold","label":"Long shot","p_open":1,"p_active":0.564,"p_room":0.36,"age_days":136,"expected_fill_days":72,"reasons":["conf:0","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":120000,"is_top_pay":false},"html_url":"https://alion.io/job/constructor-senior-machine-learning-engineer-search-quality","json_url":"https://alion.io/job/constructor-senior-machine-learning-engineer-search-quality.json","meta":{"generated_at":"2026-10-17T10:22:42Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13541,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":716274},"rest":"https://alion.io/mcp/rest/get_company?id=716274"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fconstructor-senior-machine-learning-engineer-search-quality"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fconstructor-senior-machine-learning-engineer-search-quality"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fconstructor-senior-machine-learning-engineer-search-quality"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/constructor-senior-machine-learning-engineer-search-quality\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fconstructor-senior-machine-learning-engineer-search-quality"}]}