{"id":4603124,"url":"https://alion.io/job/welocalize-expert-rater","title":"Expert Rater","company":{"id":1937083,"name":"Welocalize","domain":"welocalize.com","url":"https://alion.io/company/welocalize-com","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":null},"role":"Operations","role_family":"Operations","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["India"],"countries":["IN"],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Service Desk","optional":false}],"status":"live","first_seen_at":"2026-11-19T13:12:19Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-19T13:12:19Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact  subject Workday Candidate Login\nWhen creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.\nThank you!\nNOTICE: For Privacy Policy please review here\nJob Responsibilities:\nWelo Data is an award-winning localization and AI data company. We run some of the world’s largest AI model relevance rating programs. This will play a crucial role in analyzing and improving AI-driven online advertising platforms.This role will help establish benchmarks and guidelines for data used to train AI models, particularly in areas lacking defined standards. That means you will be shaping the future of web-based advertising and AI models.\nMAIN DUTIES\nThe following is a non-exhaustive list of responsibilities and areas of ownership of an Expert Rater\nRate Client-provided ads following pre-defined guidelines\nEvaluate advertisements based on specific quality, relevance, and compliance criteria provided by the client.\nEnsure ratings are objective, consistent, and aligned with the predefined rating standards.\nIdentify any guideline ambiguities and apply critical thinking when assessing borderline cases.\nMaintain a high level of accuracy and efficiency, meeting daily/weekly rating quotas.\nReview and refine rating guidelines, identifying areas for improvement and recommending updates to enhance accuracy, consistency, and overall rating quality.\nCurate high-quality datasets (\"golden sets\") by selecting and validating top-tier rated ads, which can serve as benchmarks for AI model training and human rater calibration.\nCollaborate with cross-functional teams (e.g., quality assurance, data analysts, and AI training teams) to ensure rating processes align with evolving industry and client needs.\nAnalyse trends and patterns in ad ratings, providing insights that contribute to guideline optimizations and overall rating effectiveness.\nAssist in training and mentoring new raters, ensuring they understand guidelines and best practices for accurate evaluations.\nREQUIREMENTS\nExperience\nHave experience in AI model relevance, such as data labeling, linguistic annotation, relevance rating, etc.\nAre analytical and data-driven with a proven track-record of data-based decision making \nHave a strong interest and understanding of digital marketing and advertising, especially as it relates to artificial intelligence \nCan effectively summarize complex information, questions, and solutions for various audiences Have experience researching and gathering insights, and understanding complex problems across a variety of topics \nCan defining, explain, and defend their points of view in group discussions \nAre comfortable reviewing and discussing a variety of topics - you do not need to have expertise on the topics, but willingness to research and understand to support consensus decisions is vital \nAre comfortable with ambiguity in guidelines, workflows, and processes, and are motivated to help establish those systems \nRequirements\nNative level fluency in the target language\nExcellent understanding of both written & spoken English\nA 4 year university degree and/or or at least 2 years work experience in one or more of the following: AI-based relevance rating, marketing/advertising, linguistics, content creation, writing, tech-related quality assurance, data labeling, or linguistic annotation.\nAdditional Job Details:","description_format":"text","description_chars":3570,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Translation Services","AI Training Data & Annotation"],"lifecycle":[{"event":"open","at":"2026-11-19T13:12:19Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":43,"reasons":["conf:1","win:early"],"computed_at":"2026-11-19T15:01:47Z"},"pay":null,"html_url":"https://alion.io/job/welocalize-expert-rater","json_url":"https://alion.io/job/welocalize-expert-rater.json","meta":{"generated_at":"2026-11-19T15:01:47Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24916,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1937083},"rest":"https://alion.io/mcp/rest/get_company?id=1937083"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fwelocalize-expert-rater"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fwelocalize-expert-rater"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fwelocalize-expert-rater"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/welocalize-expert-rater\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fwelocalize-expert-rater"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4603124}},{"tool":"search_jobs","arguments":{"company":"welocalize.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4603124},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}