{"id":1606490,"url":"https://alion.io/job/innodata-ai-voice-evaluation-specialist","title":"AI Voice Evaluation Specialist","company":{"id":48089,"name":"Innodata","domain":"innodata.com","url":"https://alion.io/company/innodata","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":75,"open_postings":8,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":49,"computed_at":"2026-11-02T06:13:15Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States","United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":20,"max":25,"currency":"USD","period":"hour","gross":null,"usd_annual":50000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[],"status":"live","first_seen_at":"2026-09-19T16:46:25Z","employer_posted_date":"2026-10-15","last_verified_at":"2026-11-02T05:30:42Z","board_verified":true,"closed_at":null,"days_open":43,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":43},"description":"Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.\nScope of the Role: \nWe are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact with two different AI models using the same assigned scenario, carefully compare their responses, and provide structured evaluations based on defined quality criteria.\nThe goal of the evaluation is to create a fair, consistent comparison between models and identify which model delivers the stronger overall conversational experience.\nWhat You’ll Own:\nReview an assigned scenario and roleplay a natural conversation with two different AI models.\nConduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible.\nMaintain approximately the same number of conversational turns with each model to support a fair comparison.\nRecord your voice during each interaction and pay close attention to the quality and behavior of the model's responses.\nEvaluate each model across five defined evaluation dimensions.\nIdentify and categorize relevant error clusters that may occur in the audio or conversation.\nCompare the performance of Model A and Model B based on the evaluation criteria and your observations.\nSelect the model that demonstrated the stronger overall performance according to the defined evaluation framework.\nWrite a detailed rationale explaining your final preference, referencing specific examples and observations from both conversations.\nApply evaluation guidelines consistently across different scenarios and model interactions\nYou’ll Thrive in This Role If You Have\nBachelors Degree \nStrong attention to detail and ability to notice subtle differences in conversational quality.\nExcellent listening and comprehension skills.\nStrong written communication skills, particularly the ability to explain observations clearly and objectively.\nAbility to follow detailed evaluation guidelines consistently.\nComfort speaking naturally and roleplaying different conversational scenarios.\nAbility to compare two interactions fairly without allowing personal preferences to influence the evaluation.\nStrong critical-thinking and analytical skills.\nReliability and consistency when completing structured evaluation tasks.\nFamiliarity with AI assistants, voice-based AI, or conversational systems\nThe expected hourly salary range for this position is $20-$25 p/hour, based on experience, skills, and qualifications.\nPlease be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. \nIf you believe you’ve been targeted by a recruitment scam, please report it to Innodata at  and consider reporting it to the FTC at ReportFraud.ftc.gov.","description_format":"text","description_chars":3651,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Entry & Processing","AI Training Data & Annotation"],"lifecycle":[{"event":"open","at":"2026-10-01T19:52:38Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 2","filings_12m":2,"filings_prev_12m":2,"green_card_filings_12m":0,"median_offered_wage_usd":150000,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":57,"band":"ok","label":"Likely open","p_open":1,"p_active":0.756,"p_room":0.75,"age_days":43,"expected_fill_days":49,"reasons":["conf:0","velocity","win:late"],"computed_at":"2026-11-02T06:13:15Z"},"pay":{"stated_usd_annual":50000,"is_top_pay":false},"html_url":"https://alion.io/job/innodata-ai-voice-evaluation-specialist","json_url":"https://alion.io/job/innodata-ai-voice-evaluation-specialist.json","meta":{"generated_at":"2026-11-02T09:35:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13454,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":48089},"rest":"https://alion.io/mcp/rest/get_company?id=48089"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Finnodata-ai-voice-evaluation-specialist"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Finnodata-ai-voice-evaluation-specialist"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Finnodata-ai-voice-evaluation-specialist"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/innodata-ai-voice-evaluation-specialist\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Finnodata-ai-voice-evaluation-specialist"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1606490}},{"tool":"search_jobs","arguments":{"company":"innodata.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1606490},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}