{"id":1465520,"url":"https://alion.io/job/recruitment-room-data-analyst-ai-evaluation","title":"Data Analyst (AI Evaluation)","company":{"id":100174,"name":"Recruitment Room","domain":"recruitmentroom.net","url":"https://alion.io/company/recruitment-room","size_band":null,"is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Analytics","role_family":"Analytics","seniority":"middle","employment_type":"contractor","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":68000,"max_usd":139000,"period":"year","method":"global_role_seniority_cell","sample_n":1713},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-09-29T12:10:00Z","employer_posted_date":null,"last_verified_at":"2026-09-29T12:10:00Z","board_verified":false,"closed_at":null,"days_open":22,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":22},"description":"Data Analyst (AI Evaluation)\nContract · Remote · U.S. Only\nAnnual Compensation Equivalent: $57,600-$115,200/year\nHourly Rate: $30-$60/hr\nThe annual compensation figure is a full-time equivalent based on 40 hours per week across 48 workable weeks. It is not a guaranteed salary or earnings level.\nAbout the Role\nWe are looking for experienced Data Analysts to review datasets and task outputs for accuracy, completeness, consistency, and adherence to defined evaluation criteria.\nYou’ll apply structured rubrics across large volumes of data, identify errors and inconsistencies, handle ambiguous cases using sound judgment, and provide clear documentation explaining your decisions. No prior AI experience is required.\nWhat You’ll Do\nReview datasets and task outputs for accuracy, completeness, consistency, and adherence to guidelines.\n\nIdentify and flag inconsistencies, errors, and outputs that deviate from defined instructions.\n\nApply structured rubrics and evaluation criteria consistently across large datasets.\n\nMake well-reasoned decisions in ambiguous situations where guidelines may not fully address a scenario.\n\nDocument the rationale behind evaluation decisions clearly and consistently.\n\nIdentify recurring patterns or systemic data-quality issues and escalate them for further analysis.\n\nProvide clear, actionable written and verbal feedback, including recommended resolution paths.\n\nMaintain high levels of accuracy and attention to detail across repetitive and high-volume data review work.\n\nWhat We’re Looking For\n3-5+ years of experience in data review, data quality, quality assurance, analytics, or a related field.\n\nProven experience reviewing, validating, and critiquing data or deliverables against defined criteria.\n\nAbility to follow detailed written instructions and apply complex evaluation rubrics consistently.\n\nStrong judgment and comfort working with ambiguity.\n\nExcellent error-spotting and attention-to-detail skills, particularly across high-volume or repetitive work.\n\nStrong written and verbal communication skills.\n\nAbility to clearly document findings and explain evaluation decisions.\n\nBaseline spreadsheet proficiency, including sorting, filtering, and simple formulas.\n\nPreferred Experience\nExperience with SQL or hands-on data querying.\n\nData annotation, data labeling, or rubric-based evaluation.\n\nQuality assurance or data validation workflows.\n\nExperience identifying recurring data-quality patterns and escalating systemic issues.\n\nEngagement & Compensation\nContractor engagement.\n\nRemote work, U.S. based.\n\nHourly rate: $30-$60/hr.\n\nAnnual compensation equivalent: $57,600-$115,200 based on 40 hours per week across 48 workable weeks.\n\nActual earnings depend on the amount and scope of work assigned.\n\nNo prior AI experience is required.","description_format":"text","description_chars":2785,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence"],"lifecycle":[{"event":"open","at":"2026-09-29T14:45:33Z"}],"visa":[],"liveness":{"score":31,"band":"fade","label":"Fading","p_open":0.85,"p_active":0.492,"p_room":0.75,"age_days":21,"expected_fill_days":28,"reasons":["seen:21","agency","velocity","win:late","comp:brand"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/recruitment-room-data-analyst-ai-evaluation","json_url":"https://alion.io/job/recruitment-room-data-analyst-ai-evaluation.json","meta":{"generated_at":"2026-10-21T21:12:43Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":30091,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":100174},"rest":"https://alion.io/mcp/rest/get_company?id=100174"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Frecruitment-room-data-analyst-ai-evaluation"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Frecruitment-room-data-analyst-ai-evaluation"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Frecruitment-room-data-analyst-ai-evaluation"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/recruitment-room-data-analyst-ai-evaluation\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Frecruitment-room-data-analyst-ai-evaluation"}]}