{"id":1606492,"url":"https://alion.io/job/innodata-engagement-manager-agentic-ai-workflow-evaluations","title":"Engagement Manager, Agentic AI Workflow Evaluations","company":{"id":48089,"name":"Innodata","domain":"innodata.com","url":"https://alion.io/company/innodata","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":100,"open_postings":8,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":59,"computed_at":"2026-10-20T05:45:00Z"}},"role":"Solutions","role_family":"Solutions","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Jose, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":75,"max":85,"currency":"USD","period":"hour","gross":null,"usd_annual":170000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"RLHF","optional":false}],"status":"live","first_seen_at":"2026-09-19T04:43:43Z","employer_posted_date":"2026-09-19","last_verified_at":"2026-10-20T22:38:37Z","board_verified":true,"closed_at":null,"days_open":31,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":31},"description":"Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.\nScope of the Role: \nWe are standing up a dedicated onsite team to evaluate complex, real-world agentic AI workflows for a frontier AI customer. The Engagement Manager owns this team and this engagement: a group of ten reviewers and one QA lead working inside isolated test environments, assessing whether AI agents complete tasks safely, respect user intent and consent, and hold up under close scrutiny. \nThis is a delivery leadership role with a strong customer-facing component. You are the customer's primary day-to-day contact at the site, accountable for throughput, quality, and turnaround, and responsible for identifying where the engagement should grow next. You will not be scoring trajectories as a daily task, but you need enough technical depth to audit the team's work yourself and defend a scoring decision in a room with the customer's technical leads. \nWhat You’ll Own:\nOwn end-to-end delivery for the onsite team: throughput, quality, turnaround, and capacity against committed volumes \nManage and develop a team of eleven, including hiring, onboarding, performance management, and retention \nServe as the primary onsite point of contact for the customer's program and technical leads; run recurring reviews, report on delivery metrics, and resolve issues before they escalate \nAudit reviewer output directly - sample trajectories, check rubric application, and assess whether scoring rationale would survive customer review \nPartner with the QA lead on calibration cycles, quality metrics and evaluation, and rubric refinement; arbitrate disagreements that calibration does not resolve \nOwn the escalation path for safety-relevant and ambiguous findings, including judgment on what reaches the customer and how quickly \nIdentify expansion opportunities within the account: adjacent workstreams, new task types, additional capacity, and scope the work with internal delivery and commercial teams \nForecast staffing and cost against the engagement's commercial model, and flag variance early \nMaintain information security, privacy, and facility access practices required by the customer's onsite environment \nYou’ll Thrive in This Role If You Have:\nBachelor's degree or equivalent practical experience \n5+ years of professional experience, including direct management of a delivery team of 10-20 people \nTrack record as the customer-facing owner of a services or delivery engagement with an enterprise or technology client, including metrics reporting and issue escalation \nSignificant experience with AI/ML evaluation work: annotation, red-teaming, RLHF, model or agent evaluation, or trust and safety review \nAbility to read rubric-scored work critically and form an independent view of whether a score is correct \nStrong written communication; able to produce reporting and escalation memos that a technical customer will accept without rework \nThe expected hourly salary range for this position is $75-85 p/hour, based on experience, skills, and qualifications.\nPlease be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. \nIf you believe you’ve been targeted by a recruitment scam, please report it to Innodata at  and consider reporting it to the FTC at ReportFraud.ftc.gov.","description_format":"text","description_chars":4139,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Entry & Processing","AI Training Data & Annotation"],"lifecycle":[{"event":"open","at":"2026-10-01T19:52:38Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 2","filings_12m":2,"filings_prev_12m":2,"green_card_filings_12m":0,"median_offered_wage_usd":150000,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":77,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.856,"p_room":0.9,"age_days":31,"expected_fill_days":59,"reasons":["conf:0","velocity","win:mid"],"computed_at":"2026-10-20T05:45:00Z"},"pay":{"stated_usd_annual":170000,"is_top_pay":false},"html_url":"https://alion.io/job/innodata-engagement-manager-agentic-ai-workflow-evaluations","json_url":"https://alion.io/job/innodata-engagement-manager-agentic-ai-workflow-evaluations.json","meta":{"generated_at":"2026-10-21T01:56:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2926,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":48089},"rest":"https://alion.io/mcp/rest/get_company?id=48089"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Finnodata-engagement-manager-agentic-ai-workflow-evaluations"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Finnodata-engagement-manager-agentic-ai-workflow-evaluations"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Finnodata-engagement-manager-agentic-ai-workflow-evaluations"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/innodata-engagement-manager-agentic-ai-workflow-evaluations\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Finnodata-engagement-manager-agentic-ai-workflow-evaluations"}]}