2,380,563open jobs
148,595companies
285,119added this week
Browse all
Location
Remote (India)
Seniority
Senior · 7+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 19, 2026. First seen by Alion on Nov 11, 2026. Welo Global scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Welo Global is a language and data services company that supplies localisation, translation and training data to technology firms, life sciences companies and enterprises expanding internationally. Its work covers translation and multilingual quality assurance, localisation testing for games and software, data annotation and collection across many languages, and the human evaluation and preference work used to improve large language models. The company recruits linguists, annotators and subject-matter reviewers across dozens of languages, which is why it advertises a very high volume of part-time and contract roles tied to specific language pairs.

Position Overview

We are seeking an analytical, proactive, and leadership-oriented Quality Coordinator to oversee the accuracy, consistency, and alignment of our AI model training pipelines. In this role, you will lead a cohort of AI Trainers/Data Annotators within your locale, conduct rigorous quality evaluations, run targeted calibration and upskilling sessions, and extract meaningful data insights for client stakeholders.

You will serve as the bridge between ground-level annotation workflows and strategic quality initiatives, ensuring our Large Language Model (LLM) training outputs meet rigorous linguistic criteria.

Key Responsibilities

1. Quality Assessment & Auditing

  • Perform continuous spot checks, blind audits, and systematic quality reviews across LLM training workflows (RLHF, SFT, red-teaming, prompt-response evaluation, and data labeling).
  • Evaluate annotation outputs against client taxonomies, gold standards, and rubric guidelines for factual accuracy, linguistic nuance, tone, safety, and coherence.
  • Help monitor key performance indicators, like Inter-Annotator Agreement (IAA), error classifications, and First-Time Pass Rates.

2. Trainer Enablement & Coaching

  • Support in the design and delivery of onboarding, calibration sessions, and targeted refresher workshops to continuously upskill AI trainers.
  • Provide granular, actionable feedback to individual contributors and facilitate root-cause analyses on recurring annotation errors.
  • Help maintain and update locale-specific training documentation, guideline appendices, error glossaries, and best-practice cheat sheets.

3. Locale Team Leadership

  • Serve as the primary point of contact and team lead for trainers within your assigned language/cultural locale (Hindi and Hinglish, specifically)
  • Address daily workflow escalations, edge cases, and guideline ambiguities directly with the team.
  • Partner with workforce managers to track trainer throughput, quality trends, and individual development roadmaps.

4. Client Insights & Data Intelligence

  • Aggregate qualitative and quantitative error data in weekly quality reviews.
  • Identify systematic data distribution gaps, subtle linguistic drifts, cultural alignment nuances, and model failure modes to present actionable intelligence to the client.
  • Translate raw quality audits into strategic recommendations for guideline refinements and dataset balancing.

5. Ad Hoc Quality & Operational Support

  • Assist core Quality Leadership with rapid-turnaround evaluations, and pilot annotation schemas.
  • Participate in cross-locale calibration rounds to align standards across global working teams.
  • Perform peer reviews and audits
  • Support unexpected project ramp-ups, tooling transition tests, and data sanitization tasks as needed.

Required Qualifications

  • Experience: 7+ years of experience in LLM evaluation/RLHF, content moderation QA, localization QA, translation, MTPE or editorial quality management.
  • Education: Bachelor’s degree in Linguistics, English, Communications, or a related field
  • Language & Cultural Expertise: Native or bilingual proficiency in Hindi, accompanied by strong cultural fluency and modern idiom awareness. Professional working proficiency in English.

Preferred Qualifications

  • Experience gathering, structuring, and visualizing error trends using spreadsheets (Google Sheets/Excel) or BI tools (Tableau, Looker, Metabase).
  • Demonstrated capability to mentor peers, run calibration workshops, and clearly articulate complex guidelines.
  • Prior experience working on human-in-the-loop (HITL) pipelines for Tier-1 LLM developers (e.g., prompt engineering, pairwise comparisons, safety red-teaming).
  • Familiarity with annotation platforms
  • Working knowledge of basic query languages (SQL) or scripting (Python) for data extraction and reporting.
  • Experience writing or refining formal annotation guidelines and rubrics.

Key Competencies

  • Precision & Critical Thinking: Exceptional attention to subtle semantic, factual, and cultural distinctions in text.
  • Communication: Ability to present technical data findings clearly to both engineering-oriented clients and non-technical annotator cohorts.
  • Agility: Comfort operating in fast-paced environments where project guidelines and client expectations evolve frequently.
  • Empathy in Leadership: A constructive coaching style that elevates team performance and morale under strict deadlines.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,380,563 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Administrative
Similar stack
Same company
Gurgaon
$54k per year · Remote (United States) · Full-Time · United States
Apply
Remote (United States) · Full-Time
Apply
$66k – $120k per year · Remote (United States, CT hours) · Full-Time · 3+ years exp · Associate's Degree · United States
Apply
Remote (Canada) · Full-Time · 5+ years exp · Canada
Apply
Remote (United States) · High School Diploma · United States
Apply
In office · Full-Time · Gurgaon
Apply
Senior UX/UI Designer 11 hours ago
≈ $15k – $34k per year (Estimated) · Hybrid · Full-Time · 5+ years exp · Bachelor's Degree · Gurgaon
AI/ML
Computer Use
Cybersecurity
HIPAA
Design
Figma
Apply
Account Manager 11 hours ago
In office · Full-Time · 4+ years exp · Gurgaon
Marketing
Salesforce
Apply
Account Manager 11 hours ago
In office · Full-Time · 4+ years exp · Gurgaon
Marketing
Salesforce
Apply
Senior Engineer 12 hours ago
In office · 3+ years exp · Gurgaon
Python
Java
PHP
C#
Databases
MySQL
DevOps
Jenkins
Git
QA
Selenium
Apply
See all jobs
This is one of many
2,380,563 more open roles from verified company boards, updated every day.