577,120open jobs
24,628companies
79,541added this week
Browse all
Salary
$21k – $47k per year (Estimated)
Location
Remote (Philippines)
Seniority
Senior · 2+ years exp
Employment
Part-Time
Overview
Company
Impact
Profile match

About HumanSignal

Real-world data is the competitive edge in AI.

HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real-world data creation to annotation to delivery.

We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open-source standard for data labeling and evaluation, used by over 1 million practitioners worldwide.

We specialize in the operationally complex: real-world data collection, multimodal pipelines, and multi-step workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in-house capacity runs out.

If you want to do work that materially shapes how the next generation of AI products gets built, we'd love to talk.

Graphic Design Expert

Location:  Remote

Type:  Part-Time Contract (15+ hours per week for 2 weeks | 30 hour minimum commitment)

Duration: 2 weeks with potential for ongoing work

Compensation: $3.13 per delivered milestone of 120 tasks ($6.25/hour equivalent)

About the Project

You'll evaluate and rate graphic design elements on standardized quality scales to train AI models that assess design effectiveness-contributing to cutting-edge technology that advances how AI understands and evaluates visual content quality.

What You'll Do

  • Review and rate graphic design elements using our Label Studio Enterprise platform across multiple quality dimensions:
    • Typography quality (readability, hierarchy, font pairing appropriateness)
    • Visual hierarchy effectiveness (clarity, balance, focal point strength)
    • Design element execution (icon quality, illustration polish, image selection)
    • Color palette effectiveness (harmony, contrast, accessibility)
    • Layout and composition quality (grid usage, spacing, alignment)
    • Overall design effectiveness and professional polish
  • Apply consistent 1-5 rating scales across hundreds of design examples
  • Provide clear, objective assessments based on established design principles
  • Follow detailed rating guidelines and rubrics to maintain consistency
  • Process high volumes of design samples with sustained attention to detail
  • Participate in weekly calibration sessions to align rating standards
  • Meet quality benchmarks for rating consistency and inter-rater reliability

Basic Qualifications

Required Experience

  • Formal training in graphic design, visual arts, or related field  (degree, certificate, or bootcamp completion)  OR 2-3 years of professional graphic design experience
  • Strong proficiency in design principles (composition, color theory, typography, visual hierarchy)
  • Ability to objectively critique and evaluate design work against industry standards
  • Understanding of what constitutes effective vs. ineffective design choices
  • Experience reviewing or providing design feedback
  • Exceptional attention to detail and ability to maintain focus during repetitive tasks

Skills & Attributes

  • Comfort with highly repetitive work -ability to maintain quality and engagement while rating similar content for extended periods
  • Strong visual discrimination and consistent aesthetic judgment
  • Reliability and consistency in applying rating standards
  • Self-motivated with ability to work independently on repetitive tasks
  • Excellent focus and concentration for sustained periods
  • Strong communication skills for flagging edge cases or unclear examples
  • Comfortable with feedback and recalibration
  • Minimum 10 hours per week availability for at least 3 months

Nice-to-Haves

Preferred Background

  • Portfolio demonstrating diverse design work and critical eye
  • Experience as a design reviewer, art director, or in quality assurance roles
  • Understanding of accessibility standards (WCAG, inclusive design principles)
  • Knowledge of design across multiple contexts (branding, editorial, digital, UX/UI)
  • Experience teaching or mentoring design concepts

Technical Experience

  • Experience with Figma, Sketch, or other modern design tools
  • Prior data annotation, content moderation, or quality evaluation experience
  • Exposure to machine learning or computer vision concepts
  • Familiarity with design systems and component libraries

Work Style

  • High tolerance for repetitive evaluation tasks -finds rhythm and satisfaction in systematic work
  • Ability to maintain consistent standards across thousands of ratings
  • Strong pattern recognition-quickly identifying quality patterns across examples
  • Disciplined, methodical approach with minimal variation in judgment
  • Problem-solving mindset for handling ambiguous or borderline cases
  • Interest in AI/ML applications in design and creative fields
  • Previous remote work experience with self-directed tasks

What Makes Someone Successful in This Role

You thrive on consistency and repetition  - You find satisfaction in systematic work and can maintain quality standards while evaluating similar content repeatedly without losing focus or accuracy.

You have a calibrated design eye  - You can quickly assess design quality against objective criteria and apply the same standards consistently across hundreds or thousands of examples.

You're objective and principled  - You separate personal taste from professional assessment, basing ratings on established design principles rather than subjective preference.

You maintain sustained focus  - You can work through high volumes of repetitive tasks while staying sharp and attentive to subtle quality differences.

You're a clear communicator  - You flag confusing examples or rating criteria early, ask clarifying questions, and document edge cases clearly.

You're curious about technology  - You're genuinely interested in how AI learns to evaluate design quality and see value in contributing to machine learning training data.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
577,120 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
$94k – $234k per year (Estimated) • In office • Full-Time • PhD • Singapore
Python
AI/ML
Reinforcement Learning
JAX
Multimodal AI
Computer Vision
Transformers
TensorFlow
PyTorch
CLIP
LLaVA
Embodied AI
Robotics
ROS
Perception
Sim-to-Real
Reinforcement Learning
Apply
AI Engineer III 12 hours ago
$24k – $64k per year (Estimated) • In office • 5+ years exp • Bengaluru
AI/ML
Claude
Fine-tuning
RLHF
Reinforcement Learning
Multimodal AI
NLP
Transformers
TensorFlow
PyTorch
LLM
RAG
Recommender Systems
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Cybersecurity
HIPAA
Apply
$43k – $110k per year (Estimated) • In office • Full-Time • 3+ years exp • Master's Degree • Bengaluru
AI/ML
Multimodal AI
AI Agents
PEFT
Transformers
LLM
SFT
Management
Agile
Apply
Research Engineer 1 day ago
In office • Master's Degree • Bengaluru
Python
AI/ML
Multimodal AI
Computer Vision
VLM
PyTorch
Vision-Language-Action
DevOps
AWS
Robotics
ROS
LeRobot
Foxglove Studio
SLAM
Visual-Inertial Odometry
Apply
$47k – $118k per year (Estimated) • In office • 7+ years exp • Master's Degree • Bengaluru
Python
Java
Scala
Databases
Apache Kafka
AI/ML
Cursor
Spark
OpenCV
Claude Code
Model Context Protocol
Scikit-learn
Multimodal AI
Computer Vision
AI Agents
NLP
spaCy
Flink
TensorFlow
Keras
PyTorch
BERT
ResNet
EfficientNet
NLTK
CLIP
DevOps
Amazon S3
Apply
$121k – $282k per year (Estimated) • Remote
Python
JavaScript
TypeScript
Python
Django
Databases
PostgreSQL
AI/ML
Multimodal AI
Label Studio
Frontend
React.js
DevOps
Kubernetes
Apply
$46k – $113k per year (Estimated) • Remote • Columbus
AI/ML
Multimodal AI
Label Studio
Apply
Solutions Architect 7 days ago
$123k – $144k per year • Equity • Remote
Python
JavaScript
AI/ML
Multimodal AI
Label Studio
DevOps
Rest API
Docker
Kubernetes
Apply
$100k per year • In office • Columbus
AI/ML
Multimodal AI
Label Studio
Apply
$88k – $184k per year (Estimated) • Remote • 2+ years exp
AI/ML
Multimodal AI
Label Studio
Marketing
LinkedIn
Apply
See all jobs
This is one of many
577,120 more open roles from verified company boards, updated every day.