Legal Expert (AI Evaluation)
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are looking for experienced legal professionals to support the review and evaluation of legal content used in advanced AI training and assessment projects.
The role involves reviewing legal questions and answers for accuracy, relevance, clarity, completeness, and logical consistency, applying sound legal judgment across a broad range of topics, and identifying errors, ambiguities, or unsupported conclusions. Reviewers are expected to work efficiently while maintaining a high quality bar.
CONTRACT: Contractor assignment, 4 weeks
COMMITMENT: Hourly, up to 40h/week
LOCATIONS: Remote - Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, Vietnam
PROCESS: The selection will be made based on an online questionnaire and resume/education
Key Responsibilities
- Review legal questions and answers for factual and legal accuracy.
- Assess relevance, clarity, completeness, and logical consistency.
- Apply professional legal judgment across a broad range of legal topics.
- Identify legal errors, ambiguities, unsupported conclusions, and reasoning gaps.
- Evaluate whether answers appropriately address the legal question presented.
- Provide clear and consistent review decisions based on project guidelines.
- Suggest improvements where task quality can be strengthened.
- Apply annotation and quality-review standards consistently.
- Complete assigned reviews efficiently while maintaining accuracy.
Requirements
- At least 6 years of strong subject-matter expertise in law.
- Ability to evaluate complex legal content across varied legal topics.
- Strong legal reasoning and analytical skills.
- Ability to identify factual, legal, and logical issues in written content.