Easy applyno account needed

Software Engineer - AI Code Evaluation

Gramian Consulting Group • English • Artificial Intelligence • IT Consulting & Digital Transformation • Bachelor's Degree • 1 day ago
Smart Apply
Similar jobs
1,628,680open jobs
97,701companies
249,880added this week
Browse all
Salary
≈ $130k – $225k per year (Estimated)
Location
Remote (United States, United Kingdom, Australia, Canada, New Zealand)
Employment
Contractor

Confirmed on the employer's own hiring board on Oct 14, 2026. First seen by Alion on Oct 13, 2026.

Overview
Company
Impact
Profile match

Gramian Consulting Group

Gramian Consulting Group is an international management and technology consulting firm based in Los Angeles, California. The firm provides executive-level advisory services, digital transformation strategy, software engineering, and corporate restructuring for middle-market and enterprise clients across diverse industries. By combining high-level strategic planning with hands-on technology execution, the company helps client organizations modernize their operations, optimize revenue models, and scale business growth efficiently.
gramianconsultinggroup.com • HQ: Los Angeles, United States • IT Consulting & Digital Transformation • Management Consulting
Tech stack of Gramian Consulting Group

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are looking for Software Engineers to help train and evaluate next-generation AI models on real-world software engineering tasks. You will assess AI-generated code for correctness, quality, and design, create challenging programming problems with verified reference solutions, and evaluate model reasoning across architecture, debugging, and system design. This role is ideal for technically strong professionals who can identify engineering flaws and provide clear, actionable feedback to improve AI performance.

SENIORITY: Mid-Senior

LANGUAGE: Strong written English

Key Responsibilities

  • Evaluate AI-generated code for functional correctness, code quality, maintainability, and sound software design.
  • Create challenging coding problems, verified reference solutions, and comprehensive test cases.
  • Review AI reasoning on software architecture, debugging, algorithms, and system design.
  • Identify logical errors, inefficient implementations, edge cases, and architectural weaknesses.
  • Provide detailed technical feedback and explanations to help improve AI model performance.
  • Apply consistent evaluation criteria to ensure accurate and reliable assessments.

Requirements

  • At least 3 years of overall professional experience in Data Science or Software Engineering.

  • At least 1 year of professional experience at a leading technology, finance, or research company.

  • A bachelor’s degree in Data Science, Software Engineering, Computer Science, or a related field from a university in the United States, Canada, Australia, New Zealand, or the United Kingdom.

  • Strong programming and software engineering fundamentals.

  • Ability to evaluate code correctness, identify bugs, and assess software design decisions.

  • Strong analytical thinking and the ability to solve complex technical problems.

  • Excellent written English and the ability to communicate technical feedback clearly.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,628,680 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Recommended for you based on this role

Backend
Similar stack
Same company
In your city
$199k – $295k per year • Remote (United States, ET hours) • Full-Time • 6+ years exp • New York
Python
JavaScript
TypeScript
SQL
Databases
PostgreSQL
Redis
Snowflake
DuckDB
AI/ML
AI Agents
Anthropic
Frontend
Redux
GraphQL
React.js
DevOps
Terraform
Helm
CI/CD
AWS
Kubernetes
Design
Figma
Apply
$199k – $265k per year • Hybrid • Full-Time • 4+ years exp • New York
Python
JavaScript
TypeScript
Databases
PostgreSQL
Redis
Snowflake
AI/ML
AI Agents
Anthropic
Frontend
Redux
GraphQL
React.js
DevOps
Terraform
Helm
CI/CD
AWS
Kubernetes
Robotics
Apollo
Analytics
A/B Testing
Design
Figma
Apply
$199k – $265k per year • Remote (United States) • Full-Time • 5+ years exp • San Francisco • New York
Python
JavaScript
TypeScript
SQL
Node JS
Node JS
BullMQ
Databases
PostgreSQL
Redis
Snowflake
DynamoDB
AI/ML
AI Agents
Anthropic
Frontend
Redux
GraphQL
React.js
DevOps
Terraform
Helm
WebSockets
CI/CD
AWS
Kubernetes
Amazon S3
Design
Figma
Apply
$199k – $295k per year • Hybrid • Full-Time • 4+ years exp • San Francisco • New York
Python
JavaScript
TypeScript
Databases
PostgreSQL
Redis
Snowflake
AI/ML
AI Agents
Anthropic
Frontend
Redux
GraphQL
React.js
DevOps
Terraform
Helm
CI/CD
AWS
Kubernetes
Design
Figma
Apply
$199k – $295k per year • Hybrid • Full-Time • 4+ years exp • San Francisco • New York
Python
JavaScript
TypeScript
SQL
Databases
PostgreSQL
Redis
Snowflake
AI/ML
AI Agents
Anthropic
Frontend
Redux
GraphQL
React.js
DevOps
Terraform
Helm
CI/CD
AWS
Kubernetes
Design
Figma
Apply
≈ $30k – $86k per year (Estimated) • Remote (Indonesia, Nigeria, Pakistan, Turkey, Vietnam) • Contractor • Bachelor's Degree
Python
JavaScript
PHP
Rust
TypeScript
Ruby
C#
C++
AI/ML
LLM
DevOps
Git
Apply
≈ $58k – $94k per year (Estimated) • Remote (France, Croatia, Czech Republic, Poland, Romania) • Contractor • Bachelor's Degree
Python
JavaScript
Node JS
Frontend
GraphQL
DevOps
Azure
CI/CD
Git
AWS
Platform Engineering
Apply
Remote (United States, Germany, France, United Kingdom, Poland) • Contractor • Bachelor's Degree
Apply
Remote (Egypt, Nigeria, Pakistan, Romania, Bangladesh) • Contractor • Bachelor's Degree
Apply
Remote (Argentina, Brazil, Colombia, Mexico, Chile) • Contractor • Bachelor's Degree
Apply
See all jobs
This is one of many
1,628,680 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles