Software Engineer LLM Coding Agent Dataset Creation
First seen by Alion on Oct 23, 2026. Innodata scores A on the Alion truth index.
About the Role
Software Engineer – LLM Coding Agent Dataset Creation
Are you an experienced Software Engineer passionate about coding, AI, and solving complex engineering challenges Here's an exciting opportunity to work on cutting-edge LLM-based coding agents and AI evaluation datasets!
We're looking for talented engineers with strong software development fundamentals and hands-on experience working with large codebases.
Job Details:
Location: Noida (Work from Office)
Experience: 6+ Years
Notice Period: Immediate Joiners Only
Key Responsibilities
Develop, review, test, and validate coding tasks across multiple programming languages.
Create high-quality datasets for training and evaluating LLM-powered coding agents.
Build and maintain test suites to ensure code correctness, reliability, and quality.
Work with large open-source repositories and understand complex codebases.
Review code, technical designs, and implementation approaches.
Break down requirements into well-defined engineering tasks and resolve technical challenges.
Required Technical Skills
Strong expertise in one or more of the following programming languages:
Python
Rust
TypeScript
Java
C++
Go
Additional expertise in Git, Docker, debugging, automated testing, code reviews, and clean code practices is essential.
Preferred Qualifications
- Experience with LLMs and AI-assisted coding tools.
- Knowledge of code generation and AI model evaluation.
- Experience creating coding benchmarks, evaluation datasets, or software engineering datasets.