Production Manager - Tech Operations
First seen by Alion on Sep 10, 2026.
Role Overview:
We are seeking a seasoned Production Manager to lead our Technology Operations division, focusing on the complex lifecycle of AI data annotation and LLM evaluation. In this role, you will serve as the bridge between cutting-edge Generative AI research and large-scale operational execution. You will lead diverse, high-performing teams to manage end-to-end workflows including RLHF (Reinforcement Learning from Human Feedback) and DPO (Direct Preference Optimization) pipelines. By collaborating closely with data scientists, product managers, and global stakeholders, you will ensure our AI models are trained on high-quality, nuanced data that directly impacts the accuracy and safety of our next-generation technology products. Your leadership will be pivotal in scaling our production capabilities while maintaining rigorous quality standards in a fast-paced, remote-first environment.
Key Responsibilities:
- Orchestrate large-scale AI data annotation projects by aligning workforce capacity with technical requirements to ensure timely delivery of high-quality training datasets.
- Implement Lean Six Sigma methodologies across production workflows to identify bottlenecks, reduce cycle times, and optimize operational efficiency for LLM evaluation tasks.
- Drive the integration of automation tools within manual annotation processes to enhance throughput and maintain consistency in complex RLHF and DPO workflows.
- Partner with cross-functional engineering and product teams to translate technical model requirements into actionable operational guidelines for the production workforce.
- Manage performance metrics and quality assurance frameworks to ensure that all data outputs meet the stringent accuracy benchmarks required for advanced Generative AI models.
- Mentor and scale global operational teams, fostering a culture of continuous improvement and technical excellence to meet evolving business objectives.
Required Skillset:
- Demonstrated expertise in managing large-scale technology operations or BPO/KPO environments with a focus on data-centric workflows and complex project delivery.
- Proven ability to apply Lean Six Sigma or similar process improvement frameworks to drive measurable gains in productivity and quality within technical operations.
- Strong technical acumen regarding Generative AI, specifically in the nuances of RLHF, DPO, and LLM evaluation, allowing for effective communication with research and engineering teams.
- Exceptional stakeholder management skills, with the ability to influence cross-functional partners and lead distributed teams across multiple locations.
- Advanced analytical capabilities to interpret operational data, identify trends, and implement automation strategies that scale with business growth.
- Excellent communication skills, with the ability to articulate complex operational strategies to senior leadership and translate them into clear instructions for frontline teams.
- A postgraduate degree in Management or a related technical field is preferred, complemented by a high degree of adaptability to work effectively in a remote or hybrid professional setup.
- 8 - 16 years of professional experience in high-growth technology or operations-intensive organizations.
Skills
IT Operations, Automation