Principal Engineer, AI Platform

Job Role: Full Stack Principal Engineer, AI Platform

Office Location: Andheri East, Mumbai

Ph.D Required

About Accrete

Accrete is an agentic managed services company: an AI workforce that does high-stakes, judgement-heavy work for government and enterprise clients - at the economics of software, not labor.

At the core is Accrete’s Knowledge Engine, a dynamic context graph that captures an organization’s tacit knowledge, resolves data across silos, and builds a living, auditable ground truth. Expert agents reason against that ground truth to act on complex, high-stakes decisions - not just answer questions about them.

From national security to commercial operations, Accrete delivers the work on one platform, with unlimited expert agents and expert judgement.

About the Role

We are seeking a Full Stack Principal Engineer to join our AI Platform team. The ideal candidate will have a PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related field and a strong background in designing and building AI-driven systems. You will play a pivotal role in architecting, building, and scaling the platform that powers Accrete's AI products and agentic systems.

This is a hands-on technical leadership role. You will work across the full technology stack while driving architectural decisions, solving complex engineering challenges, and shaping the technical direction of the AI Platform. You will collaborate closely with software engineers, ML engineers, data scientists, and product teams to turn advanced AI capabilities into reliable, scalable, and production-ready systems.

What You'll Do

Architecture & Technical Leadership

• Lead the architecture, design, and development of core components of the AI Platform.
• Drive technical direction across frontend, backend, infrastructure, and platform services.
• Design scalable, reliable, secure, and maintainable systems for complex AI agent workloads.
• Solve complex and ambiguous technical problems and make sound architectural decisions considering scalability, performance, reliability, cost, and time-to-market.
• Identify architectural bottlenecks and technical risks and proactively drive solutions.
• Establish engineering best practices across system design, code quality, testing, security, observability, and maintainability.

Full-Stack & AI Platform Development

• Design and build end-to-end features across frontend and backend systems.
• Develop scalable APIs, services, and core libraries that power AI applications and agents.
• Build developer-facing tools and intuitive interfaces for interacting with AI models, agents, and data.
• Design and develop infrastructure for securely running and orchestrating AI agents and AI workloads in production.
• Integrate AI/ML models, data pipelines, and emerging AI capabilities into production systems.
• Build modular platform components that can evolve with advances in AI technology.

Scalability, Innovation & Collaboration

• Architect systems for high performance, availability, scalability, and fault tolerance.
• Drive improvements in platform reliability, latency, resource utilization, observability, and developer experience.
• Contribute to the long-term technical roadmap of the AI Platform and evaluate emerging technologies relevant to AI/ML systems.
• Provide technical mentorship and guidance to engineers and help raise engineering standards across the organization.
• Lead technical design discussions, architecture reviews, code reviews, and complex problem-solving sessions.
• Collaborate with product, ML, data, and engineering teams to translate business requirements into effective technical solutions.
• Own initiatives from concept and architecture through implementation, deployment, and continuous iteration.

What We're Looking For

Education & Experience

• PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related field or Master's degree in Computer Science, Engineering, Artificial Intelligence, Machine Learning, or a related technical field from a Tier I institution.
• 10+ years of experience in software engineering, with significant experience designing and building scalable production systems and platforms.
• Proven experience owning complex, high-impact engineering initiatives from architecture through production.
• Strong experience with software architecture, system design, distributed systems, and scalable platforms.
• Experience providing technical leadership, mentoring engineers, and influencing technical direction across teams.
• Experience with AI/ML systems, AI agents, language models, or data-intensive applications is highly desirable.

Technical Expertise

• Strong frontend experience with React, TypeScript, or similar technologies.
• Strong backend development experience with Python, Go, or similar languages.
• Strong understanding of REST, GraphQL, and API/service architectures.
• Experience with relational and/or NoSQL databases.
• Strong experience with AWS, GCP, or Azure.
• Experience with Docker, Kubernetes, and cloud-native architectures.
• Strong understanding of CI/CD, DevOps, observability, and production operations.
• Experience designing systems for security, reliability, performance, high availability, and fault tolerance.
• Familiarity with AI/ML frameworks, model-serving infrastructure, or AI application architectures.

Leadership & Problem Solving

• Exceptional systems-thinking and problem-solving abilities.
• Strong technical judgment with the ability to evaluate complex engineering trade-offs.
• Ability to operate independently in ambiguous and rapidly evolving environments.
• Excellent communication and collaboration skills with both technical and non-technical stakeholders.
• Demonstrated ability to mentor engineers and raise the technical bar across teams.
• Strong ownership and accountability for technical outcomes and business impact.

Nice to Have

• Experience building AI agent platforms, agent orchestration systems, or AI infrastructure.
• Experience with LLMs, Generative AI, or model-serving systems.
• Experience with PyTorch, TensorFlow, or similar AI/ML frameworks.
• Experience with real-time systems, event-driven architectures, or streaming systems.
• Experience with Apache Spark or other distributed data-processing technologies.
• Experience designing secure execution environments for AI agents or untrusted workloads.
• Experience building developer platforms, internal tooling, or infrastructure-as-a-product.
• Exposure to security, compliance, privacy, or government-focused environments.

Cultural Fit & Values

At Accrete, success goes beyond technical expertise. We value:

• Ownership & Accountability: Drive initiatives to completion with high standards and proactive problem-solving.
• Transparency & Communication: Share information openly and give and receive constructive feedback.
• Strategic Thinking & Problem-Solving: Analyze challenges critically and develop effective, scalable solutions.
• Collaboration & Professionalism: Work effectively across teams and contribute to a culture of mutual respect.
• Passion for AI & Innovation: Stay curious, continuously learn, and push the boundaries of AI.
• Going Beyond the Job Description: Look for opportunities to create impact beyond your immediate responsibilities.

These principles shape our culture, performance expectations, and growth opportunities.

Company Benefits

• Competitive Salary: Aligned with experience and market standards.
• Mediclaim: ₹10 lakh coverage for you and your family.
• Flexible PTO & Hybrid Work: Take time off when needed and enjoy remote flexibility in accordance with company guidelines.
• Growth & Development: Access to professional learning opportunities and career advancement support.
• Onsite Perks: Catered lunches and snacks.
• Team Bonding: Company-sponsored social events and team activities.

Accrete is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.