Principal Engineer

Job Purpose

The Principal Engineer is a senior technical leader responsible for driving the design, implementation, and management of scalable, secure, and highly available AI solutions that power AOT’s portfolio of digital products for the public and private sectors. This role blends deep technical expertise with strategic thinking and hands-on leadership - setting architectural direction, championing AI-assisted engineering practices, and mentoring engineers to build the next generation of intelligent, cloud-native applications. The Principal Engineer partners closely with the Head of Engineering, product leaders and cross-functional teams to translate complex business and user needs into resilient, future-ready technical solutions grounded in open-source principles and modern cloud architecture.

Job Duties and Responsibilities

• Lead the end-to-end design, architecture and delivery of scalable, secure and highly available AI-powered solutions across AOT’s product portfolio.
• Define and evolve the technical vision for AI/ML platforms, including LLM-based applications, RAG pipelines, agentic workflows and ML model lifecycle management.
• Architect distributed, cloud-native systems leveraging AWS, Azure, and/or GCP - ensuring high availability, fault tolerance, observability and cost efficiency across multi-cloud environments.
• Champion the adoption of AI-assisted development practices (e.g.Claude Code, Cursor, GitHub Copilot or other agentic coding tools) to accelerate engineering velocity and elevate code quality across teams.
• Drive the evaluation, selection and integration of open-source frameworks, libraries, and platforms to build sustainable, vendor-agnostic solutions aligned with AOT’s hybrid-source philosophy.
• Provide hands-on technical leadership - writing production-grade code, building proof-of-concepts and prototypes, reviewing pull requests and shaping critical design decisions across multiple teams.
• Establish engineering excellence standards across security, performance, scalability, observability, accessibility and privacy compliance - with special focus on responsible and ethical AI practices.
• Mentor and grow senior engineers, tech leads and architects through coaching, design reviews, technical deep-dives and structured feedback - building a strong engineering bench.
• Partner with the Head of Engineering, Product and Solutions teams to align technical strategy with business outcomes, customer needs and long-term product roadmaps.
• Lead cross-team architectural reviews and serve as the principal authority on technical trade-offs, build-vs-buy decisions and platform standardization.
• Define and guide DevOps, SRE and MLOps practices - including CI/CD, infrastructure-as-code, model deployment, monitoring and continuous evaluation of AI systems.
• Stay at the forefront of emerging trends in Generative AI, LLMs, agentic systems, and applied ML - actively bringing innovation back into AOT’s products and engineering culture.
• Represent AOT’s engineering organization in technical forums, customer conversations, open-source communities, and industry events as needed.
• Champion a culture of psychological safety, continuous learning, experimentation, open knowledge-sharing, and shared ownership of outcomes.

Required Qualifications

Education

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent professional experience.

Experience

• 12+ years of professional software engineering experience, with at least 3+ years in a Principal Engineer, Staff Engineer or Enterprise Architect role.
• Proven track record of architecting and delivering large-scale, production-grade AI/ML or data-intensive solutions in cloud environments.
• Demonstrated experience designing and operating highly available, distributed systems serving enterprise or public sector customers.
• Hands-on experience leading the productionization of AI/ML workloads - including LLM-based applications, RAG systems, vector databases, prompt engineering, fine-tuning or agentic workflows.

Technical Skills

• Deep expertise in scalable architecture patterns: microservices, event-driven systems, distributed computing, caching, queueing and high-throughput data pipelines.
• Strong proficiency across multiple cloud platforms (AWS, Azure, GCP) - including compute, storage, networking, identity, container orchestration (Kubernetes, ECS, AKS), and managed AI/ML services (Bedrock, SageMaker, Azure OpenAI, Vertex AI).
• Strong hands-on coding ability in one or more modern backend languages/frameworks such as Python, Java, Node.js or Go.
• Working knowledge of frontend frameworks such as React, Vue, or Angular, and the ability to reason about full-stack performance and architecture.
• Practical experience with AI/ML frameworks and ecosystems: PyTorch, TensorFlow, scikit-learn, Hugging Face, LangChain/LlamaIndex, OpenAI/Anthropic/Bedrock APIs, vector databases.
• Strong command of AI-assisted development tools and workflows (Claude Code, GitHub Copilot, Cursor or any other agentic coding agents) and ability to operationalize them across an engineering organization.
• Solid understanding of DevOps, SRE and MLOps practices: CI/CD, IaC (Terraform, CloudFormation), containerization (Docker, Kubernetes), observability (Prometheus, Grafana, OpenTelemetry) and model monitoring.
• Deep understanding of secure coding practices, identity and access management, data privacy, accessibility and compliance frameworks relevant to enterprise and public sector software.
• Experience with process orchestration and workflow tools (e.g., M8Flow, Camunda, Airflow, Temporal) is a strong plus.

Leadership & Communication

• Proven ability to lead through influence - driving alignment across engineering teams, product, design and executive stakeholders without direct reporting authority.
• Excellent written and verbal communication skills, with the ability to translate complex technical concepts for both technical and non-technical audiences.
• Strong mentorship and coaching skills, with a track record of growing senior engineers and tech leads.
• Skilled in agile development methodologies and iterative, customer-centric delivery.

Preferred Qualifications

• Hands-on experience building and deploying agentic AI systems, multi-agent orchestration or tool-using LLM applications in production.
• Experience contributing to or leading open-source projects, or managing hybrid-source software portfolios.
• Background in low-code/no-code platforms, BPMN-based process automation (e.g., Camunda, M8Flow), or workflow orchestration products.
• Familiarity with government digital standards, procurement environments, and compliance regimes (e.g., SOC 2, ISO 27001, GDPR, HIPAA, FedRAMP).
• Exposure to responsible AI practices - bias evaluation, model governance, AI safety, and red-teaming of LLM systems.
• Experience presenting at conferences, publishing technical content, or contributing to industry communities around AI, cloud or software architecture.
• Certifications in cloud architecture (AWS/Azure/GCP) or AI engineering are an added advantage.

Working Conditions

• Work Arrangement: This is an opportunity based out of our Trivandrum office.
• Travel Requirements: Occasional travel may be required for team meetings, customer engagements, industry conferences or knowledge-sharing forums.
• On-Call Requirements: Light on-call rotation may be required to support critical production systems, depending on operational needs.
• Hours of Work: Monday to Friday, 40 hours per week, with overlap with PST required as needed to collaborate with global teams.

Living AOT’s Values

Our values guide how we work, collaborate, and grow as a team. Every role at AOT is expected to embody and promote these values:

• Innovation: We pursue true innovation by solving problems and meeting unarticulated needs.
• Integrity: We hold ourselves to high ethical standards and never compromise.
• Ownership: We are all responsible for our shared long-term success.
• Agility: We stay ready to adapt to change and deliver results.
• Collaboration: We believe collaboration and knowledge-sharing fuel innovation and success.
• Empowerment: We support our people so they can bring the best of themselves to work every day.