AI Agent Observability Engineer

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Agent Observability Engineer based in India.

This opportunity is designed for an early-career engineer interested in building software and applying artificial intelligence to real-world products and platforms. You will contribute to backend and full-stack development while gaining hands-on exposure to AI and Large Language Model (LLM) capabilities. Working alongside experienced engineers, you will help design, test, deploy and monitor production-ready systems. The role combines software engineering fundamentals with practical work across LLM integrations, Retrieval-Augmented Generation (RAG), evaluation and agent capabilities. You will also contribute to automated testing, datasets, benchmarks and observability to improve system quality and reliability. This is a fast-paced environment where you can develop technical skills, collaborate with global teams and build practical experience in emerging technologies.

Accountabilities

• Contribute to backend and full-stack feature development, testing and releases for core products and platforms, delivering production-ready code.
• Collaborate with senior engineers on module design, API and interface definition, system integration and deployment.
• Support logging, monitoring, troubleshooting and performance optimisation across deployed services.
• Write and maintain automated tests and Continuous Integration and Continuous Delivery (CI/CD) configurations to improve development efficiency and code quality.
• Support the integration and deployment of Artificial Intelligence (AI) and Large Language Model (LLM) capabilities based on business requirements.
• Integrate LLM application programming interfaces (APIs), develop basic Retrieval-Augmented Generation (RAG) pipelines and embed tools or agent capabilities into existing systems.
• Help build and maintain datasets and benchmarks for AI evaluation and regression testing.
• Track online system and model performance, assist with debugging and contribute to resolving technical issues.
• Produce clear technical documentation and communicate effectively with engineering and cross-functional teams.

Requirements

• Currently pursuing a Bachelor’s or Master’s degree in Computer Science, Software Engineering, Artificial Intelligence or a related field.
• Strong software engineering fundamentals, including data structures and algorithms, object-oriented design, common design patterns and coding best practices.
• Proficiency in Python is required, along with experience using at least one primary programming language for engineering work.
• Experience with Java, Go, TypeScript or JavaScript is a plus.
• Familiarity with Git, basic Linux environments and software debugging practices.
• Understanding of unit and integration testing, Representational State Transfer (RESTful) APIs and relational or non-relational databases.
• Some project or internship experience with AI or LLM technologies is sufficient; deep research experience is not required.
• Familiarity with prompt engineering, function calling, RAG, vector databases or frameworks such as LangChain or LangGraph is a plus.
• Strong ownership and accountability, with the ability to take initiative and deliver assigned work.
• Good communication and collaboration skills, with the ability to work effectively with senior engineers and cross-functional teams.
• Ability to learn quickly and adapt to new technologies, tools and engineering practices.
• Experience shipping web or backend services is a plus.
• Knowledge of caching, message queues, concurrency and performance tuning is a plus.
• Familiarity with Docker, Kubernetes, cloud platforms such as AWS, Google Cloud Platform (GCP) or Microsoft Azure, or observability tools such as Prometheus, Grafana or ELK is a plus.
• Exposure to LLM evaluation, prompt iteration, data feedback loops or basic fine-tuning workflows is a plus.
• Able to commit to at least 6 months, 5 days per week.

Benefits

• 3-6 month early-career internship opportunity with potential for continued engagement based on business needs and applicable local laws.
• Work-from-home arrangement, subject to the nature of the business team.
• Opportunity to gain hands-on experience in blockchain, digital assets, AI and LLM technologies.
• Exposure to backend and full-stack software development and production engineering.
• Collaboration with experienced engineers and global teams.
• Opportunities for networking and professional development.
• Experience working on fast-paced, innovative projects with autonomy and meaningful technical challenges.
• Continuous learning and opportunities for career development.
• Competitive salary and company benefits.
• Opportunity to develop transferable technical and professional skills in a global technology environment.