Bengaluru
9+ year exp
Java
Master's Degree
Apply now
Save
Overview
Company
Profile match
Impact
Conditions
Benefits
Hiring process
Similar jobs
Tekion
Tekion is an end-to-end, AI-native automotive retail platform that unifies dealership operations — DMS, CRM, digital retail, service, payments and analytics — on a single cloud-based operating system. Tekion powers 3,000+ dealerships and has processed $43B+ in transactions.
Responsibilities:
- Design and build production-grade AI platform services: LLM gateways, MCP servers, and agent orchestration frameworks.
- Lead the design and implementation of Tekion's AI gateway, a unified abstraction layer for multi-provider LLM access with intelligent routing, fallback, cost optimisation, token budgeting, and comprehensive observability.
- Design and implement MCP (Model Context Protocol) infrastructure.
- Design agentic AI patterns, multi-step reasoning workflows, tool orchestration, guardrails, and human-in-the-loop escalation paths.
- Take end-to-end ownership of critical platform subsystems.
- Solve complex performance bottlenecks across inference and orchestration layers.
- Mentor junior and mid-level engineers.
- Communicate and collaborate with management, product, QA, UI/UX, and AI/ML teams.
- Deliver with quality, on time, in a fast-paced start-up environment.
Requirements:
- Bachelor/Master's in Computer Science or relevant fields.
- 9+ years of relevant software engineering experience.
- Strong sense of ownership.
- Excellent Java and object-oriented development skills.
- Experience in building and scaling microservices.
- Strong problem-solving skills, technical troubleshooting, and diagnosing.
- Expected to be a role model for young engineers with a strong sense of code quality and enforce code quality within the team.
- Strong knowledge of RDBMS and NoSQL technologies.
- Experience in developing backends for enterprise systems (eCommerce / manufacturing/supply chain, etc. )
- Excellent understanding of debugging, performance, and optimisation techniques.
- Experience with Java, MongoDB, MySQL, AWS technologies, ELK stack, Spring Boot, Kafka.
- Experience in developing large-scale cloud-native applications.
- Proven experience leading and mentoring engineering teams, driving technical excellence, architectural decisions, and successful project delivery.
- Strong understanding of LLM fundamentals.
- Experience with or strong knowledge of MCP (Model Context Protocol), designing tool schemas, building MCP servers, tool discovery, and integrating MCP into agentic workflows.
- Understanding of AI gateway architecture, multi-provider LLM routing, semantic caching, load balancing, token tracking, cost allocation, fallback chains, and request/response logging.
- Familiarity with agentic AI frameworks LangChain/LangGraph, LlamaIndex, CrewAI, OpenAI Agents SDK, or similar orchestration tools.
- Experience with LLM observability and evaluation tracing (LangSmith, OpenTelemetry), LLM-as-judge evaluation, cost and latency monitoring.
- Understanding of AI safety and guardrails, input/output validation, PII detection, content filtering, and hallucination mitigation.
- Demonstrated ability to deliver in a fast-paced environment.
- Good communication skills.
Recommended for you based on this role
Similar stack
Same company
In your city
Application Support Engineer-II
1 day ago
In office • Full-Time • 3+ year exp • Bachelor's Degree • Bengaluru
Python
SQL
DevOps
AWS
Datadog
GCP
Splunk
Management
Jira
Apply
Senior Software Engineer - Data Engineer
1 day ago
Equity • In office • Full-Time • 6+ year exp • Bengaluru
Python
Scala
SQL
Databases
Apache Hudi
Apache Iceberg
Apache Kafka
Delta Lake
AI/ML
Airflow
Flink
Spark
DevOps
AWS
CI/CD
Git
Apply
Senior Staff Machine Learning Engineer
1 day ago
In office • Full-Time • 10+ year exp • Bachelor's Degree • Bengaluru
Python
AI/ML
PyTorch
Scikit-learn
TensorFlow
DevOps
AWS
Azure
CI/CD
GCP
Kubernetes
Apply
Application Support Engineer - II
1 day ago
3+ year exp • Bachelor's Degree • Bengaluru
Java
Python
SQL
DevOps
AWS
Datadog
GCP
Splunk
Management
Jira
Apply
Staff Software Engineer - Backend
2 days ago
In office • Full-Time • 8+ year exp • Bachelor's Degree • Bengaluru
Java
Java
Spring Boot
Databases
Apache Kafka
MySQL
DevOps
AWS
Apply
Staff Engineer, DevOps
8 days ago
In office • Full-Time • 8+ year exp • Bachelor's Degree • Bengaluru
DevOps
AWS
Azure
CI/CD
GCP
Kubernetes
Platform Engineering
Pulumi
Self-Healing
Service Mesh
Terraform
Apply
Software Development Engineer in Test
10 days ago
2+ year exp • Bachelor's Degree • Bengaluru
Java
SQL
TypeScript
DevOps
CI/CD
Git
Jenkins
Rest API
QA
Playwright
Selenium
Apply
Frontend / Fullstack Engineer
13 days ago
Chennai
JavaScript
TypeScript
Frontend
Angular
React.js
Vue.js
DevOps
Git
Apply
Senior Backend Engineer
15 days ago
Contractor • Chennai
Java
Databases
Neo4j
Qdrant
AI/ML
LangChain
Langflow
LangGraph
LLM
Semantic Search
DevOps
Vector
Apply
Software Engineer II
20 days ago
Remote/Hybrid • Full-Time • 4+ year exp • Bachelor's Degree • Bengaluru
Python
SQL
Databases
Databricks
AI/ML
AI Agents
dbt
DevOps
CI/CD
Rest API
SLI/SLO/SLA
Analytics
Tableau
Apply
Career impact
Discover how this job can transform your career
Get a personal career forecast for this job - salary uplift, next-level role, skill boost and a 3-year financial impact, all calculated from your profile.
Personal salary uplift vs. your current pay
Your 3-year career trajectory
Skills you will level up in this role
3-year financial impact in dollars
Free forever • Less than a minute • No credit card
Work setup
Location
Bengaluru
