Salary
≈ $47k – $115k per year (Estimated)
Location
In office (Hyderabad)
Seniority
Senior
Overview
Company
Impact
Profile match
NStarX is a global IT solutions company that specializes in the development of cloud platforms, and mobile and e-commerce platforms to help startups and SMBs build cutting-edge SaaS products for the global market.
We are seeking an experienced and driven Agentic AI Platform Engineer to design and build the core backend infrastructure for our enterprise-grade Agentic AI platform. In this role, you will move beyond prototyping to architect robust services handling agent orchestration, model routing, enterprise security, cost telemetry, and deep data integration. You will be instrumental in ensuring our AI systems are scalable, observable, secure, and seamlessly connected to enterprise data ecosystems.
Responsibilities:
- Core Infrastructure Development: Build and maintain critical backend services for model routing, dynamic agent orchestration, and multi-agent graph protocols.
- Integration and Data Pipelines: Implement and optimise production-grade RAG pipelines (retrieval, embedding/vector search, and grounding) and develop robust enterprise connectors (SQL, Kafka, Salesforce, SharePoint).
- Security and Compliance: Engineer built-in data protection mechanisms, including PII detection/redaction, RBAC/ABAC policy enforcement, and tamper-evident audit logs.
- FinOps and Observability: Instrument complete system telemetry (tracing, metrics, and logs) and design usage/cost tracking mechanisms for multi-provider AI workloads.
- Deployment and Scaling: Design resilient REST APIs and deploy production services onto cloud-managed container orchestrators (Kubernetes/ECS).
Requirements:
- Expert Python and Async Frameworks: Extensive hands-on experience building production services using Fast API or equivalent asynchronous Python frameworks.
- Production AI Systems: Track record of shipping at least one LLM-powered system to production (multi-step orchestration, advanced RAG, or autonomous agents); prototypes or toy apps do not qualify.
- Agent/Graph Frameworks: Practical experience with agent frameworks. LangGraph is highly preferred (LangChain, AutoGen, or comparable frameworks considered).
- Data and Caching: Strong competency running PostgreSQL and Redis in high-throughput production environments.
- Cloud and DevOps: Direct experience deploying and managing production services on Kubernetes (EKS) or AWS ECS.
- Observability: Solid fundamentals in system instrumentation, specifically using Open Telemetry tracing, structured logging, and metrics collection.
- API Design: Proven ability to design secure, clean, and scalable REST APIs integrated with legacy enterprise ecosystems.
Good to Have:
- LLM Gateway Management: Experience using LiteLLM, Kong, Portkey, or Azure APIM for virtual keys, budget tracking, fallback chains, and caching.
- Advanced Protocols: Exposure to Model Context Protocol (MCP) for building or consuming MCP servers/clients, as well as multi-agent protocols.
- Cloud AI Platforms: Hands-on experience with Amazon Bedrock, SageMaker, or cross-provider model routing.
- Compliance Engineering: Knowledge of WORM retention, hash-chained audit logs, and automatic PII masking.
- AI FinOps: Experience setting up cost instrumentation and cost-tracking dashboards for massive LLM workloads.
- Enterprise Middleware: Experience building enterprise data connectors or working with event streaming via Apache Kafka.
- Policy-as-Code: Familiarity with OPA-based policy enforcement and sophisticated RBAC/ABAC security design.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
657,068 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Similar stack
Same company
Hyderabad
Manager, System Engineer
3 hours ago
$87k – $120k per year • In office • Full-Time • 5+ years exp • Bachelor's Degree • Joliet
Python
SQL
Apply
Custom Software Engineer
3 hours ago
≈ $27k – $61k per year (Estimated) • In office • Full-Time • 3+ years exp • Bengaluru • Chennai • Hyderabad • Pune • Kolkata
Python
SQL
Python
Flask
Django
AI/ML
LangChain
Management
Agile
Apply
Sr. SW Engineer
3 hours ago
≈ $116k – $221k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Foster City
Python
Go
JavaScript
Kotlin
TypeScript
SQL
Databases
RabbitMQ
Apache Kafka
AI/ML
Copilot
ChatGPT
AI Agents
DevOps
Rest API
Splunk
Terraform
GCP
OpenTelemetry
Datadog
Prometheus
Azure
CI/CD
Git
AWS
Docker
Kubernetes
Grafana
Analytics
ETL/ELT
QA
Swagger
Apply
Intern - Engineering ADAS Perception Features
3 hours ago
≈ $42k – $66k per year (Estimated) • In office • Internship • Bachelor's Degree • Auburn Hills
Python
C++
AI/ML
Computer Vision
Cybersecurity
GDPR
Robotics
Sensor Fusion
Apply
Internship: Digital Design F/M
3 hours ago
≈ $53k – $130k per year (Estimated) • In office • Internship • Master's Degree • Catania
Python
Verilog
SystemVerilog
Perl
Chips/EDA
Formal Verification
Apply
Data Engineer
1 month ago
≈ $39k – $104k per year (Estimated) • In office • Hyderabad
Python
Databases
DynamoDB
ElasticSearch
OpenSearch
Amazon Redshift
AI/ML
Scikit-learn
TensorFlow
PyTorch
DevOps
AWS
AWS Lambda
Amazon S3
Amazon CloudWatch
AWS Step Functions
API Gateway
Analytics
ETL/ELT
Domo
Apply
MLOps Engineer
2 months ago
≈ $47k – $127k per year (Estimated) • In office • Hyderabad
Python
SQL
AI/ML
LangChain
Cohere SDK
LLM
Hugging Face
DevOps
Ansible
Azure
CI/CD
AWS
Docker
Kubernetes
Apply
Product Manager - Adtech
2 days ago
≈ $38k – $92k per year (Estimated) • In office • 4+ years exp • Hyderabad
Mobile
AppsFlyer SDK
Management
Agile
Apply
Sr. Software Engineer
2 days ago
≈ $41k – $105k per year (Estimated) • In office • 4+ years exp • Bachelor's Degree • Hyderabad
JavaScript
TypeScript
DevOps
Azure DevOps
GitHub Actions
Azure
CI/CD
Jenkins
Git
Management
Agile
Scrum
QA
Selenium
Cucumber
Playwright
Postman
Rest-Assured
Apply
In office • Full-Time • Bachelor's Degree • Hyderabad
Apply
Senior Cyber Security Engineer
2 days ago
≈ $49k – $111k per year (Estimated) • Remote/Hybrid • 5+ years exp • Hyderabad
Python
PowerShell
AI/ML
AI Agents
DevOps
IAM
Apply
Apply
This is one of many
657,068 more open roles from verified company boards, updated every day.

