2,448,881open jobs
150,171companies
300,098added this week
Browse all
Salary
$8.7k per year (gross)
Location
In office (Hyderabad)
Experience
3+ years exp
Employment
Full-Time

First seen by Alion on Nov 20, 2026.

Overview
Company
Impact
Profile match
86 Agency is a senior-only software development company building custom platforms, cloud infrastructure and AI systems for fintech, healthcare and SaaS teams.

Job Details:

Company: 86 Agency

Position: Software Development Engineer – AI

Experience: 3+ Years (Mandatory)

Location: Hyderabad

Work Mode: Hybrid

 

About the Role

We are hiring a Software Development Engineer - AI to build production-grade AI applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic AI frameworks. The role involves developing intelligent workflows, integrating enterprise data sources, and building reliable, secure, scalable AI services with an emphasis on accuracy, traceability, and performance.

 

What You Will Build

• LLM Applications & AI Services: LLM-powered applications, prompt workflows, structured outputs, and function calling.

• Agentic AI & Orchestration: AI agents, tool integrations, and multi-step workflow automation.

• RAG & Knowledge Retrieval: Document ingestion, embeddings, vector databases, semantic search, and

contextual retrieval.

• AI Evaluation & Guardrails: Response validation, hallucination mitigation, quality evaluation, and monitoring.

• Enterprise AI Integration: AI-powered document processing, information extraction, summarization, and report generation.

• AI Governance & Traceability: Citations, source attribution, audit logging, and secure data handling.

 

Key Responsibilities

• Develop and maintain AI applications using LLMs, RAG, and agentic AI frameworks.

• Build AI agents capable of executing multi-step tasks and interacting with APIs, tools, and enterprise systems.

• Implement document ingestion, parsing, chunking, embedding, and retrieval pipelines.

• Develop prompt templates, structured outputs, function calling, and context management mechanisms.

• Integrate LLM services with backend APIs, databases, and enterprise data sources.

• Implement AI evaluation pipelines to measure accuracy, relevance, faithfulness, latency, and cost.

• Develop guardrails for hallucination mitigation, prompt injection protection, and sensitive data handling.

• Build AI-powered document analysis, extraction, summarization, and content generation workflows.

• Implement citations, source traceability, logging, and validation of AI-generated outputs.

• Optimize AI workflows for performance, scalability, token usage, and cost efficiency.

• Write clean, testable, maintainable Python code and contribute to code reviews, testing, and deployments.

• Collaborate with senior engineers, platform teams, and product stakeholders to deliver production-ready AI capabilities.

 

Required Qualifications

• 3+ years of software development experience, with practical experience building AI/LLM-based applications.

• Strong Python programming skills and experience building backend services or REST APIs.

• Hands-on experience with LLM APIs such as OpenAI, Azure OpenAI, Anthropic, or open-source models.

• Experience implementing RAG pipelines, embeddings, and vector search (e.g., FAISS, pgvector, Pinecone, or Qdrant).

• Familiarity with LangChain, LangGraph, LlamaIndex, Semantic Kernel, or equivalent implementations.

• Understanding of prompt engineering, function calling, structured outputs, and AI application testing.

• Working knowledge of Git, Docker, CI/CD, databases, and cloud deployment fundamentals.

Preferred Qualifications

• Experience with multi-agent workflows, MCP, or enterprise tool integration.

• Familiarity with LLM evaluation and observability tools such as LangSmith, Langfuse, or Arize Phoenix.

• Experience in document intelligence, OCR, or unstructured data processing.

• Understanding of RBAC, data privacy, auditability, and regulated enterprise environments.

 

Important: A minimum of 3+ years of software development experience is mandatory. Profiles with less than 3 years of experience will not be considered.

 


Skills

Python, LangGraph, LangChain, Large Language Models (LLM), Retrieval Augmented Generation (RAG)

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,448,881 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
Hyderabad
$6.5k per year (gross) · In office · Full-Time · 1+ year exp · Chennai
SQL
Databases
PostgreSQL
Apply
Postgre Developer 1 day ago
$5.4k – $6.5k per year (gross) · In office · Full-Time · 2+ years exp · Chennai
SQL
Databases
PostgreSQL
Apply
Software Engineer 2 days ago
In office · Full-Time · 2+ years exp · Bengaluru
Python
Python
Flask
SQLAlchemy
FastAPI
Django
Databases
MySQL
PostgreSQL
Redis
AI/ML
LangGraph
LangChain
DSPy
LlamaIndex
AI Agents
LLM
RAG
OpenAI
Anthropic
Hugging Face
DevOps
Rest API
gRPC
GCP
Azure
CI/CD
Git
AWS
Docker
Kubernetes
TCP/IP
Management
Agile
QA
Pytest
Apply
Hybrid · Full-Time · 6+ years exp · Bachelor's Degree · Bengaluru
Python
Perl
Apply
Remote (India) · Full-Time · 6+ years exp · Bachelor's Degree · Bengaluru
Python
Perl
Apply
In office · Bachelor's Degree · Hyderabad
JavaScript
Java
TypeScript
SQL
Java
Hibernate
Frontend
Angular
DevOps
Azure
AWS
Management
Agile
Scrum
Apply
Kafka Administrator 10 hours ago
In office · 5+ years exp · Hyderabad
Python
Databases
Apache Kafka
DevOps
Splunk
Ansible
Prometheus
Grafana
Incident Management
Apply
In office · Hyderabad
Apply
In office · Full-Time · 10+ years exp · Bachelor's Degree · Hyderabad
DevOps
Splunk
Terraform
Ansible
Red Hat
VMWare
Chef
Datadog
Azure
Windows Server
Grafana
Platform Engineering
AIOps
GitHub
Linux
Windows
Management
ServiceNow
Apply
In office · Full-Time · 10+ years exp · Hyderabad
AI/ML
AI Agents
RAG
DevOps
Splunk
OpenTelemetry
Azure
CI/CD
Platform Engineering
FinOps
AIOps
Incident Management
SLI/SLO/SLA
Management
ServiceNow
Apply
See all jobs
This is one of many
2,448,881 more open roles from verified company boards, updated every day.