Generative AI/Agentic AI Engineer
First seen by Alion on Oct 16, 2026.
Gen AI / Agentic AI / LLM Engineer
Experience : 4+ Years
Employment Type : Full-Time
Job Summary :
We are looking for a skilled Gen AI / Agentic AI / LLM Engineer with 4+ years of experience in Python development, Generative AI, Large Language Models (LLMs), and AI-powered application development. The ideal candidate should have hands-on experience building LLM-based solutions, Retrieval-Augmented Generation (RAG) pipelines, AI agents, and scalable backend services. The candidate will be responsible for designing, developing, integrating, and deploying intelligent AI applications using modern LLMs, agentic frameworks, vector databases, and cloud-based AI services.
Key Responsibilities :
- Design and develop Generative AI applications using LLMs such as GPT, Claude, Llama, or Gemini.
- Build and optimize RAG pipelines, including document ingestion, chunking, embeddings, vector search, reranking, and retrieval optimization.
- Develop autonomous and semi-autonomous AI agents using frameworks such as LangGraph, LangChain, CrewAI, AutoGen, or Semantic Kernel.
- Implement tool calling, function calling, workflow orchestration, and multi-agent collaboration.
- Develop backend services and REST APIs using Python and frameworks such as FastAPI or Flask.
- Integrate LLM applications with enterprise systems, databases, APIs, and external tools.
- Work with vector databases such as FAISS, Pinecone, Weaviate, Chroma, or Azure AI Search.
- Implement prompt engineering, context management, conversation memory, and response optimization.
- Evaluate and improve AI application quality, including accuracy, relevance, hallucination rates, latency, and cost.
- Implement security measures, guardrails, input validation, and protection against prompt injection.
- Deploy and maintain AI applications using Docker, CI/CD pipelines, and cloud platforms.
- Collaborate with data scientists, software engineers, product teams, and business stakeholders.
Required Technical Skills :
1. Generative AI & LLMs :
- Hands-on experience with Generative AI and Large Language Models.
- Knowledge of GPT, Claude, Llama, Gemini, or similar models.
- Prompt engineering, structured outputs, embeddings, and LLM API integration.
2. Agentic AI & Frameworks :
- Experience with at least one framework : LangGraph, LangChain, CrewAI, AutoGen, or Semantic Kernel.
- Understanding of AI agents, tool/function calling, workflow orchestration, and agent memory.
- Ability to build tool-using agents and multi-step AI workflows.
3. RAG & Vector Databases :
- Experience building Retrieval-Augmented Generation (RAG) applications.
- Document processing, chunking strategies, embedding models, semantic search, and hybrid retrieval.
- Familiarity with vector databases such as FAISS, Pinecone, Chroma, Weaviate, or Azure AI Search.
4. Programming & Backend Development :
- Strong Python programming skills.
- Experience with FastAPI, Flask, REST APIs, and JSON.
- Working knowledge of SQL, Git, debugging, and software development best practices.
5. Cloud & Deployment :
- Exposure to AWS, Microsoft Azure, or Google Cloud.
- Familiarity with Docker, CI/CD, application deployment, and monitoring.
- Experience with Azure OpenAI, Amazon Bedrock, or Vertex AI is an advantage.
6. Evaluation & Responsible AI :
- Knowledge of LLM evaluation, hallucination reduction, and response quality assessment.
- Understanding of AI guardrails, data privacy, access control, and prompt-injection mitigation.
- Familiarity with tools such as LangSmith, RAGAS, or similar evaluation frameworks is preferred.
Good to Have :
- Experience with fine-tuning, LoRA/PEFT, or open-source LLMs.
- Knowledge of knowledge graphs, graph-based RAG, and advanced retrieval techniques.
- Experience with AI observability, tracing, and production monitoring.
- Familiarity with Kubernetes and scalable AI application architectures.
- Experience delivering enterprise-grade AI assistants, copilots, or automation solutions.
Education :
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.
Ideal Candidate Profile :
- 4+ years of relevant software development, AI/ML, or Generative AI experience.
- Practical experience building and deploying LLM-powered applications.
- Strong Python skills and a solid understanding of RAG and agentic AI architectures.
- Ability to develop production-ready AI solutions and troubleshoot complex technical issues.
- Strong analytical, communication, collaboration, and problem-solving skills.
Skills
Generative AI, Agentic AI, LLM, RAG, AI Integration, LangChain, Python, AWS, Machine Learning