{"id":3016696,"url":"https://alion.io/job/businessonbot-ai-engineer","title":"AI Engineer","company":{"id":9241,"name":"BusinessOnBot","domain":"businessonbot.com","url":"https://alion.io/company/businessonbot","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":20000,"max_usd":50000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":32},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"FastAPI","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Function Calling","optional":false},{"name":"Gemini","optional":false},{"name":"Knowledge Distillation","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"LangSmith","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Distillation","optional":false},{"name":"New Relic","optional":false},{"name":"Node JS","optional":false},{"name":"OpenAI","optional":false},{"name":"Pino","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Reranking","optional":false},{"name":"Sentry","optional":false},{"name":"Structured Outputs","optional":false},{"name":"Text-to-Speech","optional":false},{"name":"TypeScript","optional":false},{"name":"WebSockets","optional":false},{"name":"WhatsApp","optional":false},{"name":"JavaScript","optional":true}],"status":"live","first_seen_at":"2026-10-21T16:35:45Z","employer_posted_date":null,"last_verified_at":"2026-10-21T16:35:45Z","board_verified":false,"closed_at":null,"days_open":4,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":4},"description":"We're looking for an AI Engineer who can own our agent stack end-to-end: design, build, ship, and keep it healthy in production. This is not a research role. You won't be reading papers and running benchmarks in a notebook. Our AI agents talk to real customers of real D2C brands, on WhatsApp and on voice, about their orders and their money. When an agent hallucinates a discount code or loops on a tool call, a business owner notices and a customer is unhappy. So the job is to build agents that work reliably, prove they work with evals and traces, keep them from doing dumb or dangerous things with guardrails, and do all of it without the inference bill quietly doubling every quarter. You'll be the person who holds the entire agent architecture in their head. That means being independent; you'll get direction on what the product needs, not a spec for how to build it.\n\nThe core responsibilities for the job include the following:\n\nAgent Architecture, End-to-End: \nOwn the design and implementation of the production LLM agent tool calling, memory, state, multi-step reasoning, and handoff to humans.\nBuild and maintain Python/FastAPI services that expose these agents to our platform, reliably and at low latency.\nDecide agent boundaries: what's one agent vs. many, what's a tool vs. a workflow step, and what should never be an LLM call at all.\nIntegrate with our core backend, messaging channels, and e-commerce/CRM data sources so agents actually have the context they need.\n\nRAG and Retrieval Quality: \nBuild and own retrieval pipelines for chunking, embedding, indexing, reranking, and refresh strategy.\nDebug retrieval failures properly: is it the chunking, the query, the index, or the prompt? Know how to tell the difference.\nHandle multi-tenant data isolation in retrieval as a correctness and security requirement, not an afterthought.\nKeep retrieval fresh as brand catalogs, policies, and offers change.\n\nGuardrails and Safety: \nDesign input and output guardrails, prompt injection defense, PII handling, scope enforcement, refusal behavior, and escalation paths.\nPrevent the failure modes that cost customers money: hallucinated commitments, wrong order info, runaway tool loops, and unbounded retries.\nBuild deterministic fallbacks for when the model is wrong, slow, or unavailable.\nTreat \"the agent said something it shouldn't have\" as a production incident, not a prompt-tuning ticket.\n\nObservability, Tracing, and Evaluation: \nInstrument everything: traces, spans, token usage, latency, and tool call outcomes (we use LangSmith, New Relic, Sentry, and Pino structured logging).\nBuild eval sets and regression suites so we know whether a prompt or model change made things better or worse, with evidence.\nMake agent behavior debuggable by someone who isn't you; a trace should tell the story without a walkthrough.\nSet up alerting for quality degradation, not just uptime.\n\nCost Consciousness: \nOwn the LLM and infrastructure cost of everything you ship (AWS, OpenAI, Gemini, vector store, embedding compute).\nKnow the unit economics: cost per conversation, per resolution, and per brand, and be able to quote them.\nMake the routing calls smaller model vs. larger, cached vs. fresh, and retrieval vs. long context, and defend them with numbers.\nFlag cost anomalies early and propose architectural fixes, not just usage caps.\n\nCustomer Empathy: \nUnderstand that our agents are the front door for D2C businesses talking to their customers.\nRead real conversations. Sit with the support and product teams. Let actual failures shape the roadmap, not intuition.\nTreat a customer-facing quality bug with more urgency than an internal refactor.\n\nBalancing Tradeoffs: \nNavigate the tension between shipping a working agent this month and building the platform that supports fifty of them.\nKnow when a prompt is the right answer and when it's a hack that will break in three weeks.\nMake architecture decisions that hold up as the AI surface area grows agents, voice, and deeper e-commerce automation.\n\nRequirements: \n3-5 years of software engineering experience, with meaningful time spent shipping LLM-powered features to production.\nStrong Python, with production experience in FastAPI (or equivalent async Python service frameworks).\nHands-on experience building agents with LangChain (or LangGraph / similar orchestration frameworks), not just calling a chat completion endpoint.\nPractical experience with LangSmith or comparable tooling for tracing, evals, and prompt/version management.\nDirect experience with OpenAI and Gemini model families, including their tool calling, structured output, and failure quirks.\nBuilt and operated a RAG pipeline in production, and can explain what broke and how you fixed it.\nReal experience designing guardrails and safety layers around LLM output.\nComfort with AWS and with reasoning about cost/performance tradeoffs in cloud and inference spend.\nThe ability to hold an entire agent architecture independently; you can go from a fuzzy product goal to a shipped, monitored system without hand-holding.\n\nStrong Plus: \nExperience building voice AI pipelines: STT/TTS, streaming, turn-taking, barge-in, and latency budgets.\nExposure to real-time messaging systems (WebSockets, pub/sub, queue-driven architectures).\nExperience with multi-tenant SaaS architecture and per-tenant data isolation.\nFamiliarity with WhatsApp Business API, omnichannel messaging, or e-commerce integrations.\nExperience working alongside a TypeScript/Node.js backend.\nFine-tuning, distillation, or model routing work done for cost or latency reasons\nPrior experience at a startup in the 10-100 person range where you set the standard rather than inherited it.\nSkills\nAWS, FastAPI, Gemini, LangChain, LangGraph, LangSmith, OpenAI, Python, RAG, guardrails, tracing","description_format":"text","description_chars":5791,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commerce","Conversational AI","Social Commerce","Marketing & Sales AI"],"lifecycle":[{"event":"open","at":"2026-10-21T16:35:45Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.859,"p_room":1,"age_days":4,"expected_fill_days":23,"reasons":["seen:4","win:early"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/businessonbot-ai-engineer","json_url":"https://alion.io/job/businessonbot-ai-engineer.json","meta":{"generated_at":"2026-10-26T08:50:36Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11751,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":9241},"rest":"https://alion.io/mcp/rest/get_company?id=9241"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbusinessonbot-ai-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbusinessonbot-ai-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbusinessonbot-ai-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/businessonbot-ai-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbusinessonbot-ai-engineer"}]}