{"id":1253041,"url":"https://alion.io/job/leena-ai-engineering-manager","title":"Engineering Manager","company":{"id":1957,"name":"Leena AI","domain":"leena.ai","url":"https://alion.io/company/leena-ai","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Leadership","role_family":"Leadership","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gurgaon, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":30000,"max_usd":82000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":27},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Embeddings","optional":false},{"name":"Function Calling","optional":false},{"name":"Hallucination","optional":false},{"name":"Hybrid Search","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Microsoft Office","optional":false},{"name":"NLP","optional":false},{"name":"Node JS","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"ServiceNow","optional":false},{"name":"Tool Use","optional":false},{"name":"JavaScript","optional":true},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2026-09-11T07:04:45Z","employer_posted_date":null,"last_verified_at":"2026-09-11T07:04:45Z","board_verified":false,"closed_at":null,"days_open":35,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":35},"description":"About Leena AI : \n\nLeena AI is a leader in Agentic AI for the enterprise.\n\nWe are building an iconic company, delivering AI Colleagues that transform back-office functions and accelerate the full promise of Generative AI unlocking real productivity gains, cutting costs, and delighting employees at scale.\n\nLeena AI provides the most forward-looking, open, and scalable Agentic AI architecture for the enterprise it empowers CIOs and CTOs to develop, deploy, and manage AI Colleagues for the back office at scale.\n\nBuilt with full governance, compliance, security, and auditability at its core.\n\nLeena AI integrates with 1000+ applications, including SAP, Salesforce, ServiceNow, Workday, and Microsoft Office 365.\n\nWe are proud to be trusted by 500+ global enterprises and 20 million+ employees, including leading brands such as Nestle, Puma, Coca-Cola, Sony, and Etihad Airways.\n\nFounded in 2018 and headquartered in New York, Leena AI has secured over $40M in financing from top-tier investors including Greycroft, Bessemer Venture Partners, B Capital, and Y Combinator.\n\nRole Overview : \n\nLeena AI's agentic assistant answers employees' HR, IT, and policy questions from each customer's knowledge base, across ~400 enterprise tenants.\n\nThis role leads the Knowledge Intelligence team : retrieval and ranking, answer grounding, conflict detection, LLM policy, and the evaluation infrastructure that keeps an LLM-powered agent trustworthy at enterprise scale.\n\nThe role blends people leadership, system design, and hands-on ownership of production LLM systems.\n\nThe candidate we hire has shipped LLM-based products to real users - with evals, tool calling, and cost/latency engineering not only classical ML.\n\nClassical ML depth is necessary here; it is not sufficient.\n\nLLM & Agentic Systems Ownership : \n\n- Own production LLM systems end to end : RAG pipelines, agent tool-calling flows, model selection and routing, guardrails, and answer-vs-escalate decision logic.\n\n- Build and own evaluation infrastructure : golden datasets per tenant, LLM-as-judge graders calibrated against human judgment, regression gates on every prompt and model change, and online quality monitoring.\n\n- Drive answer quality : grounding and attribution against ACL-visible sources, hallucination control, and confidence calibration across heterogeneous tenant knowledge bases.\n\n- Engineer cost and latency at scale : routing to right-sized models, caching, and token budgets - with per-query economics you can state from memory.\n\nRetrieval & ML Ownership : \n\n- Own search quality across tenants : embeddings, rerankers, hybrid retrieval, chunking/sectioning, and measurement (recall@k, MRR) - including per-tenant diagnosis when quality regresses.\n\n- Guide the full model lifecycle : data preparation, training, evaluation, deployment, monitoring, and iteration - including the data-bias traps in learning from your own system's logs.\n\n- Ensure ML systems are reliable, observable, scalable, and cost-efficient in production.\n\nEngineering Leadership : \n\n- Lead, mentor, and grow a cross-functional team of backend and ML engineers.\n\n- Create a high-trust, high-ownership culture focused on quality, learning, and delivery.\n\n- Support career development, performance management, and technical growth of team members.\n\nArchitecture & Technical Direction : \n\n- Drive architecture for distributed, multi-tenant backend systems that integrate LLM inference, retrieval, and data pipelines.\n\n- Separate what must be learned from what should be a rule : design systems where models handle judgment and policy handles constraints.\n\n- Partner with senior ICs on trade-offs across accuracy, latency, cost, and system complexity; review designs and code across services, ML pipelines, and infrastructure.\n\nExecution & Cross-Functional Collaboration : \n\n- Plan and execute multi-quarter roadmaps spanning product engineering and ML initiatives; balance experimentation velocity with enterprise-grade reliability and compliance.\n\n- Work closely with Product, Applied AI, and Customer teams to align technical execution with business outcomes; translate product requirements into feasible plans.\n\n- Represent engineering in roadmap, prioritization, and stakeholder discussions - with metrics, not adjectives.\n\nRequirements LLM Production Experience (hard Requirement) : \n\n- Shipped LLM-based systems to production with real users - RAG, agents, or LLM-powered product features - and operated them : this is the bar, not a bonus.\n\n- Designed and run evaluation for LLM systems : offline golden sets, judge models validated against human labels, and eval-gated rollout of prompt or model changes.\n\n- Debugged real agent and tool-calling failures (malformed calls, loops, hallucinated grounding) and can tell those stories concretely, with numbers.\n\n- Reasoned about LLM system economics in production : cost per query, latency budgets, routing and caching strategies.\n\nExperience & Background : \n\n- 7+ years of software engineering experience, with prior hands-on IC work in ML or applied AI systems.\n\n- 2+ years managing engineers, ideally including ML or data-focused teams.\n\n- Experience building and operating production ML systems (not just experimentation or research).\n\nTechnical Expertise : \n\n- Strong retrieval/NLP foundation : embeddings, rerankers, hybrid search, and search-quality measurement.\n\n- Strong foundation in distributed systems and backend engineering (Node.js or Python, APIs, cloud infrastructure); multi-tenant SaaS experience valued.\n\n- Ability to reason about ML-specific trade-offs : accuracy vs latency, offline vs online metrics, calibration, retraining strategies.\n\nLeadership & Judgment : \n\n- First-principles problem framing : interrogates objectives, cost asymmetries, and constraints before proposing architecture.\n\n- Our interviews test this habit directly.\n\n- Proven ability to lead teams through ambiguity and technically complex problem spaces.\n\n- Comfortable being hands-on when needed, while primarily operating as a multiplier for the team.\n\n- Excellent communication with technical and non-technical stakeholders; can explain LLM behavior and risk to product and business partners.\n\nHow We Interview : \n\nWe tell candidates this up front because it produces better conversations.\n\nExpect : \n\n1. A deep-dive on an LLM system you personally shipped - architecture, eval story, failures, and cost.\n\n2. A design problem from our domain, where asking the right questions is scored.\n\nEducation : \n\nBachelor's or Master's degree in Computer Science, Engineering, or a related field (Tier 1 preferred).\n\nNice to Have : \n\n- Conversational AI, enterprise knowledge management, or search at multi-tenant scale.\n\n- Classical recommender/personalization systems experience (valued in addition to, not instead of, LLM production work).\n\n- Prior experience scaling AI systems in B2B SaaS or regulated, high-availability environments.\n\nSkills\nEngineering Management, Artificial Intelligence, Machine Learning, Generative AI, LLM, Distributed Systems, RAG, NLP","description_format":"text","description_chars":7051,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Conversational AI","Human Resources","HR & Recruiting AI"],"lifecycle":[{"event":"open","at":"2026-09-25T18:04:06Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 1","filings_12m":1,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":152500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":20,"band":"cold","label":"Long shot","p_open":0.6,"p_active":0.614,"p_room":0.55,"age_days":34,"expected_fill_days":27,"reasons":["seen:34","velocity","win:tail"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/leena-ai-engineering-manager","json_url":"https://alion.io/job/leena-ai-engineering-manager.json","meta":{"generated_at":"2026-10-17T02:19:41Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3274,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1957},"rest":"https://alion.io/mcp/rest/get_company?id=1957"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fleena-ai-engineering-manager"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fleena-ai-engineering-manager"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fleena-ai-engineering-manager"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/leena-ai-engineering-manager\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fleena-ai-engineering-manager"}]}