{"id":2137130,"url":"https://alion.io/job/llamaindex-head-of-engineering","title":"Head of Engineering","company":{"id":3562,"name":"LlamaIndex","domain":"llamaindex.com","url":"https://alion.io/company/llamaindex","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Leadership","role_family":"Leadership","seniority":"head","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":200000,"max":300000,"currency":"USD","period":"year","gross":null,"usd_annual":300000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Fine-tuning","optional":false},{"name":"LlamaIndex","optional":false},{"name":"Multimodal AI","optional":true},{"name":"OCR","optional":true}],"status":"live","first_seen_at":"2026-10-08T23:26:16Z","employer_posted_date":"2026-10-08","last_verified_at":"2026-10-26T10:27:24Z","board_verified":true,"closed_at":null,"days_open":17,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":17},"description":"Join us and help shape the future of AI by defining the narrative around document understanding.\nAbout the Role\nLlamaIndex makes enterprise data useful for AI applications.\nYou will own engineering execution, technical direction, hiring, and team development. You will work closely with company leadership and product teams to decide what we build, how we build it, and how we deliver it reliably to customers.\nThis is a hands-on role. You should be comfortable reviewing code and architecture, debugging production issues, and writing code for critical systems. We are looking for someone who has shipped and operated B2B API products and understands both model serving and model training-from experimentation and evaluation to deployment and production operations.\nResponsibilities\nLead and develop our engineering team, setting clear priorities, ownership, and accountability.\n\nPartner with company leadership to translate customer needs into a focused roadmap and deliver software predictably.\n\nStay directly involved in architecture, code reviews, production debugging, and implementation of critical changes.\n\nSet technical direction across application services, APIs, data pipelines, and ML infrastructure, balancing immediate customer needs with long-term maintainability.\n\nWork with ML engineers and researchers on model training, fine-tuning, evaluation, and deployment, ensuring model improvements translate into better production outcomes.\n\nGuide model serving decisions across latency, throughput, GPU utilization, capacity, reliability, and inference cost.\n\nImprove engineering practices for testing, observability, security, incident response, and releases.\n\nHire strong engineers, coach technical leaders and managers, and build a culture of direct communication, customer focus, and responsibility for results.\n\nRequired Qualifications\nExperience leading multiple engineering teams in B2B SaaS, at a scope comparable to a 20-30-person organization, with responsibility for delivering and operating customer-facing products.\n\nStrong, current hands-on engineering skills: you can read and write production code, review architecture, and diagnose complex technical problems.\n\nPractical familiarity with model serving and model training, including training or fine-tuning workflows, evaluation, deployment, and production operations.\n\nUnderstanding of the tradeoffs between model quality, latency, throughput, GPU resources, reliability, and cost.\n\nStrong background in backend systems, APIs, distributed systems, and cloud infrastructure.\n\nA track record of hiring and developing engineers, setting clear expectations, and giving constructive feedback.\n\nGood product judgment, including knowing when to move quickly and when to invest in correctness, reliability, and security.\n\nClear written and verbal communication with technical teams, customers, and company leadership.\n\nPreferred Qualifications\nExperience scaling engineering at a Series A-C startup.\n\nExperience with document processing, OCR, extraction, retrieval, indexing, or other systems that work with enterprise data.\n\nExperience with LLMs or multimodal models, evaluation datasets, and model quality monitoring.\n\nExperience with GPU infrastructure, distributed training, inference optimization, or model serving frameworks.\n\nExperience building developer tools or API-first products.\n\nExperience with enterprise requirements such as multi-tenancy, access controls, auditability, and security reviews.\n\nExperience developing engineering managers while staying closely involved in technical execution.\n\nPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.\n LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.","description_format":"text","description_chars":3948,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Agents","AI Development Tools","Vector Search & RAG"],"lifecycle":[{"event":"open","at":"2026-10-09T02:11:18Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":17,"expected_fill_days":87,"reasons":["conf:3","win:early"],"computed_at":"2026-10-26T05:57:25Z"},"pay":{"stated_usd_annual":300000,"is_top_pay":true},"html_url":"https://alion.io/job/llamaindex-head-of-engineering","json_url":"https://alion.io/job/llamaindex-head-of-engineering.json","meta":{"generated_at":"2026-10-26T13:59:16Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":19312,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3562},"rest":"https://alion.io/mcp/rest/get_company?id=3562"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fllamaindex-head-of-engineering"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fllamaindex-head-of-engineering"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fllamaindex-head-of-engineering"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/llamaindex-head-of-engineering\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fllamaindex-head-of-engineering"}]}