{"id":4651796,"url":"https://alion.io/job/upstart-principal-engineer-llm","title":"Principal Engineer, LLM","company":{"id":1709,"name":"Upstart","domain":"upstart.com","url":"https://alion.io/company/upstart","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":82,"open_postings":18,"ghost_share":0.056,"stale_share":0.556,"repost_share":0.056,"time_to_fill_p50_days":59,"computed_at":"2026-11-19T09:08:57Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["United States"],"countries":["US"],"hiring_countries":["CA"],"hiring_countries_total":1,"salary":{"min":238400,"max":330200,"currency":"USD","period":"year","gross":null,"usd_annual":330200},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"AI Agents","optional":false},{"name":"Context Engineering","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Function Calling","optional":false},{"name":"Knowledge Distillation","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Distillation","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"Python","optional":false},{"name":"React.js","optional":false},{"name":"Rest API","optional":false},{"name":"Structured Outputs","optional":false},{"name":"TypeScript","optional":false},{"name":"JavaScript","optional":true}],"status":"live","first_seen_at":"2026-11-19T23:18:50Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-20T02:17:29Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Upstart\nAt Upstart, we’re united by a mission that matters: to radically reduce the cost and complexity of borrowing for all Americans. Every day, we bring creativity, experimentation, and advanced AI to reshape access to credit, helping millions move forward financially with clarity and confidence.\nAs the leading AI lending marketplace, we partner with banks and credit unions to expand access to affordable credit through technology that’s both radically intelligent and deeply human. Our platform runs over one million predictions per borrower using more than 3,000 signals, powering smarter, fairer decisions for millions of customers. But the numbers only hint at the impact. Every idea, every voice, and every contribution moves us closer to a world where credit never stands between people and their financial progress.\nWe’re proudly digital-first, giving most Upstarters the flexibility to do their best work from wherever they thrive, alongside teammates across 80+ cities in the US and Canada. Digital-first doesn’t mean distant. We’re intentional about in-person connection through team onsites, planning sessions, and moments that spark creativity and trust. And whether you choose to work primarily from home or collaborate in-person from one of our offices in Columbus, Austin, the Bay Area, or New York City, you’ll have the support to work in the way that works best for you.\nIf you’re energized by tackling meaningful problems, excited to innovate with purpose, and motivated by work that truly matters, we’d love to hear from you.\nThe Team: \nAt Upstart, our Applied AI team's mission is threefold:\nAgent Platform: Build and support the platform that makes it straightforward for non technical users across Upstart to build, launch, and operate AI agents (voice/chat/text) reliably.\n\nBorrower and Applicant Assistant Orchestration: Build the orchestration layer behind a unified personal assistant that shares context across specialized agents, giving applicants and borrowers a cohesive, assistant-like experience.\n\nBorrower-Connected Internal Workflows: Improve internal operational workflows that directly connect to applicant and borrower experiences, making them faster, smarter, and more efficient.\n\nAs Principal Engineer, LLM you will serve as a technical pathfinder and force multiplier for this team and the product squads we partner with. Rather than owning internal developer-tooling infrastructure or training foundation models from scratch, your mandate is to compress the time between an ambiguous idea and a reliable, user-facing AI system, while raising the applied AI bar across every squad you touch.\nThis role operates on an explicit 80/20 charter:\n0-to-1 Product and Architecture Pathfinder (~80%): Rapidly prototype high-ambiguity bets across our agent platform, cross-agent context orchestration, borrower-facing assistant experiences, and internal workflows. Partner directly with Product and Design to validate non-deterministic UX, establish clean architectural patterns, and hand off battle-tested evaluation contracts for engineering squads to scale.\n\nAI-Native Engineering Catalyst (~20%): While dedicated internal teams own Upstart's broader AI developer tooling and software-factory initiatives, you will serve as a visible practitioner on the product side. You will lead by example with agentic coding workflows and tight verification harnesses, partner with our internal tooling teams as an early adopter (\"customer zero\"), and help product squads adopt higher-leverage ways of working.\n\nBecause AI systems are non-deterministic, user experience is part of the architecture. Whether you are designing cross-agent handoffs, borrower-facing assistant flows, or internal operational tools, you will navigate real-world trade-offs across latency, unit economics, reliability, and user trust, and push back constructively when a simpler deterministic approach is the right call.\nHow you’ll make an impact\nDe-risk 0-to-1 bets across the stack: Rapidly prototype ambiguous initiatives spanning multi-agent context sharing, UX for non technical users, platform primitives for launching agents, and borrower-connected internal workflows.\n\nDeliver durable evaluation contracts, not throwaway handoffs: Treat prototype code as disposable proof of concept, and hand off to engineers what they actually need to build production services with confidence: golden datasets, automated evaluation harnesses, documented failure-mode maps, latency/cost benchmarks, and clean architectural blueprints.\n\nPartner cleanly from spike to production: Align early with receiving squad tech leads to surface system constraints, support joint go/no-go decisions with Engineering and Product leadership (including killing unviable bets early), and stay engaged through initial productionization to review early PRs and debug edge-case model behavior.\n\nDesign non-deterministic UX and orchestration together: Treat latency spikes, context loss between agents, subtle hallucinations, and fallback paths as systems design problems, shaping experiences that earn and protect borrower and operator trust.\n\nMake pragmatic applied AI trade-offs: Default to the simplest reliable solution first (prompting, context engineering, deterministic guardrails), and make clear architectural calls on model routing, fine-tuning, or distillation when latency, unit economics, or reliability require it.\n\nRaise the applied AI bar across squads: Model disciplined agentic coding and verification practices in your daily workflow, feed practical requirements back to internal tooling teams, and elevate engineering judgment across teams through active collaboration.\n\nMinimum Qualifications \nSoftware engineering foundation and live AI shipping: 8+ years of software engineering experience, along with hands-on experience shipping non-deterministic, user-facing LLM or AI products to real users.\n\nAgentic and LLM systems architecture: Deep practical experience designing production LLM systems involving structured outputs, tool calling, context engineering, retrieval/memory patterns, and multi-step or multi-agent orchestration (including state management and context sharing across agents).\n\nProduction systems, latency, and reliability engineering: Strong distributed-systems and backend fundamentals for non-deterministic pipelines: async orchestration, streaming UX, caching, timeouts and fallback paths, rate-limit handling, and end-to-end observability/tracing to diagnose failures.\n\nEvaluation and quality engineering: Proven experience building golden datasets, automated evaluation harnesses (deterministic checks, heuristics, and LLM-as-a-judge), regression gates, and systematic failure-mode analyses.\n\nSafety, guardrails, and applied AI pragmatism: Strong instinct to reach for the simplest reliable tool first (deterministic logic, prompting, context engineering, guardrails against hallucinations and prompt/data risks), paired with sound judgment on when latency, unit cost, or reliability justify routing, fine-tuning, or distillation over frontier APIs.\n\nFull-stack prototyping fluency: Comfortable moving fast across backend and frontend stacks (such as Python, TypeScript/React, and modern REST or streaming APIs) to put working end-to-end prototypes in front of users and stakeholders quickly.\n\nLow-ego pathfinder collaboration and UX empathy: Track record aligning early with partner squads, handing off ownership cleanly without ego, and partnering directly with Product, Design, and operations or business leaders to turn ambiguous goals into concrete latency budgets and resilient fallback experiences.\n\nBachelor's degree in Computer Science, Engineering, Mathematics, or equivalent practical experience.\n\nPreferred Qualifications\nStartup or 0-to-1 incubation DNA: Experience operating in early-stage or low-boundary environments where you owned ambiguous problems end to end under real constraints.\n\nAgent platform and shared abstractions: Experience designing reusable agent primitives, SDKs, or orchestration platforms that help peer engineering teams build, evaluate, and launch AI workflows safely and quickly.\n\nProduction fine-tuning and distillation reps: Hands-on experience fine-tuning or distilling smaller models in production to improve latency, unit economics, or task reliability.\n\nAI-native engineering habits: Deep daily fluency with agentic coding workflows and automated verification harnesses, plus experience helping peer engineers adopt higher-leverage development practices.\n\nExperience in regulated or high-trust consumer domains (such as fintech, lending, or healthcare) where accuracy, explainability, PIIprotection, and user trust are critical.\n\nPosition location This role is available in the following locations: Remote \nTime zone requirements The team operates on the East/West coast time zones. \nTravel requirements As a digital first company, the majority of your work can be accomplished remotely. The majority of our employees can live and work anywhere in the U.S but are encouraged to to still spend high quality time in-person collaborating via regular onsites. The in-person sessions’ cadence varies depending on the team and role; most teams meet once or twice per quarter for 2-4 consecutive days at a time.\n#LI-MidSenior \nAt Upstart, your base pay is one part of your total compensation package. The anticipated base salary for this position is expected to be within the below range. Your actual base pay will depend on your geographic location-with our “digital first” philosophy, Upstart uses compensation regions that vary depending on location. Individual pay is also determined by job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.\nIn addition, Upstart provides employees with target bonuses, equity compensation, and generous benefits packages (including medical, dental, vision, and 401k).\nUnited States | Remote - Anticipated Base Salary Range\n$238,400—$330,200 USD\nWhat you'll love\nAt Upstart, our benefits for full-time employees are designed to support your health, financial well-being, family, and personal growth. Here’s what you can expect:\nCompetitive compensation, including base pay, bonus opportunities, and annual equity grants that vest quarterly \nRetirement benefits to help you plan for the future, including a 401(k) or Group Retirement Savings Plan with a company match of $2 for every $1 contributed, up to $15,000 annually (USD in the US, CAD in Canada)\nEmployee Stock Purchase Plan (ESPP) with discounted stock purchase options for eligible employees (US only)\nComprehensive health coverage designed to support you and your family, including medical, dental, vision, and wellness resources for US and supplemental health coverage for Canada.\nHealth Savings Account contributions from Upstart for eligible plans (US only)\nIncome protection benefits, including life insurance and disability coverage for added financial security\nPaid time off, sick leave, and company holidays, in line with local requirements\nPaid family and parental leave to support caregiving and major life moments (duration varies by country)\nFamily-centered benefits to support fertility, parenthood, and caregiving needs\nEmployee Assistance Program (EAP) offering mental health support and life-centered resources\nFinancial wellness resources, including access to financial planning tools and a financial concierge service (US Only)\nAnnual wellness allowance to support your physical and emotional well-being and personal development, based on what matters most to you\nAnnual productivity allowance to invest in relevant tools and resources you need to do your best work, no matter where you work from\nConnection and community through team events, all-company updates, and employee resource groups (ERGs)\nOnsite perks, including catered lunches and fully stocked micro-kitchens when working fro...","description_format":"text","description_chars":12625,"description_truncated":true,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["401k plan","Equity","Life insurance","Parental leave","Retirement plans"],"hiring_locations":[{"name":"Canada","iso":"CA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Financial Software & Embedded Finance","Financial AI","Consumer Loans & Pawnshops"],"lifecycle":[{"event":"open","at":"2026-11-20T02:17:29Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 63 · green card filings: 13","filings_12m":63,"filings_prev_12m":58,"green_card_filings_12m":13,"median_offered_wage_usd":191447,"route":null,"cap_exempt":false,"checked_at":"2026-11-19T07:44:56+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":36}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":59,"reasons":["conf:1","win:early"],"computed_at":"2026-11-20T04:01:18Z"},"pay":{"stated_usd_annual":330200,"is_top_pay":true},"html_url":"https://alion.io/job/upstart-principal-engineer-llm","json_url":"https://alion.io/job/upstart-principal-engineer-llm.json","meta":{"generated_at":"2026-11-20T04:01:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":201,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1709},"rest":"https://alion.io/mcp/rest/get_company?id=1709"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fupstart-principal-engineer-llm"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fupstart-principal-engineer-llm"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fupstart-principal-engineer-llm"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/upstart-principal-engineer-llm\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fupstart-principal-engineer-llm"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4651796}},{"tool":"search_jobs","arguments":{"company":"upstart.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4651796},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}