{"id":165904,"url":"https://alion.io/job/userpilot-software-engineer-agentic-platform","title":"Software Engineer - Agentic Platform","company":{"id":58871,"name":"Userpilot","domain":"userpilot.com","url":"https://alion.io/company/userpilot","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"BambooHR","truth_index":{"grade":"B","score":75,"open_postings":7,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Backend","role_family":"Backend","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Dublin, Ireland"],"countries":["IE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":56000,"max_usd":144000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":8},"experience_years_min":3,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Claude","optional":false},{"name":"Claude Code","optional":false},{"name":"Cursor","optional":false},{"name":"Elixir","optional":false},{"name":"FastAPI","optional":false},{"name":"Function Calling","optional":false},{"name":"JavaScript","optional":false},{"name":"LangChain","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Pydantic","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"React.js","optional":false},{"name":"Structured Outputs","optional":false},{"name":"Tool Use","optional":false},{"name":"WebSockets","optional":false},{"name":"Anomaly Detection","optional":true},{"name":"AutoGen","optional":true},{"name":"ClickHouse","optional":true},{"name":"Hybrid Search","optional":true},{"name":"Langfuse","optional":true},{"name":"LangGraph","optional":true},{"name":"OpenTelemetry","optional":true},{"name":"Time Series Forecasting","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-06-05T00:00:00Z","employer_posted_date":"2026-06-05","last_verified_at":"2026-10-17T12:27:35Z","board_verified":true,"closed_at":null,"days_open":134,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":134},"description":"About Userpilot\nUserpilot is a leading product analytics and user engagement platform used by product teams at hundreds of companies to understand, segment, and activate their users. The product spans a performant JavaScript SDK that runs inside customers' web apps, a Chrome Extension for building in-app UI without code, and a React dashboard that handles complex real-time data, all backed by a distributed Elixir/Phoenix backend that sustains hundreds of thousands of concurrent WebSocket connections, high-throughput Kafka event ingestion, and real-time content delivery at scale.\nWe move fast, we ship often, and we believe the best engineers care as much about the product they're enabling as the systems and interfaces they build.\nThe Role\nThis is an AI-deep role focused on Lia, Userpilot's agent platform, the system that turns a rich product-data model into reliable, grounded, multi-turn AI experiences. The AI is the product, not just a tool you use to build it.\nYou'll own and elevate the agent platform: a Python service built on Microsoft Agent Framework, with hybrid retrieval over multiple tool catalogs, complex multi-step orchestration utilizing skills and sub-agents, multi-turn state and grounding, and full trace-level observability and cost accounting, all built on framework-neutral domain contracts.\nThis is a platform you own and push further, not just keep running. You'll contribute to architecture, raise the reliability and eval bar, and help define where a frontier agentic system goes. We hire engineers who can follow a problem wherever it leads, who know when deterministic logic or statistics beat an LLM and vice versa, and who care about the customer experience as much as the system underneath.\nWhat You'll Work On\nConversational AI experiences grounded in a rich product-data model, with the tool use, retrieval, streaming, and orchestrated multi-turn grounding required to do it reliably, not just plausibly.\nThe agent runtime and orchestration itself: complex, multi-step agentic workflows, behind framework-neutral domain contracts that keep business logic portable.\nHybrid retrieval and tool grounding: RAG (vector + lexical) over tool catalogs assembled from multiple sources (OpenAPI specs, MCP, …), so the agent calls the right operation with the right arguments against live customer data.\nPackaged AI workflows that produce durable, editable, actionable outputs, not just chat answers that get lost in history.\nThe eval, observability, and cost infrastructure that makes all of this safe and economically viable in production: a multi-layer eval harness (deterministic checks plus live, judge-scored reasoning evals), end-to-end tracing, and per-call cost accounting.\nAgent interoperability: an MCP server that exposes Userpilot's tools to external AI agents.\nWhat You'll Do\nDesign, build, and operate the agent platform end to end, from the API surface through the runtime, tools, retrieval, persistence, and observability.\nBuild LLM/agent features that ground reliably in customer data, with the streaming, retries, evals, and graceful degradation required to hold them to a production reliability bar.\nPick the right tool for each signal (retrieval, deterministic logic, structured outputs, statistics, or an LLM), and combine them well.\nTreat evals, cost-per-call, and latency as first-class. AI features that run continuously at scale have unit economics; the economics matter as much as the output.\nWork in a spec-driven, agent-assisted flow, reading and contributing to PRDs that drive both human and AI implementation.\nContribute to the team's agentic infrastructure (AGENTS.md, CLAUDE.md, DESIGN.md, slash commands, architectural rules) so AI tooling understands our codebase as well as the humans do.\nReview code for architectural consistency and reliability, including making sure agent-generated code respects the same boundaries and framework-neutral contracts that human-written code does.\nRaise the bar around you: set the patterns, write the specs and evals others build on, and level up the engineers (and agents) working in the platform.\nWhat We're Looking For\nRequired\n3+ years building and shipping production software, with a track record of owning systems (not just features) and raising the quality bar for the people around you.\nStrong Pythonand CS fundamentals, including solid work with databases, queues, or real-time systems. The agent platform runs on Python (FastAPI, Pydantic, async), so you're fluent here or will be very quickly.\nProduction agentic / LLM systems, not just calling an API:tool use, retrieval grounding, structured outputs, multi-turn state and continuity, streaming, evals, and designing for non-deterministic behavior. Having owned an agent runtime or orchestration layer end to end is a strong signal.\nArchitectural judgment for AI systems:you keep domain logic decoupled from a fast-moving vendor framework, make build-vs-adopt calls deliberately, and know why that matters when the framework landscape shifts every quarter.\nJudgment about when to use an LLM and when not to:you reach for deterministic logic, retrieval, or statistics when they're more reliable, cheaper, or more reproducible, and you can tell which is which.\nAI-native workflow:you use AI coding agents (Claude Code, Cursor) as a real part of how you build, prompting for scaffolding, reviewing output critically, and knowing when to push back.\nStrong product sense and judgment. You care about the user experience and about system correctness in equal measure.\nSelf-management and a continuous-improvement mindset. We don't over-prescribe how the work gets done.\nBonus Points\nExperience with agent frameworks or orchestration: Microsoft Agent Framework, LangGraph, AutoGen, or a runtime you built yourself.\nRAG and tool-use platforms (retrieval over tools and APIs, OpenAPI-driven tool generation, MCP).\nLLM evals and observability: designing them, running them, and acting on the signal, with tracing and cost tooling like Langfuse or OpenTelemetry GenAI.\nCost engineering on LLM workloads (caching, batching, model routing, prompt compaction).\nEmbedding-based retrieval or clustering (vector DBs, hybrid search, HDBSCAN, UMAP, and similar).\nMulti-tenant SaaS architecture: data isolation, per-tenant state, noisy-neighbor concerns.\nFull-stack / core-services depth:production React/TypeScript, and/or our core stack (Elixir/Phoenix with OTP, ClickHouse, Kafka). You won't live here day to day, but it helps where the agent platform meets the rest of the product.\nTime-series anomaly detection or drift monitoring; recommendation or ranking systems with user-feedback loops.\nSpec-driven development, writing or working from specs that drive both human and AI implementation.\nContributing to developer experience or agentic infrastructure.\nTechnical leadership on an engineering team.\nOpen source contributions.\nHow We Build\nAI is at the center of what we ship and how we ship it. A few things we believe about how the work gets done:\nStatistics, heuristics, and LLMs each have a role. The mistake we don't want to make is asking an LLM to do anomaly detection or risk scoring directly: wrong economics, wrong reliability, wrong reproducibility. Use the LLM where it's strongest; use statistics where they're strongest; use heuristics where they're cheapest.\nFeatures start with a written spec (a PRD that captures intent and constraints), not a two-line ticket, whether the implementer is a human or an agent.\nCoding agents do the scaffolding; engineers own the architecture, the review, and the judgment calls.\nEvals are how we ship safely. Every LLM-shaped feature gets an eval suite before it goes to production, and we look at the suite, not just whether it ran.\nLLM calls are economics, not free. Caching, batching, model routing, and prompt compaction are first-class engineering concerns.\nFeedback loops are how AI features get smarter. Instrument everything.\nOur patterns are encoded explicitly. Every umbrella app and product domain has an AGENTS.md capturing what it does, the patterns it uses, and the mistakes to avoid, so an agent working on core doesn't violate a cache invariant or write directly to ClickHouse, and an agent on the dashboard doesn't break a design contract.\nDX is a product: if a new engineer (or an AI agent) can't understand a domain from its documentation and rules, that's a bug we fix.\nYou don't need to have done all of this at your last job. But you should be genuinely curious about it, comfortable owning a system end to end, and excited to help shape how AI products get built here.\nRight to Work\nCandidates must have the right to work in Ireland. We are not in a position to offer visa sponsorship for this role.\nEqual Opportunities Statement\nUserpilot is an equal opportunity employer. We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of gender, civil status, family status, age, disability, race, religion, sexual orientation, or membership of the Traveller community, in accordance with the Employment Equality Acts 1998-2015.\nData Privacy Notice\nBy applying for this role, your personal data will be processed by Userpilot for the purposes of recruitment and candidate evaluation. We will retain your information for no longer than is necessary for this purpose.","description_format":"text","description_chars":9355,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Product Analytics & Session Replay","Developer Tools"],"lifecycle":[{"event":"open","at":"2026-06-05T00:00:00Z"}],"visa":[],"liveness":{"score":6,"band":"cold","label":"Long shot","p_open":1,"p_active":0.231,"p_room":0.28,"age_days":134,"expected_fill_days":30,"reasons":["conf:1","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/userpilot-software-engineer-agentic-platform","json_url":"https://alion.io/job/userpilot-software-engineer-agentic-platform.json","meta":{"generated_at":"2026-10-17T15:50:25Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":21434,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":58871},"rest":"https://alion.io/mcp/rest/get_company?id=58871"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fuserpilot-software-engineer-agentic-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fuserpilot-software-engineer-agentic-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fuserpilot-software-engineer-agentic-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/userpilot-software-engineer-agentic-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fuserpilot-software-engineer-agentic-platform"}]}