Product Engineer
About the Role
This is a Product Engineer role on an AI agent evaluation product that transforms agent traces into reliable, repeatable evals. You will sit at the intersection of engineering and community, shipping features for agent builders while creating in public on X and GitHub. What you hear from the community feeds directly into what gets built.
What You'll Do
Build and ship product features covering evals, replay, cohorts, and developer experience, with strong taste for what is genuinely useful versus surface-level.
Create in public on X and GitHub, posting, demoing, and engaging with the AI engineering community to surface signal that shapes the product roadmap.
Flex across whatever the week demands, whether that is feature work, marketing motion, or customer demos.
Stay close to the target audience of AI agent builders, eval practitioners, and developers working with agent frameworks and custom runtimes.
Close the loop between community feedback and shipped product, treating distribution and engineering as one continuous motion.
What We're Looking For
3+ years building or shipping production software, with hands-on experience building or evaluating agents in real systems.
Proficiency in Python for production code.
Hands-on experience with agent frameworks (such as LangGraph, Claude Code, or equivalent).
Experience with evaluation systems for LLM or agent outputs, and with trace data, observability, or agent execution debugging.
Experience shipping developer tools, SDKs, or APIs with strong attention to DX, including documentation, ergonomics, and demos.
Open-source contributions with measurable adoption or usage by other developers.
Active, visible participation on X/Twitter or similar platforms discussing technical work in AI engineering or developer tooling.
Comfort operating in an early-stage, high-uncertainty environment where wearing multiple hats is the norm, not the exception.
Familiarity with LLM observability platforms or production ML infrastructure is a plus.
Public technical writing or content creation that demonstrates the ability to explain complex concepts clearly.
Compensation & Benefits
Salary range: $125,000 to $190,000 USD annually.
Location
This role is fully remote. The primary office location is Munich, Bavaria, Germany.