Mid/Senior AI Engineer (m/f/n)

For one of our clients, we are looking for a Mid/Senior AI Engineer (m/f/n).

You'd work on a live LLM system with real users - not a proof of concept. We're looking for a Senior AI Engineer who can take an LLM-based feature from idea to production and then keep it accurate, fast, observable and efficient.

Tasks and responsibility

• Build LLM-powered features end to end. Design and implement agentic flows, retrieval, and tool calling using LangGraph - then ship them as FastAPI services with streaming, persistence and proper tests.
• Own answer quality. Build evaluation datasets, regression suites and LLM-as-judge checks so we know whether a prompt or model change made things better before it reaches users.
• Get the right context to the model. Turn user questions into effective queries against our search platform, orchestrate multi-step research loops, and shape the context the model reasons over. When an answer is wrong, work out whether retrieval, the query or the prompt is at fault - and fix the right one.
• Debug production. Instrument flows with tracing (Langfuse), investigate bad answers from real traces, and manage latency, token and cost budgets - including routing across model sizes and families behind an AI gateway.

Requirements

• Experience in building and operating backend services - APIs, async, testing.
• Hands-on experience taking LLM features to production and keeping them running - not only prototypes.
• Agent / orchestration frameworks. LangGraph ideally.
• Practical RAG experience.
• Experience debugging LLM systems in production - tracing, evaluation, cost and latency.
• Experience running services in the cloud (we're on Azure).
• Strong problem-solving skills, analytical thinking, and technical decision-making.
• Fluent in English, proactive communicator, and a collaborative team player.
• Open-minded, creative, and motivated to push boundaries in AI and automation.

Tech stack

• Python
• FastAPI
• LangGraph
• Azure OpenAI, Google Gemini, Anthropic Claude
• FAISS
• PostgreSQL
• Langfuse
• Azure App Insights
• Bicep
• Docker / Podman

Nice to have

• Azure OpenAI, AI Search, App Service
• Infrastructure-as-code (Bicep)
• Mentoring or tech-lead experience

What We Offer:

• Rate: 175 PLN/H net + VAT
• B2B contract via SHIMI
• Location: Remote
• Availability: ASAP
• Long-term engagement