Overview
Technical skills
Timeline
Architected and shipped Grounded LLM v0.3.0, a production RAG platform (Go + Python) serving document-grounded AI assistants with source citations and numeric verification (±0.01).
Achieved 100% fact-retrieval accuracy on a 99-case adversarial evaluation suite running in GitHub Actions CI.
Built grounded-vllm, an OpenAI-compatible proxy placing token-level guardrails in the LLM serving path with +0.71ms p50 overhead.
Developed grounded-guardrails (Rust + Go gRPC) — zero-copy token buffer, PII detection (<50μs), and numeric verification.
Created grounded-bench, a public benchmark with 1000 cases across finance, medical, legal, technical, and HR domains (NVR, CP, HR, RR metrics).
Designed grounded-agent, a ReAct orchestrator with multi-step reasoning, tool use via MCP Gateway, and Redis session memory.
Built mcp-gateway (Go) — MCP protocol gateway with WASM sandboxed tools (wazero), OpenTelemetry tracing, and Prometheus metrics.
Designed a multi-tenant REST API (OpenAPI/SSE) with tenant data isolation, authentication, and audit logging.
Integrated local LLM inference via vLLM (GPU, p95 ~0.7s) and Ollama (CPU, p95 ~4.5s) with Docker Compose profiles.
Implemented Redis caching for embeddings (1h TTL) and LLM responses (24h TTL) with X-Cache: HIT/MISS headers.
Delivered infrastructure-as-code via Docker Compose, Helm/Kubernetes, and Terraform (AWS/GCP/Azure).
Set up CI/CD pipelines with automated testing, security scanning (Trivy), and coverage gates (≥60%).
Optimized PostgreSQL schemas and queries, reducing analytics report generation time by 60%.
Built internal AI assistants for ticket classification, reducing L1 support workload by 40%.Designed an open-source LLM platform for grounded document assistants with cited and verified outputs. Built orchestration and a multi-tenant REST API in Go and Python/Flask, including authentication/authorization and streaming. Implemented hybrid retrieval (BM25 + embeddings with RRF) using Chroma, Qdrant, and pgvector, plus eval-driven CI quality gates. Delivered on-prem deployment using Docker Compose, Kubernetes, and Terraform across AWS/GCP/Azure.
MCP Protocol Gateway with WASM Sandbox
LLM Serving-Path Adapter with Guardrails Integration
RAG Platform with Hybrid Retrieval & Local LLM Inference
Redis
Gunicorn
- Develop production RAG retrieval features (hybrid vector + BM25 + reranker), reindexing and embedding-caching improvements informed by real load tests.
- Build LLM orchestration and verified-answer pipelines (guardrails integration, streaming completions and SSE fallbacks) for enterprise APIs and SDKs.
- Implement hardened deployment and observability playbooks (Helm values for secrets, network policies, Prometheus/OTel dashboards and release gating) to convert demos into production.
- Extend DB migration history and add migration tests and idempotent deploy hooks to make schema evolution safer for multi-tenant installs.
OpenTelemetry
Prometheus
Kubernetes
- Lead CI/CD and release automation for production LLM platforms, including image signing, SBOMs and gated retrieval/quality checks (use the existing .github/workflows/release.yml and ci.yml as a base).
- Implement and maintain Helm charts and reference Terraform stacks for staging/production (extend deploy/terraform and deploy/helm with remote state, secrets pipelines and PDBs).
- Build observability playbooks and SLO-driven alerting using existing metrics and traces (api/http/app.py metrics + Jaeger/OTel hooks in mcp-gateway).
- Develop reliable reindex/drift workflows and migration automation around the RAG vector stores, leveraging the existing reindex and migration tracking code.
