Senior Agentic AI Architect

As the Agentic AI Architect at EDMO, you will own the end-to-end technical design and architecture of our agentic AI systems. You will be the bridge between research-grade AI ideas and production-hardened implementations - defining how LLM pipelines, multi-agent orchestration, memory systems, and tool-use come together into a coherent, scalable platform.

This is not a research or prototyping role. You will design systems that run at enterprise scale, handle real student interactions, integrate with university SIS/CRM platforms, and meet compliance standards (FERPA, SOC 2). Equally important, you will be able to communicate complex architecture decisions clearly to engineers, product stakeholders, and enterprise clients.

What You'll Own:

• Define the end-to-end agentic AI architecture - LLM orchestration layers, agent coordination mechanisms, memory management, tool-calling patterns, and multi-agent workflows.
• Design multi-agent orchestration patterns including hierarchical agents, supervisor-worker topologies, plan-and-execute strategies, and agent-to-agent (A2A) communication.
• Architect RAG (Retrieval-Augmented Generation) pipelines, hybrid search, and knowledge management systems tailored to higher-education content (catalogs, policies, student data).
• Establish architectural standards for prompt engineering, context-window management, token budgeting, and evaluation frameworks.
• Design for non-functional requirements: latency targets, throughput, reliability, observability, cost controls, and scaling guardrails.
• Build production-grade systems with structured error handling, retry logic, circuit breakers, and fallback execution paths.
• Define DevSecOps architecture and deployment patterns across multi-cloud environments.
• Implement human-in-the-loop (HITL) checkpoints for sensitive decision points within student journeys.
• Establish monitoring, observability, and audit logging frameworks for compliance, traceability, and agent behavior analysis.
• Design secure AI architectures - threat modeling, adversarial prompt defenses, and data privacy controls aligned with FERPA and SOC 2.
• Produce clear architecture documentation: reference diagrams, integration patterns, decision records, ADRs, and runbooks for production operations.
• Communicate architectural trade-offs to both engineering teams and non-technical enterprise clients in a structured, accessible way.
• Lead architecture and design reviews, mentoring engineers on agentic patterns and production best practices.
• Serve as the technical point of contact for enterprise client integrations - translating institutional requirements into AI system design.
• Stay current with the latest agent frameworks (LangGraph, CrewAI, AutoGen, Google ADK), LLM advancements, and inference optimization techniques.
• Build prototypes and proof-of-concepts to validate architectural approaches before committing to production builds.
• Drive the technology roadmap for EDMO's agentic platform - identifying where autonomous agents can replace manual workflows with measurable ROI.

You'll Be a Great Fit If You Have:

• 5+ years of hands-on software engineering, with 3+ years specifically in production AI/ML systems.
• Demonstrated experience designing and shipping multi-agent AI systems in production (not just prototypes or demos).
• Deep expertise with LLM orchestration frameworks: LangChain, LangGraph (preferred), and/or AutoGen, CrewAI, Google ADK.
• Strong command of Python and backend engineering fundamentals - APIs, microservices, async patterns.
• Hands-on experience with RAG architectures, vector databases, and semantic search.
• Proficiency with cloud platforms (AWS, GCP, or Azure) and containerized deployments (Docker, Kubernetes).
• Ability to design systems addressing latency, scalability, reliability, and cost simultaneously - not just "it works on my local machine".
• Experience with agent memory architectures: episodic, semantic, procedural - and state management in stateful multi-agent graphs.
• Familiarity with LLM inference optimization - quantization, model routing, caching, context compression.
• Understanding of API gateway design, service boundaries, versioning, and governance.
• Ability to produce clear architecture diagrams and technical documentation accessible to both engineers and non-technical stakeholders.
• Experience presenting architecture to enterprise clients or senior leadership.
• Track record of leading technical design reviews and influencing architecture decisions without direct authority.

Nice to Have:

• Experience with voice AI / telephony.
• Salesforce / CRM integration experience.
• Higher education domain knowledge.
• FERPA / SOC 2 compliance experience.
• Familiarity with n8n or workflow automation tools.
• Experience with Databricks / MongoDB for AI data pipelines.
• Google Gemini / Vertex AI experience.

What You Won't Be Doing:

• Research-only, notebook-bound, or demo-focused ML work.
• Low-code/no-code automation tool configuration (Zapier, Make, etc.).
• "Prompt-only" AI work without systems thinking.
• Architecture decks that never get built.

How We Work:

• Tech Stack: Python, LangGraph, LangChain, Google Gemini / Claude / OpenAI (multi-LLM), MongoDB, Databricks, Salesforce integrations.
• Deployment: Production-grade microservices, containerized on cloud with CI/CD pipelines.
• Compliance Environment: FERPA, SOC 2, VPAT - security and privacy are first-class concerns.
• Team: Small, high-caliber engineering team. Architects write architecture AND contribute to code.
• Clients: US-based universities and EdTech platforms at enterprise scale.

What Success Looks Like:

• In 30 days: Full audit of existing agentic system architecture; documented gaps, risks, and improvement areas.
• In 60 days: Delivered a reference agentic architecture for at least one production agent workflow; established architecture review process with the engineering team.
• In 6 months: Led architecture for a major platform capability (e.g., multi-agent student advisor, autonomous enrollment workflow); communicated architecture to at least one enterprise client; established observability and evaluation framework for agents in production.

Compensation & Growth:

• Level: Senior Architect.
• Opportunity: Direct path to VP of AI as EDMO scales.
• Impact: Your architecture decisions shape the AI experience for hundreds of thousands of students at leading US universities.
• This role sits at the intersection of applied AI research, enterprise product engineering, and client strategy - rare in the market.

Skills

AutoGen, CrewAI, Google ADK, LangChain, LangGraph, Python, RAG, Retrieval-Augmented Generation