{"id":4509055,"url":"https://alion.io/job/oscilar-engineering-manager-ai-agents-agent-platform-llms-evals","title":"Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)","company":{"id":3434,"name":"Oscilar","domain":"oscilar.com","url":"https://alion.io/company/oscilar","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":87,"open_postings":22,"ghost_share":0.136,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":84,"computed_at":"2026-11-18T05:48:20Z"}},"role":"Leadership","role_family":"Leadership","seniority":"lead","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"AI Agents","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"Platform Engineering","optional":false},{"name":"AWS","optional":true},{"name":"AWS Bedrock","optional":true},{"name":"Java","optional":true},{"name":"LangChain","optional":true},{"name":"LangGraph","optional":true},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-11-18T00:58:19Z","employer_posted_date":"2026-11-18","last_verified_at":"2026-11-18T03:52:24Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":0},"description":"Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)\nShape the future of trust in the age of AI\nAt Oscilar, we're building the most advanced AI Risk Decisioning™ Platform. Banks, fintechs, and digitally native organizations rely on us to manage their fraud, credit, and compliance risk with the power of AI. If you're passionate about solving complex problems and making the internet safer for everyone, this is your place.\nWhy join us:\nMission-driven teams: Work alongside industry veterans from Meta, Uber, Citi, and Confluent, all united by a shared goal to make the digital world safer.\n\nOwnership and impact: We believe in extreme ownership. You'll be empowered to take responsibility, move fast, and make decisions that drive our mission forward.\n\nInnovate at the cutting edge: Your work will shape how modern finance detects fraud and manages risk.\n\nBackground\nOscilar is seeking a US-based Manager of AI Agents to lead a team of engineers building and operating the production agent systems at the heart of our Agentic Risk Platform.\nIn this role, you will own the technical and people leadership for a team focused on agent orchestration, tool-calling, evaluation frameworks, reliability, and observability. You will partner closely with product, FDE and core platform engineering to raise the bar on what production-grade agents can deliver for fraud, AML, credit, and onboarding use cases.\nThis is a hands-on leadership role for someone who has been a software engineer, has shipped real agent systems in production, and has successfully built and managed engineering teams at a growing start-up or scale-up. The right person is energized by technical depth, operational excellence, and turning ambitious agent ideas into reliable, customer-facing systems.\nResponsibilities\nTeam leadership: Build, lead, and grow a high-performing team of engineers focused on AI agent systems. Hire, coach, and develop talent while establishing strong technical and cultural standards. Create an environment where strong engineers want to stay and grow.\n\nProduction agent systems: Drive the design, development, and continuous improvement of production agent capabilities including orchestration, tool-calling (including MCP and related protocols), evaluation frameworks, reliability, observability, and safe failure modes. Agents are built on a governed platform where every new agent inherits shared evals, guardrails, and auditability.\n\nTechnical quality and judgment: Raise the bar on architecture, design quality, reliability, and service ownership for agent systems that operate in high-stakes, regulated environments.\n\nCross-functional impact: Partner with Forward-Deployed Engineers and customer teams to ship agents into customer environments and turn field feedback into platform improvements.\n\nOperational excellence: Establish clear planning, execution, and incident processes that support predictable delivery without unnecessary overhead. Own reliability and post-incident learning for agent systems.\n\nTalent and leadership development: Recruit senior individual contributors and emerging leaders. Create an environment where strong engineers want to stay and grow.\n\nScale and reliability: Ensure AI agent systems meet the performance, security, auditability, and reliability standards required by financial institutions that rely on our platform to process billions of risk decisions.\n\nRequirements\nSignificant hands-on software engineering experience, with a track record of shipping production systems.\n\nProven experience building and shipping agent systems in production, including hands-on work with tool-calling, orchestration, evaluation frameworks (evals), and reliability engineering.\n\nExperience managing and building engineering teams of 5+ people (direct reports or equivalent), including hiring, coaching, and raising technical standards.\n\nExperience at a growing startup or scale-up, with comfort operating in fast-moving, ambiguous environments and creating structure where needed.\n\nStrong technical judgment and enough depth to evaluate agent architectures, system design, failure modes, and engineering quality with credibility.\n\nExcellent written and verbal communication skills, with experience partnering across product, data science, and distributed teams.\n\nExperience with reliability, observability, and production operations for complex AI or distributed systems.\n\nExperience in fintech, fraud, credit risk, AML, compliance, or other regulated industries is a strong plus.\n\nPrior experience with Model Context Protocol (MCP), multi-agent orchestration, or large-scale agent evaluation systems is highly valued.\n\nOur Tech stack: LangGraph (or similar agent frameworks), AWS Bedrock, Python + Java, MCP\n\nThis is a remote senior engineering leadership role based in the US. You will report into engineering leadership and have direct ownership of a critical part of Oscilar’s agent platform.\nBenefits\nCompensation: Competitive salary and equity packages, including a 401k\n\nFlexibility: Remote-first culture - work from anywhere\n\nHealth: Comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US)\n\nBalance: Unlimited PTO policy\n\nTechnical: AI First company; both Co-Founders are engineers at heart; and over 50% of the company is Engineering and Product\n\nCulture: Family-Friendly environment; Regular team events and offsites\n\nDevelopment: Unparalleled learning and professional development opportunities\n\nImpact: Making the internet safer by protecting online transactions","description_format":"text","description_chars":5557,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Equity","Professional development","Unlimited PTO","Vision insurance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Fraud Detection","RegTech, AML & Compliance","Financial AI"],"lifecycle":[{"event":"open","at":"2026-11-18T03:52:24Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 12 · green card filings: 2","filings_12m":12,"filings_prev_12m":4,"green_card_filings_12m":2,"median_offered_wage_usd":199643,"route":null,"cap_exempt":false,"checked_at":"2026-11-17T07:35:00+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":1}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":84,"reasons":["conf:1","win:early"],"computed_at":"2026-11-18T05:48:20Z"},"pay":null,"html_url":"https://alion.io/job/oscilar-engineering-manager-ai-agents-agent-platform-llms-evals","json_url":"https://alion.io/job/oscilar-engineering-manager-ai-agents-agent-platform-llms-evals.json","meta":{"generated_at":"2026-11-18T05:57:46Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10858,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3434},"rest":"https://alion.io/mcp/rest/get_company?id=3434"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Foscilar-engineering-manager-ai-agents-agent-platform-llms-evals"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Foscilar-engineering-manager-ai-agents-agent-platform-llms-evals"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Foscilar-engineering-manager-ai-agents-agent-platform-llms-evals"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/oscilar-engineering-manager-ai-agents-agent-platform-llms-evals\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Foscilar-engineering-manager-ai-agents-agent-platform-llms-evals"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4509055}},{"tool":"search_jobs","arguments":{"company":"oscilar.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4509055},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}