Senior AI Engineer
ID80138
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
About the role
We are looking for an Agentic AI Engineer to design and build AI agents that continuously analyze ServiceNow Discovery logs, classify failures, perform root cause analysis, and recommend or generate corrective actions at enterprise scale across millions of infrastructure targets. You will develop agentic observability capabilities for MID Servers and Discovery schedules, integrate LLM APIs including OpenAI and Anthropic using RAG and vector databases, and convert operational runbooks into reusable agentic workflows using advanced Python engineering. Strong infrastructure troubleshooting and network protocol knowledge is required alongside production-grade Python and CI/CD experience.
What you will do
Design and build AI agents that continuously analyze Discovery logs, execution results, errors, and failed discoveries at scale.
Develop agents capable of classifying and correlating failures, performing troubleshooting, identifying probable root causes, and recommending corrective actions.
Build capabilities for agents to analyze and recommend or generate corrections to ServiceNow Discovery probes and patterns, with appropriate testing, guardrails, and human approval before production changes.
Convert operational knowledge, runbooks, and recurring troubleshooting procedures into reusable agentic workflows, progressively reducing manual investigation and improving Discovery reliability.
Design and build AI agents that continuously assess the health of the ServiceNow Discovery ecosystem, including MID Servers, discovery schedules/playbooks, target execution, throughput, latency, failures, retries, and discovery coverage.
Develop agents that regularly collect, aggregate, and interpret metrics and telemetry from ServiceNow Discovery, MID Servers, logs, monitoring platforms, and other relevant data sources.
Must haves
Advanced Python
development experience of at least 4+ years, and REST API design capabilities with experience building APIs, data-processing pipelines, integrations, automation, and production-grade engineering solutions;
Strong experience with modern software development and SDLC practices and toolchains, including Git/GitHub, Jenkins or equivalent CI/CD platforms, artifact repositories, automated testing, code quality/security scanning, release management, and deployment automation;
Practical experience integrating Gen AI APIs into software applications, e.g.OpenAI, Anthropic, and a working understanding of developer-level concepts like Retrieval-Augmented Generation (RAG) and Vector databases. (Note: We need software builders, not Machine Learning researchers.);
Practical knowledge of Infrastructure Engineering with Linux, Windows Server, compute, virtualization/cloud infrastructure, authentication, processes/services, and infrastructure troubleshooting;
Working knowledge of TCP/IP, DNS, routing, firewalls, ports, SSH, WMI/WinRM, SNMP, HTTP/S, and common network and infrastructure troubleshooting techniques;
Experience with high-volume logs, metrics, errors, and operational datasets to identify patterns, anomalies, trends, and root causes and turn them into actionable engineering improvements;
Upper-Intermediate English level;
Nice to haves
Hands-on experience with ServiceNow Discovery, including MID Servers, Discovery Patterns/Probes, credentials, schedules, Discovery Status, ECC Queue, and troubleshooting Discovery failures;
Experience developing or modifying ServiceNow Discovery Patterns and Probes and understanding how infrastructure attributes and relationships are discovered;
Experience with ServiceNow CMDB/CSDM, Configuration Items (CIs), identification/reconciliation, relationships, and CMDB data quality;
Experience with observability technologies such as Prometheus, OpenTelemetry, alongside Grafana;
The benefits of joining us
Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
Flextime
Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office - whatever makes you the happiest and most productive.
Meet Our Recruitment Process
Asynchronous stage - An automated, self-paced track that helps us move faster and give you quicker feedback:
Short online form to confirm basic requirements
30-60 minute skills assessment
5-minute introduction video
Synchronous stage - Live interviews
Technical interview with our engineering team (scheduled at your convenience)
Final interview with your future teammates
If it's a match - you'll get an offer!