Observability Engineer

The Opportunity:

Something breaks at 2 AM. Today, a human gets paged. Tomorrow, an AI agent detects the anomaly, correlates the root cause, triggers the remediation, and closes the ticket, all before the first cup of coffee. You are the engineer who builds that tomorrow.

We are seeking a senior Observability Engineer with expertise in both AI technologies and enterprise performance monitoring. This role combines hands-on engineering with AIOps implementation to deliver full-stack visibility across 250+ services. You will lead efforts to implement predictive monitoring and self-healing capabilities that drive down operational costs while increasing system availability by leveraging AI to triage and resolve incidents. You will mentor and supervise engineers, own technical quality, and push the program toward AI-driven observability with opportunities to build new observability platforms from the ground up as we expand into new environments. Due to the nature of work performed within this facility, U.S. citizenship is required.

Join us. The world can’t wait.

You Have:

• 5+ years of experiencein enterprise observability, monitoring, and site reliability engineering

• Experiencearchitecting and operating Dynatracefor full-stack observability, including agent deployment, distributed tracing, log management, synthetic monitoring, and digital experiencemonitoring

• Experienceimplementing AIOps workflows, including predictive alerting, anomaly detection, automated remediation, and incident automation

• Experiencebuilding observability integrations, custom extensions, and infrastructure-as-code using Python, JavaScript, Node.js, and Terraform

• Experiencebuilding operational and executive dashboards and implementing SLOs and SLAs

• Experienceworking in Agile environments with sprint-based delivery

• Knowledge ofnetwork monitoring protocols, including SNMP, SNMP traps, NetFlow, and Syslog

• Ability tomentor engineers, conduct code reviews, and take accountability for technical delivery and quality

• Bachelor's degree

Nice If You Have:

• Experiencewith ServiceNow Event Management, including event rules, alert management rules, alert correlation, threshold tuning, noise reduction, CMDB integration with CI relationships and dependencies, ITOM alignment, automated incident creation, Flow Designer, IntegrationHub, JavaScript, Glide API, HTML or CSS, ServiceNow platform architecture, and developing standardized onboarding processes for integrating new monitoring tools into Event Management with governance, segregation of duties, and compliance documentation

• Experiencewith advanced Dynatraceplatform capabilities, including Grail, Smartscape, Davis AI, OpenPipeline, DQL, Workflow Automation, Platform API, AppSec, Session Replay, Grail-powered RUM, AI Observability, and Grail log management

• Experiencewith DynatraceIntelligence, including DynatraceAssist, Intelligence Agents, MCP Server integration, and DynatraceApps development using the App Toolkit

• Experiencedeploying and building observability platforms from scratch in government cloud environments such as AWS GovCloud, Azure Government, or IL4/IL5, including air-gapped, restricted network, and STIG-hardened deployments

• Experiencebuilding self-service onboarding portals for application team observability adoption

• Experiencewith open-source observability tooling, including OpenTelemetry, Prometheus, Grafana, and ELK/EFK

• Experiencewith FinOps practices, containerization, and cloud platforms such as AWS, Azure, or GCP

• Experienceoperating Splunk and Splunk Enterprise Security (SIEM), Cribl, and SolarWinds at enterprise scale

• DynatraceProfessional or Master Certificationor ServiceNow Certified Implementation Specialist - Event Management (CIS-EM)Certification

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Identity Statement

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Candidate AI Usage Policy

AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.

Work Model

Our people-first culture prioritizes the benefits of collaboration, whether it occurs in person or virtually. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.

• Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.

• Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility.

• Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.