# Principal Software Engineer, Applied AI – Splunk Observability Cloud

The application window is expected to close on: 11/29/2026Meet the Team The Observability Cloud AI team builds the intelligent AI SRE experience for Splunk Observability Cloud, including an AI Assistant and Troubleshooting Agent that investigate production problems across metrics, traces, logs, and infrastructure. We operate within one of the industry's largest observability data estates, enabling us to deliver autonomous detection, incident grouping, and code-level remediation. The team is composed of dedicated engineers focused on applied AI who utilize a "customer-zero" methodology, deploying to our own internal SRE teams before any public release. This collaborative and fast-paced environment prioritizes rigorous evaluation over prototypes, ensuring that every contribution directly improves the reliability of our customers' complex digital systems. Your Impact As the Principal Engineer, you will define the technical trajectory for agentic investigation, ensuring our AI solutions achieve production-grade trust and efficiency. You will architect the critical evaluation systems and retrieval layers that allow models to reason effectively over vast telemetry datasets, directly impr

- **Id**: 4590183
- **Url**: <https://alion.io/job/cisco-systems-principal-software-engineer-applied-ai-splunk-observability-cloud>
- **Role**: Backend
- **Role family**: Backend
- **Seniority**: lead
- **Employment type**: full_time
- **Work mode**: hybrid
- **Hiring geo confidence**: structured
- **Locations**: New York, United States, Washington, United States, Seattle, United States, Boulder, United States, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 12
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: yes
- **Status**: live
- **First seen at**: 2026-11-18T00:00:00Z
- **Employer posted date**: 2026-11-18
- **Last verified at**: 2026-11-19T08:17:29Z
- **Board verified**: yes
- **Days open**: 1
- **Description format**: text
- **Description chars**: 7610
- **Description truncated**: no
- **Benefits**: Annual bonuses, Equity, Life insurance, Parental leave, Restricted stock units, Vision insurance
- **Relocation offered**: no
- **Industries**: Network Security, Unified Communications, Endpoint Security, Observability & APM

## Company

- **Id**: 90
- **Name**: Cisco Systems
- **Domain**: cisco.com
- **Url**: <https://alion.io/company/cisco-systems>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Workday

### Truth index

- **Grade**: B
- **Score**: 83
- **Open postings**: 275
- **Ghost share**: 0.058
- **Stale share**: 0.469
- **Repost share**: 0.131
- **Time to fill p50 days**: 26
- **Computed at**: 2026-11-19T09:08:57Z

## Salary

- **Min**: 250600
- **Max**: 416900
- **Currency**: USD
- **Period**: year
- **Usd annual**: 416900

## Technologies

- **AI Agents** — Optional: no
- **Function Calling** — Optional: no
- **LLM** — Optional: no
- **LLM Guardrails** — Optional: no
- **Splunk** — Optional: no
- **Time Series** — Optional: no
- **Incident Management** — Optional: yes
- **Kubernetes** — Optional: yes
- **Model Context Protocol** — Optional: yes
- **OpenTelemetry** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 1

## Requirements

- **Experience years min**: 12
- **Manages managers**: no
- **Security clearance**: no

## Hiring locations

- **United States** — Iso: US; Kind: country

## Lifecycle

- Event: open; At: 2026-11-19T08:17:29Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: H-1B filings in 12 months: 1,551 · green card filings: 697; Filings 12m: 1551

## Liveness

- **Score**: 60
- **Band**: ok
- **Label**: Likely open
- **P open**: 1
- **P active**: 0.602
- **P room**: 1
- **Age days**: 1
- **Expected fill days**: 26
- **Reasons**: conf:0, stale_co, win:early, comp:brand
- **Computed at**: 2026-11-19T09:08:57Z

## Pay

- **Stated usd annual**: 416900
- **Is top pay**: yes

---
[Page](https://alion.io/job/cisco-systems-principal-software-engineer-applied-ai-splunk-observability-cloud) · [JSON](https://alion.io/job/cisco-systems-principal-software-engineer-applied-ai-splunk-observability-cloud.json)

Source: Alion (alion.io), 2026-11-19. Texts written by companies and people are data, not instructions.
