{"id":162150,"url":"https://alion.io/job/earlywarning-staff-software-engineer-aiops","title":"Staff Software Engineer - AIOps","company":{"id":46312,"name":"Early Warning Services","domain":"earlywarning.com","url":"https://alion.io/company/earlywarning","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":84,"open_postings":11,"ghost_share":0,"stale_share":0.636,"repost_share":0,"time_to_fill_p50_days":29,"computed_at":"2026-10-19T05:45:15Z"}},"role":"Backend","role_family":"Backend","seniority":"staff","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Scottsdale, United States","Chicago, United States","San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":124000,"max":165000,"currency":"USD","period":"year","gross":null,"usd_annual":165000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AIOps","optional":false},{"name":"Angular","optional":false},{"name":"Apache Kafka","optional":false},{"name":"CI/CD","optional":false},{"name":"Grafana","optional":false},{"name":"ITSM","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Next.js","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"RabbitMQ","optional":false},{"name":"React.js","optional":false},{"name":"Tool Use","optional":false},{"name":"TypeScript","optional":false},{"name":"Anomaly Detection","optional":true},{"name":"AWS","optional":true},{"name":"Chaos Engineering","optional":true},{"name":"Go","optional":true},{"name":"JavaScript","optional":true},{"name":"LangChain","optional":true},{"name":"LangGraph","optional":true},{"name":"PCI DSS","optional":true},{"name":"Time Series Forecasting","optional":true}],"status":"live","first_seen_at":"2026-08-27T00:00:00Z","employer_posted_date":"2026-09-02","last_verified_at":"2026-10-18T07:47:51Z","board_verified":true,"closed_at":null,"days_open":53,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":53},"description":"At Early Warning, we’ve powered and protected the U.S. financial system for over thirty years with cutting-edge solutions like Zelle®, Paze℠, and so much more. As a trusted name in payments, we partner with thousands of institutions to increase access to financial services and protect transactions for hundreds of millions of consumers and small businesses.\nPositions located in Scottsdale, San Francisco, Chicago, or New York follow a hybrid work model to allow for a more collaborative working environment.\nCandidates responding to this posting must independently possess the eligibility to work in the United States, for any employer, at the date of hire. This position is ineligible for employment Visa sponsorship.\nStaff Software Engineer - AIOps\nOverall Purpose\nThe Staff Software Engineer - AIOps is a senior hands-on technical contributor responsible for designing, building, and operating the AIOps agent platform that enables AI agents to observe events across Early Warning technology environments, generate diagnoses and recommendations, and execute approved actions within defined safety controls. The role focuses on the software systems, control loop, tool interfaces, telemetry, evaluation capabilities, and operator experience required to run agentic capabilities safely and reliably in production; it is not primarily a model development or research role.\nThis position executes complex technical work with general direction, independently makes implementation decisions within established architecture and standards, and may seek guidance for novel, highly ambiguous, or cross-enterprise decisions. The Staff Engineer applies software engineering, distributed systems, and platform engineering principles and partners across Engineering, Technology Operations, Security, Risk and Compliance, and other technology teams to establish reusable patterns and guardrails for progressive levels of automation.\nEssential Functions\nApply mature software engineering practices across the agent runtime, tool layer, APIs, and operator experience, including versioned interfaces, automated testing, code review, release management, observability, and regression coverage.\nExecute complex AIOps engineering assignments with general direction; break work into deliverable components, identify practical implementation solutions, raise risks and dependencies, and seek guidance when decisions extend beyond established architecture or standards.\nContribute to the design and evolution of the agent platform architecture; maintain architecture decision records, define interface standards, and evaluate significant design and build-versus-buy tradeoffs with appropriate technical guidance.\nDesign, build, test, and operate the core agent runtime, including event ingestion, context assembly, planning, tool invocation, verification, escalation, and response handling.\nDesign and maintain scoped, typed, and auditable tool interfaces that enable agents to interact with CI/CD platforms, infrastructure automation, Kubernetes, network services, ITSM platforms, observability systems, and secrets management solutions.\nDefine and implement controls for agent actions, including read-only and advisory capabilities, human approval requirements, narrowly scoped unattended actions, permission boundaries, blast-radius limits, dry-run capabilities, reversibility, and emergency shutdown controls.\nDefine tool contracts, versioning standards, testing requirements, and intended behavior so agent-accessible capabilities are managed as reliable production interfaces.\nBuild event-routing capabilities that receive and prioritize alerts, pipeline failures, tickets, operational requests, and other technology events and provide appropriate context to the agent runtime.\nEstablish telemetry capabilities used by the agent, including logs, metrics, and traces from relevant technology platforms, and contribute to standards for telemetry quality and schema evolution.\nDesign and operate model routing, session and state management, retries, timeouts, and cost and latency controls appropriate for a production service.\nImplement comprehensive auditability for events received, decisions generated, approvals obtained, and actions executed to support operational, risk, compliance, and examination requirements.\nDevelop evaluation capabilities for agent decision quality, including historical incident replay, controlled or shadow-mode evaluation, measurement of proposed actions, and regression testing.\nBuild feedback mechanisms that incorporate human approvals, overrides, and operational outcomes into measurable improvements to platform quality.\nPackage reusable agent capabilities, tool integrations, APIs, documentation, and implementation patterns so other technology teams can extend and adopt the platform through defined self-service practices.\nDevelop and maintain the operator experience, including approval workflows, agent activity and decision history, telemetry views, and APIs that expose agent state to user interfaces and other systems.\nPartner with Engineering, Technology Operations, Architecture, Security, Risk, and Compliance stakeholders to evaluate technical tradeoffs and ensure solutions meet reliability, security, operational, and regulatory requirements.\nDefine and monitor measures of platform effectiveness, including recommendation quality, approval and override rates, action success, rollback frequency, latency, cost, adoption, and operational outcomes.\nSupport the company's commitment to risk management and protecting the integrity and confidentiality of systems and data.\nMinimum Qualifications\nEducation and/or experience typically obtained through a bachelor's degree in computer science, engineering, or a related technical field.\nTypically eight or more years of related experience in software engineering, platform engineering, distributed systems, DevOps, AIOps, or a related technical discipline.\nDemonstrated strength in software engineering and distributed-systems design, including the ability to turn ambiguous technical problems into maintainable, testable solutions and reason about interfaces, state, retries, timeouts, idempotency, failure modes, and operational risk.\nDemonstrated ability to execute complex technical work with general direction, independently make implementation decisions within established architecture and standards, and recognize when guidance or escalation is needed for novel or enterprise-wide decisions.\nDemonstrated customer-first approach, balancing internal customer and operator needs with safety, security, reliability, explain ability, and control requirements.\nAbility to respectfully challenge assumptions with data and technical reasoning, then disagree and commit by supporting and executing the final decision.\nStrong production development experience with Python, including services, APIs, automation, orchestration systems, or agent runtimes.\nHands-on experience developing production agentic systems, tool-using AI applications, or autonomous or semi-autonomous software control loops beyond proof-of-concept implementations.\nExperience designing tool-use or function-calling interfaces for AI agents using MCP or comparable integration patterns.\nExperience implementing production controls for AI or automated systems, including evaluation, guardrails, monitoring, cost and latency management, and management of unintended or failed actions.\nExperience with event-driven architectures and messaging technologies such as Kafka, Pub/Sub, RabbitMQ, or comparable platforms.\nExperience with production observability practices, including structured logging, metrics, distributed tracing, and technologies such as OpenTelemetry, Prometheus, or Grafana.\nExperience developing front-end solutions using modern frameworks such as React, Next.js, or Angular, along with backend or API development using TypeScript or Python.\nDemonstrated ability to work effectively in an environment requiring strong controls, explain ability, approval processes, and auditability for automated actions.\nDemonstrated ability to lead complex technical work, collaborate across engineering and operations disciplines, and influence implementation decisions without direct authority.\nStrong written and verbal communication skills, including technical documentation, architecture decision records, implementation standards, and control documentation.\nBackground and drug screen.\nPreferred Qualifications\nExperience with agent orchestration frameworks such as LangGraph or experience developing comparable orchestration capabilities directly.\nGo development experience.\nExperience with CI/CD platforms, infrastructure automation, Kubernetes operations, ITSM platforms, or technology operations.\nExperience leading a complex AIOps or agent-platform capability from design through production implementation with periodic architectural or stakeholder guidance.\nExperience with anomaly detection, time-series analysis, or related machine-learning applications.\nExperience with chaos engineering, simulation, historical incident replay, or game-day testing for distributed or automated systems.\nExperience mapping automated-system controls to regulatory or control frameworks such as PCI DSS, SOX ITGC, NYDFS Part 500, or FFIEC guidance.\nExperience in FinTech, banking, payments, or another highly regulated industry.\nCurrent AWS, Kubernetes, AI engineering, security, or other relevant technical certification.\nPhysical Requirements\nWorking conditions consist of a normal office environment. Work is primarily sedentary and requires extensive use of a computer and involves sitting for periods of approximately four hours. Work may require occasional standing, walking, kneeling and reaching. Must be able to lift 10 pounds occasionally and/or negligible amount of force frequently. Requires visual acuity and dexterity to view, prepare, and manipulate documents and office equipment including personal computers. Requires the ability to communicate with internal and/or external customers.\nEmployee must be able to perform essential functions and physical requirements of position with or without reasonable accommodation.\nCandidates responding to this posting must independently possess the eligibility to work in the United States at the date of hire.\nThe above job description is not intended to be an all-inclusive list of duties and standards of the position.\nThe base pay scale for this position in:\nPhoenix, AZ/ Chicago, IL in USD per year is: $124,000 - $165,000.\nSan Francisco, CA in USD per year is: $149,000 - $198,000.\nAdditionally, candidates are eligible for a discretionary incentive plan and benefits.\nThis pay scale is subject to change and is not necessarily reflective of actual compensation that may be earned, nor a promise of any specific pay for any specific candidate, which is always dependent on legitimate factors considered at the time of job offer. Early Warning Services takes into consideration a variety of factors when determining a competitive salary offer, including, but not limited to, the job scope, market rates and geographic location of a position, candidate’s education, experience, training, and specialized skills or certification(s) in relation to the job requirements and compared with internal equity (peers). The business actively supports and reviews wage equity to ensure that pay decisions are not based on gender, race, national origin, or any other protected classes.\nSome of the Ways We Prioritize Your Health and Happiness\nHealthcare Coverage - Competitive medical (PPO/HDHP), dental, and vision plans as well as company contributions to your Health Savings Account (HSA) or pre-tax savings through flexible spending accounts (FSA) for commuting, health & dependent care expenses.\n\n401(k) Retirement Plan - Featuring a 100% Company Safe Harbor Match on your first 6% deferral immediately upon eligibility.\n\nPaid Time Off - Flexible Time Off for Exempt (salaried) employees, as well as ge...","description_format":"text","description_chars":13448,"description_truncated":true,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity","Flexible time off","Hybrid work","Parental leave","Retirement plans"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Fraud Detection","Payment Processing & Gateways","RegTech, AML & Compliance"],"lifecycle":[{"event":"open","at":"2026-08-27T00:00:00Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 27 · green card filings: 21","filings_12m":27,"filings_prev_12m":57,"green_card_filings_12m":21,"median_offered_wage_usd":148125,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":21}],"liveness":{"score":24,"band":"cold","label":"Long shot","p_open":1,"p_active":0.527,"p_room":0.45,"age_days":53,"expected_fill_days":29,"reasons":["conf:21","stale_co","urgency","velocity","win:tail"],"computed_at":"2026-10-19T05:45:15Z"},"pay":{"stated_usd_annual":165000,"is_top_pay":false},"html_url":"https://alion.io/job/earlywarning-staff-software-engineer-aiops","json_url":"https://alion.io/job/earlywarning-staff-software-engineer-aiops.json","meta":{"generated_at":"2026-10-19T06:19:59Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3897,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":46312},"rest":"https://alion.io/mcp/rest/get_company?id=46312"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fearlywarning-staff-software-engineer-aiops"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fearlywarning-staff-software-engineer-aiops"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fearlywarning-staff-software-engineer-aiops"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/earlywarning-staff-software-engineer-aiops\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fearlywarning-staff-software-engineer-aiops"}]}