{"id":4213139,"url":"https://alion.io/job/keysight-rd-engineer-3-software-5","title":"R&D Engineer 3, Software","company":{"id":53596,"name":"Keysight","domain":"keysight.com","url":"https://alion.io/company/keysight","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Jibe","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gurgaon, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Bash","optional":false},{"name":"Function Calling","optional":false},{"name":"Grafana","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Hyper-V","optional":false},{"name":"Incident Management","optional":false},{"name":"Kubernetes","optional":false},{"name":"KVM","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"PowerShell","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Splunk","optional":false},{"name":"VMWare","optional":false},{"name":"Windows","optional":false},{"name":"Zabbix","optional":false},{"name":"Alertmanager","optional":true},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"GCP","optional":true}],"status":"live","first_seen_at":"2026-11-13T01:35:00Z","employer_posted_date":null,"last_verified_at":"2026-11-13T01:35:00Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"We are looking for a Senior Observability Engineer to design, build, and continuously improve monitoring and observability for our enterprise environment. Most of the work focuses on on-premises systems: physical servers, virtualized infrastructure, and on-prem Kubernetes clusters, along with the infrastructure layers underneath them. Some cloud use cases are also in scope. Your goal is to give system owners and business stakeholders an accurate, actionable view of the health and uptime of the systems they depend on.\n\nYou will also help shape how we apply agentic AI to observability, moving from dashboards and alerts toward intelligent triage, correlation, and assisted remediation.\n\nResponsibilities:\nDesign end-to-end monitoring and observability solutions for enterprise applications running on VMs, Kubernetes, and bare-metal servers, and extend them to cloud workloads where needed.\nDefine a layered monitoring strategy that covers hardware, OS, virtualization, network, storage, platform services, and applications.\nSet standards for metrics, logs, alerting, dashboards, and service health models, including SLIs and SLOs where they apply.\nMake sound architectural decisions on tool roles, data flows, retention, scalability, and high availability across the observability stack.\nDefine alert escalation policies, incident response workflows, and event correlation strategies to reduce operational noise and improve service reliability.\nDesign service topology, dependency mapping, and business service monitoring across infrastructure and application layers.\nSecure observability platforms and integrations through access controls, authentication, encryption, and vulnerability remediation. Maintain compliance with enterprise security standards through platform hardening, audit readiness, and regular security reviews.\nBuild and maintain monitoring with Zabbix, covering templates, discovery, triggers, proxies, and integrations.\nDesign and maintain log collection, parsing, enrichment, and routing pipelines into Splunk, including forwarders, sourcetypes, field extractions, indexes, and searches.\nContribute to metrics and visualization with Prometheus and Grafana, particularly for Kubernetes workloads and unified dashboards.\nAutomate the configuration and onboarding of monitoring using infrastructure-as-code and APIs.\nDesign and implement AI agents that support observability workflows. Examples include alert triage and deduplication, cross-source event correlation, root-cause hypotheses, incident summarization, and runbook-driven remediation with human-in-the-loop approval.\nIntegrate LLM-based agents with monitoring and logging platforms through APIs and tool protocols such as MCP.\nDefine guardrails, permission boundaries, and auditability for AI-driven actions on production systems.\nMeasure the real impact of these agents on operations, for example on MTTD, MTTR, alert noise, and on-call load.\nWork closely with system owners to understand architecture, failure modes, and dependencies, and to translate them into meaningful monitoring.\nPartner with consumers and stakeholders of those systems to define what \"healthy\" and \"available\" mean to them, and to make sure observability gives them the visibility they need.\nProvide technical leadership and mentoring, and run knowledge sharing across operations, infrastructure, and development teams.\nRegularly review alert quality, coverage gaps, and signal-to-noise ratio, and tune or retire monitoring accordingly.\nUse incidents and post-mortems as input to improve detection and response.\nTrack the evolution of the observability toolset and the wider technology landscape.\n\nQualifications:\n\nRequired:\n7+ years in infrastructure, operations, or observability engineering, with at least 3 years focused on monitoring and observability, primarily in on-premises enterprise environments.\nHands-on, production-level experience with Zabbix and Splunk.\nProven experience monitoring physical servers, virtualization platforms (e.g., VMware, Hyper-V, KVM), and Kubernetes clusters.\nStrong understanding of infrastructure layers: compute, OS (Linux and Windows), networking, storage, and the dependencies between them.\nSolid experience with log collection and processing at scale: parsing, normalization, enrichment, retention, and search optimization.\nPractical experience applying agentic AI (LLM agents, tool use, automation) to monitoring, operations, or incident management, along with a working understanding of how these systems behave and where their risks lie.\nExperience designing monitoring architecture, not only operating existing tools.\nExperience defining alert escalation policies, incident response workflows, and event correlation strategies to reduce operational noise and improve service reliability.\nExperience designing service topology, dependency mapping, and business service monitoring across infrastructure and application layers.\nWorking knowledge of securing observability platforms, including access control, authentication, encryption, and hardening.\nStrong scripting skills (e.g., Python, Bash, PowerShell) and comfort working with REST APIs.\nExcellent communication skills and the ability to work with both technical owners and non-technical stakeholders.\n\nNice to Have:\nExperience with Prometheus (exporters, alerting rules, Alert manager, long-term storage).\nExperience with Grafana (dashboard design, multi-source visualization, alerting).\nExperience monitoring cloud workloads (AWS, Azure, or GCP) and hybrid environments.\nSoftware development experience, such as building integrations, tools, exporters, or services.\nSkills\nKubernetes, Splunk, Zabbix","description_format":"text","description_chars":5663,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["EDA Software","Simulation & Digital Twin Software","Test & Measurement Instruments"],"lifecycle":[{"event":"open","at":"2026-11-13T01:35:00Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":44,"reasons":["seen:0","win:early"],"computed_at":"2026-11-13T03:11:42Z"},"pay":null,"html_url":"https://alion.io/job/keysight-rd-engineer-3-software-5","json_url":"https://alion.io/job/keysight-rd-engineer-3-software-5.json","meta":{"generated_at":"2026-11-13T03:11:42Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6727,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":53596},"rest":"https://alion.io/mcp/rest/get_company?id=53596"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fkeysight-rd-engineer-3-software-5"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fkeysight-rd-engineer-3-software-5"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fkeysight-rd-engineer-3-software-5"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/keysight-rd-engineer-3-software-5\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fkeysight-rd-engineer-3-software-5"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4213139}},{"tool":"search_jobs","arguments":{"company":"keysight.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4213139},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}