Sr. Observability Engineer – Integration Layer & OpenTelemetry (OTEL)

This role is part of the integration modernization program, focused on building a next-generation observability platform while migrating WebMethods integrations to AWS. The engineer will design and implement the telemetry and instrumentation layer using OpenTelemetry (OTEL), enabling unified collection of metrics, logs, and traces across APIs, messaging, MFT, and SAP integrations.

The role focuses on ensuring end-to-end observability across ~1,300+ integrations, supporting distributed tracing, correlation, and deep system visibility. It works closely with platform, integration, and monitoring teams to ensure telemetry data is correctly generated, propagated, and consumed by downstream tools such as Prometheus, Grafana, CloudWatch, and X-Ray

Telemetry & Instrumentation Design

• Design and implement OpenTelemetry (OTEL) instrumentation across integration components
• Enable telemetry collection (metrics, logs, traces) across APIs, messaging, batch, and MFT flows
• Define instrumentation standards and patterns for AWS-native integration services

Distributed Tracing & Correlation

• Implement end-to-end distributed tracing across integration flows
• Enable trace propagation and correlation IDs across systems
• Ensure seamless traceability across services like API Gateway, EKS, Lambda, EventBridge, and SQS

Integration Layer Observability

• Instrument integration runtimes for observability data generation
• Ensure visibility into transaction flows, payload movement, and service dependencies
• Support implementation of structured telemetry data for downstream analytics

Platform Integration

• Integrate OTEL outputs with other tools
• Ensure compatibility with AWS-native observability stack and pipelines

Reliability & Troubleshooting Enablement

• Enable observability capabilities to support root cause analysis and troubleshooting
• Provide telemetry insights for performance bottlenecks and system failures

Required Skills & Competencies

• Strong experience with OpenTelemetry (OTEL) instrumentation
• Solid understanding of distributed systems and tracing concepts
• Experience with AWS services (Lambda, API Gateway, EKS, EventBridge, SQS)
• Good knowledge of metrics, logging, and tracing pipelines
• Strong understanding of microservices and event-driven architectures
• Excellent troubleshooting and analytical skills

Good to Have

• Experience with Prometheus, Grafana, and CloudWatch integration
• Knowledge of AWS X-Ray and tracing frameworks
• Familiarity with Spring Boot / Camel-based services instrumentation

Qualifications

• Bachelor’s degree in Engineering or related field
• 8-12 years of experience