Senior Specialist - AI Engineering

Roles &Responsibilities:

RCA Agent Development

Design develop and enhance the RCA agent using GenAIagentic AI patterns

Build prompts reasoning workflows toolfunction integrations and supporting APIs

Optimize agent accuracy reliability latency safety and cost

AD RCA Integration

Integrate the upstream AD workflow with the RCA agent through enterprise APIsservice layers

Implement data and workflow integration between the agent and dependent enterprise systems

Validate endtoend integration and errorhandling scenarios

Evaluation Framework

Build an automated evaluation frameworktest harness for the RCA solution

Define acceptance criteria and metrics covering accuracy factuality grounding safety latency and cost

Perform regression adversarial hallucination guardrail and failurepath testing

Use evaluation findings as release gates and inputs for system improvement

E2E Tuning Optimization

Analyze failures across the complete RCA pipeline and tune prompts context orchestration and inference behavior

Improve accuracy and production reliability based on evaluation results

Identify error propagation across multistep agent workflows through tracing and observability

AWS SageMaker Bedrock

Develop and operationalize agent workloads using Amazon Bedrock where applicable

Support model deployment optimization monitoring and lifecycle activities using SageMaker

Optimize prompts embeddings and inference performance

Establish monitoring for production performance and anomalies

Short version for JD RR

Key Responsibilities

Develop and enhance the RCA agent integrate ADtoRCA workflows build the GenAI evaluation framework perform endtoend testing and tuning optimize promptsmodel inference and support deployment monitoring and operationalization using AWS SageMaker and Amazon Bedrock