Backend Engineer

Responsibilities:

• Performance: Maintain < 200ms P95 latency for all user-critical operations at 10x current scale.
• Incident Reduction: Implement monitoring and automation that reduces production incidents by 80%.
• Team Enablement: Create platform abstractions that let product teams ship features 3x faster.
• Design and implement asynchronous multi-agent orchestration.
• Own end-to-end latency from user message to AI response.
• Build resilient inference pipelines that gracefully degrade under load.
• Implement intelligent request routing and load balancing for AI workloads.
• Migrate critical AI conversation flow from monolith to dedicated services.
• Implement WebSocket/streaming infrastructure for real-time chat.
• Design circuit breakers and fallback strategies for AI model failures.
• Build comprehensive observability for AI system performance.
• Optimize credit data retrieval and caching strategies.

Requirements:

• 2+ years building and scaling distributed systems, handling > 5K concurrent requests in production.
• Hands-on experience with microservices decomposition from monolithic architectures under live traffic.
• Production experience with service mesh technologies and container orchestration at scale.
• Deep understanding of database sharding, replication, and distributed transaction management.
• Hands-on experience with CDN optimization and edge computing for global/multi-region deployments.
• Proven ability to optimize systems, achieving < 100ms P99 latency for critical user-facing operations.