Staff Software Development Engineer
First seen by Alion on Aug 4, 2026.
We are looking for a Staff Software Development Engineer who is passionate about delivering high-quality, customer-centric solutions and ensuring operational excellence across production systems. In this role, you will drive runbook-based operational processes, investigate and validate production issues, identify process improvements and edge cases, and implement targeted enhancements such as code fixes, data corrections, and internal tooling improvements. You will work closely with Customer Experience, Product, and Engineering teams to streamline workflows, improve system reliability, and maintain accurate, consistent customer-facing operations in a collaborative, feedback-driven environment.
Key Responsibilities:
- Production Incident Support (70%): Working closely with the Head of Customer Support to investigate, troubleshoot, and resolve production incidents impacting customers, including the runbook-based CX support and bug investigation work detailed below.
- API / Microservice Development (30%): Building and enhancing backend systems, including designing and shipping APIs and microservices that connect financial institutions, payment processors, and data platforms.
What your Day will look like:
- Provide runbook-based Customer Experience (CX) support by resolving production issues and operational workflows.
- Investigate and troubleshoot advance failures, repayment issues, account deletion requests, and user confirmations.
- Collaborate with CX and Engineering teams to ensure timely resolution of customer-impacting issues.
- Validate and reproduce reported bugs, identify root causes, and group related issues for efficient resolution.
- Provide clear, actionable bug reports and investigation findings to support Engineering teams.
- Enhance internal tools and reporting by improving visibility features and resolving data accuracy and user experience issues.
- Generate reports, user metrics, and perform data operations including PII cleanup, targeted data fixes, and mass user management tasks.
Required Qualifications:
- 8+ years of experience in Software Engineering, Quality Engineering, SDET, or Technical Operations supporting production systems.
- Strong expertise in operational quality, customer-impacting workflows, and regulated/financial environments, ensuring accuracy and reliability.
- Experience executing and improving runbook-driven processes, investigating production issues, reproducing defects, validating fixes, and identifying documentation gaps.
- Hands-on experience with logs, metrics, service observability, and making small system improvements such as test fixes, configuration updates, data corrections, or internal tooling enhancements.
- Excellent collaboration skills to work with Customer Experience, Product, and Engineering teams to resolve issues, reduce defect noise, and improve feedback loops.
Technical Key Skills:
- Programming: Experience writing production-quality code in Node.js (JavaScript/TypeScript), Rust, or similar languages.
- Database: Strong experience with advanced queries in MySQL, PostgreSQL, SpannerDB, or similar databases for data investigation.
- Architecture: 4-5 years of experience with Microservices, Event-driven Architecture, or a combination of 2 years Microservices + 2 years API development.
- API Development: Experience building and maintaining GraphQL, gRPC, and REST APIs.
- Infrastructure: Working knowledge of GCP/AWS, Docker, Terraform, Kubernetes, Kafka, S3/GCS Buckets, Artifactory, and BigQuery/Data Lake.
- APM & Monitoring: Experience with Grafana, Prometheus, New Relic, Kibana, Datadog, or similar monitoring/logging tools.
- BI Tools: Experience using Looker, Tableau, or similar Business Intelligence tools.
Skills
API, Production Support, Microservices Architecture, Node.js, Python, MySQL, APM, Monitoring Tools