Python Infrastructure Engineer
First seen by Alion on Aug 11, 2026.
About the Role:
We are looking for an experienced Python Infrastructure Engineer / Backend Platform Engineer to design, develop, and enhance a new Device Boot Service. The service will manage server/device boot and provisioning requests through REST APIs, persist request and device data in a database, execute long-running boot/provisioning operations using asynchronous workers, and track each request through a state-machine-based workflow. The successful candidate will work closely with engineering and infrastructure teams to finalize the data model, API architecture, state-machine design, and migration strategy, and will be responsible for implementing reliable, scalable, and production-ready service components. The role requires strong backend engineering skills combined with an understanding of infrastructure, server provisioning, device management, and automation technologies.
Key Responsibilities:
- Design and develop production-grade backend services using Python.
- Design and implement RESTful APIs for device/server boot and provisioning workflows.
- Contribute to the design and finalization of:
1. Data models and database schemas
2. API contracts and endpoint design
3. State-machine workflows and state transitions
4. Database migration strategy
5. Background processing architecture
- Develop API endpoints, request/response models, serialization, validation, and error handling.
- Implement database models and migrations using appropriate Python ORM frameworks.
- Develop asynchronous/background processing using technologies such as Celery, RQ, Dramatiq, or equivalent.
- Implement reliable long-running workflows with:
1. Retry mechanisms
2. Idempotent task execution
3. Scheduled jobs
4. Failure handling and recovery
5. Concurrency-safe operations
- Design and implement state-machine-based workflows to track boot/provisioning request lifecycle.
- Integrate the service with internal boot, provisioning, BMC, and infrastructure management systems.
- Ensure safe and consistent state transitions in concurrent and distributed environments.
- Write comprehensive unit, integration, and API tests using pytest or equivalent frameworks.
- Implement application observability through:
1. Structured logging
2. Application and business metrics
3. Prometheus
4. Grafana
5. Health/readiness checks
6. Alerting and monitoring
- Troubleshoot production issues and improve system reliability, performance, and scalability.
- Participate in code reviews, architecture discussions, and technical design sessions.
- Prepare and maintain runbooks, technical documentation, API documentation, and operational procedures.
- Collaborate with DevOps, infrastructure, QA, and platform engineering teams to deliver production-ready solutions.
Required Technical Skills :
Python & Backend Development :
- 5 to 15 years of overall software development experience, with strong hands-on experience in production Python backend development.
- Strong proficiency in Python 3.x and object-oriented/programming fundamentals.
- Hands-on experience building production-grade backend services.
Skills
Python, Django, FastAPI, Flask, Backend Architecture, Backend Infrastructure