ML Engineer (Python) - REMOTE

We are seeking an ML Engineer specializing in Python to package, serve, and operate AI capabilities across our client's shared platform. Their customers rely on fast, defensible answers across massive volumes of unstructured text, documents, audio, and video for critical missions in defence, intelligence, and law enforcement.

In this role, you will bridge the gap between research and production-taking models out of notebooks and packaging them into versioned, production-ready artifacts served behind standardized APIs. You will own inference performance, cost, and output provenance across cloud, on-premise, and fully air-gapped environments.

Key Responsibilities

• Production Serving: Package models as immutable versioned artifacts, deploy them onto shared runtime infrastructures (e.g., Triton, vLLM), and expose them behind standards-compliant contracts.
• Benchmarking & Model Selection: Evaluate and select models using a centralized testing framework with reproducible runs, clear task metrics, and complete documentation.
• Performance & Cost Optimization: Manage inference latency, throughput, dynamic batching, quantization, and GPU placement to keep performance high and cost accountable.
• Observability & Operations: Instrument dashboards, trace request pipelines, monitor for quality/drift, and participate in on-call rotations for served capabilities.
• Constrained & Offline Delivery: Prepare ML pipelines and OCI artifacts for unattended execution in air-gapped customer environments with strict audit and provenance constraints.