MLOps Engineer

We are seeking a Senior MLOps / LLM Infrastructure Engineer to drive the deployment, distributed training, and infrastructure optimization of large-scale machine learning models. In this role, you will bridge the gap between AI development and production systems, ensuring high GPU utilization, scalable performance, cost efficiency, and cloud-agnostic architectures for models up to 20B parameters.

Responsibilities:

• Deploy and manage ML/LLM models (< 20B parameters) in production environments.
• Design and execute model load testing and performance benchmarking (latency, throughput, memory, cost).
• Build and optimize multi-node, multi-GPU training pipelines.
• Configure and tune distributed training frameworks (data parallelism, model parallelism, and pipeline parallelism).
• Optimize GPU utilization, memory footprint, and inference costs.
• Set up CI/CD pipelines for model deployment and retraining.
• Troubleshoot GPU, networking, and performance bottlenecks.
• Work across cloud platforms to ensure portability and vendor-agnostic deployments.

Requirements:

• Strong experience with GPU workloads (NVIDIA GPUs, CUDA concepts).
• Proven expertise in model deployment on AWS, Azure, and GCP.
• Hands-on experience deploying models up to 20B parameters.
• Experience with distributed training (multi-node, multi-GPU setups).
• Deep understanding of load testing, stress testing, and benchmarking ML systems.