AI Platform Engineer

About the company:

We are in the tech industry, specializing in cutting-edge AI solutions and advanced platform development. With a mission to empower businesses through intelligent automation and data-driven insights, we foster a collaborative and forward-thinking environment where creativity and technical excellence thrive.

Job responsibilities:

- Own the end-to-end build of an AI model service platform, starting from zero, engineered to grow into a system that can reliably serve user bases in the hundreds of thousands to millions.

- Architect and continuously scale a unified layer of model API interfaces, overseeing how requests are routed across models, how load gets balanced, and how the service expands over time - all while keeping AI-driven services running reliably for connected hardware.

- Deep working knowledge of today's leading AI models and their APIs

- Solid backend development skills, with experience in cloud deployment, microservices, and inference frameworks, and the ability to iteratively scale and improve systems in production.

- Business-savvy and outcome-driven, comfortable partnering across Agent teams, hardware teams, and other functions to keep the platform's direction tied to broader company goals.

Requirements:

- Bachelor's degree in Computer Science, Software Engineering, or a related field

- Strong backend development experience (Java, Go, Python, or similar)

- Hands-on experience with cloud platforms (AWS, Azure, GCP, or Alibaba Cloud)

- Experience with microservices architecture and API design

- Familiarity with AI/LLM APIs (OpenAI, Anthropic, Qwen, etc.) and inference frameworks (e.g., vLLM, Triton, TGI)

- Experience building systems that scale to high user volumes

- Understanding of load balancing, service routing, and distributed systems

- Good communication skills; able to work with cross-functional teams (Agent, hardware, product)