Founding Product Lead — ModelVault

ModelVault is building the world’s first plug-and-play on-premise AI server — a fully-integrated appliance that ships with containerized LLMs, vision models, developer tools, and remote management built in. Designed for businesses that need local, secure, cloud-independent AI, ModelVault brings AI infrastructure in-house — without the complexity.

We’re looking for a founder-type Product Lead to drive the development of our v1 hardware + software platform. You’ll work side-by-side with the founding team to take the product from zero to pilot deployments — owning strategy, execution, and market feedback.

This is not just a product management job — it’s an opportunity to define a new category and build a company from the inside out.

• Shape the product vision for our first integrated AI appliance — what it does, who it’s for, how it works

• Define the v1 scope — which models to include, how to prioritize use cases, what UX + developer tools to build

• Work closely with engineering to ship local model serving, fine-tuning workflows, remote update systems, and UI/CLI interfaces

• Run product discovery with dev teams, research groups, and IT buyers to validate demand and refine positioning

• Lead roadmap planning, customer pilots, pricing tests, and go-to-market experiments

• Coordinate hardware + software integration with a focus on reliability, simplicity, and speed

• Build the early systems that support scale — remote diagnostics, patching pipelines, customer feedback loops

• Represent product thinking in every key decision — balancing technical feasibility with user impact and long-term leverage

• Have 4–10 years of experience in product, engineering, or technical founding — ideally in devtools, infra, AI/ML, or embedded systems

• Are fluent in technical product development: can work directly with engineers, understand system design tradeoffs, and write detailed specs

• Have a bias for action and clarity — can move from vision to build to feedback quickly

• Have worked on zero-to-one hardware/software products or deeply technical stacks

• Think like a founder: prioritize ruthlessly, care about customers, and see constraints as a feature

• Want to shape not just a product, but a category and a company

• Experience with containerized model stacks (e.g., vLLM, Ollama, Triton, Hugging Face)

• Past work on embedded systems, edge computing, or AI appliances

• Familiarity with RAG pipelines, inference optimization, or open-source LLM infra

• Experience launching pilot programs or selling to technical B2B customers

• Background in dev-rel, solution engineering, or technical community engagement

• Shape a foundational AI product that redefines how and where models run

• Build at the intersection of AI, systems design, and product simplicity

• Fully remote, async-friendly, and deeply product-focused founding culture

• High-trust environment, with full ownership of the roadmap and strategy

Originally posted on Himalayas