GGUF Jobs - Remote & On-site

GGUF jobs hiring now at vetted startups and product companies on Alion, updated daily. Average salary around $218,600/year. Compare remote, hybrid and on-site positions with relocation and visa sponsorship. Browse and apply today.

AI/ML
Data Science
Backend
Frontend
Mobile
DevOps
Web3
Games
Hardware
Robotics
Security
QA
Leadership
Networking
Product
Design
Analytics
Support
Solutions
Enterprise Apps
Quantum

Inypeople Technology

inypeople.com
inypeople.com • HQ: Chennai, India • IT Staffing & Staff Augmentation • Est. 2024 • Likely startup • Hiring 15
HQ: Chennai, India • IT Staffing & Staff Augmentation • Est. 2024 • Likely startup • Hiring 15
Inypeople Technology is an Indian IT staffing and consulting company that places SAP and quality assurance specialists with client organisations. Its postings cover SAP SD and PP consultants, senior test automation engineers and AI engineers in Chennai, Pune and Bengaluru. The company is headquartered in Chennai, India.
No named decision-maker yet.
Careers mailbox is known
2 months ago Long shot · 5%

AI Engineer - Generative AI/LLM

≈ $23k – $50k per year (Estimated) • Senior • 5+ years exp • In office (Bengaluru, India)
Python
Databases
Weaviate
pgvector
Pinecone
FAISS
Qdrant
PostgreSQL
AI/ML
LangGraph
AutoGen
Weights & Biases
LangChain
Airflow
LlamaIndex
LoRA
vLLM
MLFlow
Embeddings
RLHF
Quantization
Knowledge Distillation
Function Calling
AI Agents
NLP
AWQ
GGUF
GPTQ
PEFT
QLoRA
TGI
TRL
Accelerate
Kubeflow
Transformers
PyTorch
CrewAI
LLM
RAG
Tokenization
Reranking
Triton
Hugging Face
DPO
LLM Guardrails
Multi-Agent Systems
Model Distillation
Multimodal AI
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Cybersecurity
OWASP
Analytics
A/B Testing
+47
Apply
2 months ago Long shot · 5%

AI Engineer - Data Science

≈ $23k – $50k per year (Estimated) • Senior • 5+ years exp • In office (Bengaluru, India)
Python
Databases
Weaviate
pgvector
Pinecone
FAISS
Qdrant
PostgreSQL
AI/ML
LangGraph
AutoGen
Weights & Biases
LangChain
LlamaIndex
LoRA
vLLM
MLFlow
Embeddings
RLHF
Quantization
Knowledge Distillation
Function Calling
AI Agents
NLP
AWQ
GGUF
GPTQ
PEFT
QLoRA
TGI
TRL
Accelerate
Kubeflow
Transformers
PyTorch
CrewAI
LLM
RAG
Tokenization
Reranking
Triton
Hugging Face
DPO
LLM Guardrails
Multi-Agent Systems
Model Distillation
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Analytics
A/B Testing
+44
Apply

Versa Networks

versa-networks.com
versa-networks.com • HQ: Santa Clara, United States • Cloud Security • Enterprise Networks • Network Security • 501-1000 employees • Est. 2012 • Hiring 27
HQ: Santa Clara, United States • Cloud Security • Enterprise Networks • Network Security • 501-1000 employees • Est. 2012 • Hiring 27
Versa Networks is a networking and security software company that develops secure access service edge (SASE) and software-defined wide area network (SD-WAN) products. Its single-stack platform combines routing, firewall, secure web gateway and zero trust access functions and can run in the cloud or on premises, with multitenancy for service providers. It sells to enterprises, federal agencies and telecom carriers. The company is headquartered in Santa Clara, California, United States.
Lalit Kumar · Executive Officer · decision-maker
Kumar Mehta · Executive Officer, Director · decision-maker
Kelly Ahuja · Executive Officer, Director · decision-maker
Joaquin Torres · Director
Careers mailbox is known
Top 25% payVerified live · 5 hours ago Visa sponsor 3 months ago Long shot · 11%

Sr. Data Scientist

$225k – $300k per year • Senior • Santa Clara • Remote (United States) • Full-Time • Senior
Python
AI/ML
XGBoost
Quantization
NLP
GGUF
ONNX
Transformers
TensorFlow
Pandas
NumPy
PyTorch
LLM
Time Series Forecasting
Machine Learning
Spark
DevOps
GCP
Azure
AWS
Analytics
Seaborn
Matplotlib
+12
Apply
lg.com • HQ: Seoul, South Korea • Car Electronics • Smart Home Devices • Televisions • Home Appliances • 501-1000 employees • Est. 1958 • Trust B • Hiring 84, 3 new
HQ: Seoul, South Korea • Car Electronics • Smart Home Devices • Televisions • Home Appliances • 501-1000 employees • Est. 1958 • Trust B • Hiring 84, 3 new
LG Electronics is a South Korean consumer and commercial electronics manufacturer and the largest operating company of the LG group. Founded in 1958 as GoldStar, it makes televisions, home appliances such as refrigerators, washing machines and air conditioners, monitors, smart home devices and vehicle components including infotainment and electric powertrain systems. It runs factories and sales subsidiaries worldwide, with large US operations that include a washing machine plant in Clarksville, Tennessee. The company is headquartered in Seoul, South Korea.
Kwang-mo Koo · Chairman & Chief Executive Officer · decision-maker
In-hwoi Koo · Founder · founder
Tatyana Pavlova · HR
No careers mailbox known
Verified live · 2 hours ago 3 months ago Long shot · 11%

AI Researcher (Efficient AI)

≈ $131k – $286k per year (Estimated) • Hybrid (Santa Clara, United States) • Master's Degree • Contractor
Python
AI/ML
Quantization
Multimodal AI
AI Agents
VLM
Transformers
LLM
Mixture of Experts
Post-training
Edge AI
Speculative Decoding
KV Cache
Machine Learning
llama.cpp
LoRA
vLLM
Fine-tuning
Knowledge Distillation
SGLang
GGUF
TensorRT
PEFT
TensorRT-LLM
PyTorch
DPO
Multi-Agent Systems
Model Distillation
Analytics
ETL/ELT
Management
Freshdesk
+21
Apply

Tecnoprism Pvt Ltd

technoprism.com
technoprism.com • Bengaluru • Gurgaon • Hiring 6
Bengaluru • Gurgaon • Hiring 6
No named decision-maker yet.
No careers mailbox known
3 months ago Long shot · 5%

Senior Data Scientist - Generative AI

≈ $22k – $44k per year (Estimated) • Senior • 5+ years exp • In office (India) • Senior
Python
AI/ML
LangChain
Ray Serve
DeepSpeed
LlamaIndex
vLLM
Triton Inference Server
Fine-tuning
RLHF
Reinforcement Learning
Quantization
Knowledge Distillation
Diffusion Models
AWQ
BentoML
Diffusers
GGUF
GPTQ
TensorRT
PEFT
Accelerate
Transformers
TensorFlow
PyTorch
LLM
Perplexity
Hugging Face
Pre-training
ONNX Runtime
Model Distillation
Ray
DevOps
GCP
Azure
AWS
Docker
Kubernetes
+28
Apply

Lyceum Technology Germany GmbH

lyceum.technology
lyceum.technology • HQ: Berlin, Germany • LLM & Generative AI • Artificial Intelligence • AI Compute & Inference • Startup • Hiring 15
HQ: Berlin, Germany • LLM & Generative AI • Artificial Intelligence • AI Compute & Inference • Startup • Hiring 15
Lyceum is a GPU infrastructure platform for AI teams. Serverless inference, Docker execution, virtual machines, and large-scale clusters. Per-second billing, EU data centres.
Maximilian Niroomand · Managing Director · decision-maker
Magnus Hans Grünewald · Managing Director · decision-maker
Careers mailbox is known
Verified live · 1 hour ago 3 months ago Long shot · 15%

Member of Technical Staff – AI Inference platform, features

≈ $159k – $361k per year (Estimated) • Staff+ • 3+ years exp • In office (Zurich, Switzerland) • Full-Time • Staff
Python
Go
AI/ML
vLLM
TGI
GGUF
ONNX
Safetensors
Speculative Decoding
DevOps
Rest API
gRPC
Kubernetes
Platform Engineering
Cybersecurity
GDPR
+5
Apply

Nace.AI

nace.ai
nace.ai • HQ: Palo Alto, United States • Education AI • LLM & Generative AI • 51-200 employees • Startup • Trust D • Hiring 17
HQ: Palo Alto, United States • Education AI • LLM & Generative AI • 51-200 employees • Startup • Trust D • Hiring 17
Nace.AI was born from our collective experiences at Google, Meta, Amazon, and the University of Toronto. We build trustworthy AI systems that run companies.
No named decision-maker yet.
Careers mailbox is known
Likely inactiveVerified live · 2 hours ago Visa sponsor 3 months ago Long shot · 8%

Senior MLOps Engineer

≈ $167k – $317k per year (Estimated) • Senior • 5+ years exp • In office (Palo Alto, United States) • Bachelor's Degree • Full-Time • Senior
Python
AI/ML
Weights & Biases
vLLM
MLFlow
Quantization
Knowledge Distillation
SGLang
AWQ
GGUF
GPTQ
TGI
Kubeflow
LLM
Ray
KV Cache
Model Distillation
Spark
Fine-tuning
RLHF
DPO
DevOps
Terraform
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Platform Engineering
+20
Apply
Likely inactiveVerified live · 2 hours ago Visa sponsor 7 months ago Long shot · 5%

Machine Learning Engineer

≈ $172k – $327k per year (Estimated) • Senior • 5+ years exp • In office (Palo Alto, United States) • Bachelor's Degree • Full-Time • Senior
Python
AI/ML
vLLM
Fine-tuning
RLHF
TGI
Transformers
TensorFlow
PyTorch
Synthetic Data
DPO
PPO
GRPO
Pre-training
Machine Learning
Spark
Quantization
Multimodal AI
NLP
AWQ
GGUF
GPTQ
LLM
Post-training
Model Distillation
+16
Apply

Netskope

netskope.com
netskope.com • HQ: Santa Clara, United States • Cybersecurity • Network Security • Cloud Security • 1001-5000 employees • Est. 2012 • NASDAQ: NTSK • Trust A • Hiring 121, 6 new
HQ: Santa Clara, United States • Cybersecurity • Network Security • Cloud Security • 1001-5000 employees • Est. 2012 • NASDAQ: NTSK • Trust A • Hiring 121, 6 new
Netskope provides a security service edge platform delivered from its own global network. Its products cover cloud access security, secure web gateway and zero trust private access. Enterprises use it to protect users working outside the corporate perimeter.
No named decision-maker yet.
No careers mailbox known
Top 25% payVerified live · 2 hours ago Visa sponsor 3 months ago Long shot · 17%

Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization

$125k – $272k per year • Equity • Lead • 10+ years exp • In office (Santa Clara, United States) • Master's Degree • Principal
Python
C++
AI/ML
llama.cpp
LoRA
vLLM
Fine-tuning
Quantization
AI Agents
SGLang
AWQ
GGUF
GPTQ
QLoRA
TensorRT-LLM
MLX ML
LLM Evaluation
Edge AI
ONNX Runtime
KV Cache
Agentic Workflows
Machine Learning
Claude Code
TensorRT
PEFT
OpenAI Codex
Cybersecurity
Zero Trust
+18
Apply

AvePoint

avepoint.com
avepoint.com • HQ: Jersey City, United States • Security Compliance • Data Governance & Catalogs • Backup & Disaster Recovery • 1001-5000 employees • Est. 2001 • NASDAQ: AVPT • Trust B • Hiring 276, 16 new
HQ: Jersey City, United States • Security Compliance • Data Governance & Catalogs • Backup & Disaster Recovery • 1001-5000 employees • Est. 2001 • NASDAQ: AVPT • Trust B • Hiring 276, 16 new
AvePoint is an American software company founded in 2001 that supplies data management, migration, backup and governance tools for Microsoft 365, SharePoint, Teams and other collaboration platforms. Its products handle the problems Microsoft's own tooling leaves to customers, including tenant-to-tenant migration during mergers, backup and recovery beyond the platform's retention, permission sprawl, and the readiness controls organisations need before enabling artificial intelligence assistants over their content. Headquartered in Jersey City and listed on Nasdaq, it sells both directly and through a large managed service provider channel.
Tianyi Jiang · Co-founder and Chief Executive Officer · decision-maker
Brian Brown · Executive Officer, Director · decision-maker
Xunkai Gong · Executive Officer, Director · decision-maker
James Caci · Executive Officer · decision-maker
No careers mailbox known
Verified live · 3 hours ago 4 months ago Fading · 44%

AI Engineer (Managed Services)

≈ $38k – $78k per year (Estimated) • Junior • 2+ years exp • In office (Singapore) • Bachelor's Degree • Junior
Python
Python
Flask
FastAPI
Pydantic
Databases
Weaviate
Milvus
pgvector
Pinecone
Qdrant
PostgreSQL
AI/ML
LangGraph
AutoGen
LangChain
llama.cpp
Qwen
DeepSeek
LlamaIndex
LoRA
Model Context Protocol
vLLM
Gemma
Fine-tuning
RLHF
Quantization
JAX
Prompt Engineering
Function Calling
Chain-of-Thought
AI Agents
SGLang
AWQ
Cohere SDK
DeepEval
GGUF
GPTQ
Haystack
LangSmith
LiteLLM
Ollama
QLoRA
TensorRT-LLM
TGI
Llama
Mistral
Kubeflow
Transformers
TensorFlow
PyTorch
CrewAI
LLM
RAG
Ray
Reranking
Hybrid Search
Mixtral
OpenAI
Pre-training
Structured Outputs
LLM Guardrails
Speculative Decoding
KV Cache
Multi-Agent Systems
Tool Use
RLAIF
Machine Learning
DSPy
Multimodal AI
NLP
Transfer Learning
TensorRT
PEFT
Model Distillation
DevOps
Kubernetes
Analytics
A/B Testing
+66
Apply

HiddenLayer

hiddenlayer.com
hiddenlayer.com • HQ: Austin, United States • Application Security • Information Security • Cybersecurity AI • 201-500 employees • Est. 2022 • Startup • Trust B • Hiring 16, 2 new
HQ: Austin, United States • Application Security • Information Security • Cybersecurity AI • 201-500 employees • Est. 2022 • Startup • Trust B • Hiring 16, 2 new
HiddenLayer is an Austin company founded in 2022 that secures machine learning models against adversarial attack. Its products scan model artefacts for malicious code, detect inference-time attacks such as extraction and evasion, and give security teams visibility into the AI assets running in their environment. The company grew out of research into attacks on production security models.
Christopher Sestito · Executive Officer, Director · decision-maker
Tanner Burns · Executive Officer · decision-maker
James Ballard · Executive Officer · decision-maker
Alan Freedman · Director
No careers mailbox known
Verified live · 2 hours ago Visa sponsor 4 months ago Long shot · 23%

AI Solutions Architect- Federal

≈ $132k – $252k per year (Estimated) • Staff+ • 5+ years exp • Remote (United States) • Top Secret • Architect
Python
AI/ML
Computer Vision
AI Agents
GGUF
ONNX
Safetensors
PyTorch
LLM
Hugging Face
NIST AI RMF
Machine Learning
DevOps
OpenShift
Helm
VMWare
Azure
CI/CD
AWS
Docker
Kubernetes
Proxmox VE
GitHub
Cybersecurity
OWASP Top 10
+14
Apply

Eloelo

eloelo.in
eloelo.in • HQ: Bengaluru, India • Digital Media • Content Creation • 201-500 employees • Startup • Trust A • Hiring 31, 3 new
HQ: Bengaluru, India • Digital Media • Content Creation • 201-500 employees • Startup • Trust A • Hiring 31, 3 new
Eloelo is an Indian vernacular lifestyle and consumer technology platform with influencer-driven content, live streaming and a skill-learning app called Master. It hires product designers, product managers, data and AI engineers and video editors. The company is headquartered in Bengaluru, India.
No named decision-maker yet.
Careers mailbox is known
Verified live · 2 hours ago 5 months ago Long shot · 15%

AI - Engineer

$74k – $84k per year • Middle • 3+ years exp • In office (Bengaluru, India) • Full-Time • Middle
Python
SQL
AI/ML
ChatGPT
Stable Diffusion
Bitsandbytes
Flash Attention
LoRA
Gemma
Fine-tuning
RLHF
Multimodal AI
Diffusion Models
AWQ
ControlNet
DreamBooth
GGUF
GPTQ
PEFT
QLoRA
Mistral
Transformers
LLM
OpenAI
DPO
SFT
Text-to-Speech
LLM Evaluation
Weights & Biases
DeepSpeed
vLLM
CUDA Toolkit
Prompt Engineering
NLP
Axolotl
LLaMA-Factory
TGI
PyTorch
GAN
LLaVA
CUDA
Hugging Face
FSDP
GPT-4
DevOps
GCP
AWS
+37
Apply

AgiBot

agibot.com.cn
agibot.com.cn • HQ: Shanghai, China • Robotic Software & Control Systems • Robotics AI • Humanoid Robots • 1001-5000 employees • Est. 2023 • Trust A • Hiring 437, 2 new
HQ: Shanghai, China • Robotic Software & Control Systems • Robotics AI • Humanoid Robots • 1001-5000 employees • Est. 2023 • Trust A • Hiring 437, 2 new
Headquartered in Shanghai, China, AgiBot - also known as Zhiyuan Robotics - is an innovative artificial intelligence and robotics company specializing in general-purpose humanoid robots and embodied AI systems. The firm develops advanced hardware platforms and specialized operating software that integrate computer vision, motion control, and deep learning capabilities. By producing both bipedal and wheeled robotic systems, it provides scalable automation solutions designed for industrial manufacturing, commercial environments, and research applications.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 6 months ago Fading · 27%

llm服务部署工程师

Middle • 3+ years exp • In office (Beijing, China) • Full-Time • Middle
C++
AI/ML
Qwen
vLLM
SGLang
AWQ
GGUF
GPTQ
LLM
Apply

NCS

ncs.co
ncs.co • HQ: Singapore • AI Consulting & Integration • Managed Security • IT Consulting & Digital Transformation • Systems Integrators • 1001-5000 employees • Est. 1981 • Trust B • Hiring 377, 14 new
HQ: Singapore • AI Consulting & Integration • Managed Security • IT Consulting & Digital Transformation • Systems Integrators • 1001-5000 employees • Est. 1981 • Trust B • Hiring 377, 14 new
NCS is a technology services provider headquartered in Singapore and was founded in 1981. The company provides a broad range of services including digital transformation, system integration, cybersecurity, and artificial intelligence solutions for government and enterprise clients. As a subsidiary of the Singtel Group, it operates across the Asia Pacific region with a presence in markets such as Australia, China, and India.
No named decision-maker yet.
No careers mailbox known
Likely inactiveVerified live · 2 hours ago 6 months ago Long shot · 8%

AI Architect

≈ $83k – $236k per year (Estimated) • Staff+ • 10+ years exp • In office (Singapore) • PhD • Full-Time • Architect • English
Python
Databases
Milvus
pgvector
Qdrant
PostgreSQL
AI/ML
LangGraph
AutoGen
LoRA
Model Context Protocol
vLLM
Fine-tuning
Prompt Engineering
Knowledge Distillation
AI Agents
AWQ
GGUF
GPTQ
Ollama
QLoRA
TGI
AWS Bedrock
CrewAI
LLM
RAG
Semantic Search
OpenAI
Anthropic
OpenAI Agents SDK
Feature Store
LiveKit
Semantic Search
LLM Guardrails
NIST AI RMF
Multi-Agent Systems
Tool Use
Model Distillation
LangChain
PEFT
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
FinOps
+37
Apply

Sarvam AI

sarvam.ai
sarvam.ai • HQ: Bengaluru, India • LLM & Generative AI • Speech & Audio AI • Foundation Models • Natural Language Processing • 501-1000 employees • Est. 2023 • Startup • Trust A • Hiring 40, 1 new
HQ: Bengaluru, India • LLM & Generative AI • Speech & Audio AI • Foundation Models • Natural Language Processing • 501-1000 employees • Est. 2023 • Startup • Trust A • Hiring 40, 1 new
Sarvam AI is a leading Indian artificial intelligence company focused on building full-stack sovereign generative AI infrastructure, foundational large language models (LLMs), and speech technologies tailored for India’s diverse languages and enterprise requirements.
No named decision-maker yet.
Careers mailbox is known
Verified live · 1 hour ago 6 months ago Long shot · 18%

ML Ops Engineer, Chanakya

≈ $21k – $50k per year (Estimated) • Middle • 3+ years exp • In office (Delhi, India) • Full-Time • Middle
Python
AI/ML
vLLM
Triton Inference Server
Fine-tuning
AWQ
GGUF
GPTQ
TGI
LLM
DevOps
GitHub Actions
K3s
Prometheus
CI/CD
ArgoCD
Docker
Kubernetes
Grafana
Analytics
A/B Testing
+10
Apply

Xiaomi

mi.com
mi.com • HQ: Beijing, China • Televisions • Automotive Manufacturing • Smart Home Devices • Smartphones • 1001-5000 employees • Est. 2010 • Trust C • Hiring 965, 26 new
HQ: Beijing, China • Televisions • Automotive Manufacturing • Smart Home Devices • Smartphones • 1001-5000 employees • Est. 2010 • Trust C • Hiring 965, 26 new
Xiaomi is a Chinese consumer electronics company founded in Beijing in 2010 by Lei Jun and seven co-founders, and one of the three largest smartphone makers in the world. It sells Xiaomi and Redmi handsets alongside a very broad connected-device ecosystem covering televisions, wearables, scooters, appliances and home sensors, built partly through investments in dozens of partner manufacturers. Since 2021 the company has added electric vehicles, launching the SU7 saloon and YU7 sport utility to unexpectedly strong demand, and it ties the whole portfolio together with its HyperOS operating system.
Lin Bin · Co-Founder & Vice Chairman · decision-maker
Lei Jun · Co-Founder, Chairman & Chief Executive Officer · decision-maker
Alain Lam · Chief Financial Officer · decision-maker
Lu Weibing · President · decision-maker
No careers mailbox known
Likely inactiveVerified live · 2 hours ago 1 year ago Long shot · 4%

Miclaw-移动端 AI 性能专家 (Engine & Efficiency)

In office (Beijing, China) • Full-Time • Senior
Rust
Kotlin
C++
Swift
AI/ML
AWQ
GGUF
ExecuTorch
Speculative Decoding
KV Cache
Prompt Caching
Mobile
Metal
+3
Apply
Machines can read this selection · checked 18:49 UTC
GGUF Jobs - Remote & On-site
Frequently asked questions
How many GGUF jobs are available on Alion?
There are currently 12 active listings from 10 hiring companies on Alion, refreshed daily.
What salary do GGUF jobs pay?
The average salary is around $218,600 per year based on the current listings.
Are remote options available for GGUF jobs?
Yes, many of these roles offer remote or hybrid work, and you can filter listings by remote, relocation and visa sponsorship.
How do I apply for GGUF jobs?
Open any listing on Alion and apply directly with the employer through the provided link - no lengthy sign-up required.