Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,407

Base only

Active filters: llama.cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 5 days ago • 432k • • 930

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 5 days ago • 1.4M • 588

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Image-Text-to-Text • 9B • Updated 8 days ago • 2.13M • 2.41k

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

Text Generation • 1B • Updated 9 days ago • 51.7k • 153

bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 345k • 175

empero-ai/Qwythos-9B-v2-GGUF

Image-Text-to-Text • 9B • Updated 11 days ago • 126k • 203

froggeric/Qwen-Fixed-Chat-Templates

Updated 19 days ago • 963

yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

Text Generation • 12B • Updated Jun 19 • 515k • 1.26k

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

Text Generation • 1B • Updated 9 days ago • 195k • 297

yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jun 19 • 367k • 2.75k

tvall43/Qwen3.6-14B-A3B-FableVibes-GGUF

Text Generation • 14B • Updated Jun 15 • 72.7k • 106

poolside/Laguna-XS-2.1-GGUF

Text Generation • 33B • Updated 4 days ago • 13k • 38

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated 21 days ago • 71.5k • 93

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated 8 days ago • 13.1k • 65

jcbtc/Ternary-Bonsai-27B-AMD-Strix-Halo

Text Generation • Updated 2 days ago • 12

Jackrong/Qwopus3.6-35B-A3B-Coder-MTP-GGUF

Image-Text-to-Text • 0.4B • Updated 14 days ago • 524k • 197

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 27.5k • 759

Abiray/Laguna-S-2.1-IQ4_XS-Q4_K_M-GGUF

Text Generation • 84B • Updated about 10 hours ago • 10

Jiunsong/supergemma4-26b-uncensored-gguf-v2

Text Generation • 25B • Updated Apr 12 • 63.4k • 949

Jackrong/Qwopus3.6-27B-v2-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated 14 days ago • 87.7k • 381

Jackrong/Qwopus3.6-27B-Coder-Compat-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated 14 days ago • 559k • 128

Hikari07jp/Ternary-Bonsai-27B-Abliterated-LowDeg-GGUF

Text Generation • 27B • Updated about 9 hours ago • 8

Danny-Dasilva/Ternary-Bonsai-27B-antidoom-DSpark

Text Generation • 27B • Updated 7 days ago • 1.59k • 8

Abiray/Nanbeige4.2-3B-GGUF

Text Generation • 4B • Updated about 9 hours ago • 8

protoLabsAI/Ornith-1.0-9B-MTP-GGUF

Text Generation • 9B • Updated 18 days ago • 80.5k • 77

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-GGUF

Text Generation • 27B • Updated 9 days ago • 23.6k • 15

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 602k • 105

Soofi-Project/Soofi-S-Rhine-Preview-GGUF

Text Generation • 32B • Updated 5 days ago • 52 • 7

Moore2877/Qwen-Fixed-Chat-Templates-llamacpp

Updated 6 days ago • 12

RemySkye/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-GGUF

78B • Updated 8 days ago • 5.77k • 7