Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,403

Base only

Active filters: 3-bit

mlx-community/Laguna-S-2.1-oQ3e

Text Generation • 13B • Updated about 20 hours ago • 854 • 3

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • 8B • Updated Apr 25, 2024 • 58.6k • 14

mlx-community/GLM-4.5-Air-3bit

Text Generation • 107B • Updated Jul 28, 2025 • 617 • 32

mlx-community/moonshotai_Kimi-K2-Instruct-mlx-3bit

Text Generation • 1T • Updated Aug 23, 2025 • 318 • 2

mlx-community/Kimi-K2-Instruct-0905-mlx-3bit

Text Generation • 1T • Updated Sep 6, 2025 • 135 • 2

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation • 12B • Updated Nov 28, 2025 • 29.2k • 4

MaziyarPanahi/VulnLLM-R-7B-GGUF

Text Generation • 8B • Updated Feb 10 • 174 • 1

MoringLabs/Nemotron-3-Super-120B-A12B-MLX-3.6bit

Text Generation • 121B • Updated Mar 18 • 530 • 7

MoringLabs/Qwen3.5-122B-A10B-MLX-3.7bit-VL-v2

Image-Text-to-Text • 17B • Updated Apr 6 • 537 • 1

unsloth/Qwen3.6-35B-A3B-UD-MLX-3bit

Image-Text-to-Text • 5B • Updated Apr 17 • 2.77k • 13

manjunathshiva/Nemotron-3-Super-120B-A12B-tq3

Text Generation • 129B • Updated 9 days ago • 560 • 2

marcinrogalski/Qwen3.5-122B-A10B-oQ3

122B • Updated Jun 3 • 112 • 2

deucebucket/Qwen3.6-35B-A3B-Heretic-Cerebellum-GGUF

Image-Text-to-Text • 35B • Updated 20 days ago • 2.62k • 5

rayray916/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-oQ3

Text Generation • 5B • Updated 28 days ago • 1.55k • 1

SamuelTallet/Krea-2-Turbo-SDNQ-3bit-dynamic-hadamard256

Text-to-Image • 6B • Updated 7 days ago • 577 • 3

NapYang/Ornith-1.0-35B-MLX-oQ3.5-fp16

35B • Updated 26 days ago • 754 • 1

kernelpool/LongCat-2.0-3bit

Text Generation • 1.6T • Updated 19 days ago • 643 • 2

mvid/Leanstral-1.5-119B-A6B-MLX-3bit

Image-Text-to-Text • 16B • Updated 15 days ago • 310 • 1

avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw

Image-Text-to-Text • 947B • Updated 3 days ago • 443 • 1

mlx-community/Laguna-S-2.1-oQ3e-fast

Text Generation • 13B • Updated about 20 hours ago • 101 • 1

kaitchup/Llama-2-7b-gptq-3bit

Text Generation • Updated Sep 9, 2023 • 4

clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 2 • 3

clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 6 • 3

MiNeves-tops/opt-125m-gptq-3bit

Text Generation • Updated Sep 25, 2023 • 4

Kimata/opt-125m-3bit

Text Generation • Updated Sep 29, 2023 • 4

LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 2

danny0122/Llama-2-7b-hf-gptq-3bits

Text Generation • 6B • Updated Dec 11, 2023 • 2

danny0122/Llama-2-7b-hf-gptq-3bitssafe

Text Generation • 6B • Updated Dec 11, 2023 • 3

danny0122/stablelm-base-alpha-3b-gptq-3bits

Text Generation • 3B • Updated Dec 11, 2023 • 2

danny0122/stablelm-base-alpha-3b-gptq-3bitssafe

Text Generation • 3B • Updated Dec 11, 2023 • 2