Vontra/Solar-Open2-250B-MLX-6bit
Text Generation • 250B • Updated • 142 • 1
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
149
Active filters: 6bit
alokabhishek/Meta-Llama-3-8B-Instruct-6.0-bpw-exl2
Text Generation • Updated • 1 • 1
alokabhishek/Llama-2-7b-chat-hf-6.0-bpw-exl2
Text Generation • Updated • 2 • 1
legraphista/Yuan2-M32-hf-IMat-GGUF
Text Generation • 40B • Updated • 332 • 3
legraphista/K2-Chat-IMat-GGUF
Text Generation • 65B • Updated • 238 • 5
legraphista/K2-IMat-GGUF
Text Generation • 65B • Updated • 444 • 3
legraphista/neo_7b_instruct_v0.1-IMat-GGUF
Text Generation • 8B • Updated • 875
legraphista/neo_7b_sft_v0.1-IMat-GGUF
Text Generation • 8B • Updated • 432
legraphista/neo_7b-IMat-GGUF
Text Generation • 8B • Updated • 471
legraphista/Llama-3-8B-Instruct-MopeyMule-IMat-GGUF
Text Generation • 8B • Updated • 1.6k • 1
legraphista/Meta-Llama-3-8B-Instruct-abliterated-v3-IMat-GGUF
Text Generation • 8B • Updated • 1.2k • 1
legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF
Text Generation • 71B • Updated • 966 • 2
legraphista/K2-ckpt_360-IMat-GGUF
Text Generation • 65B • Updated • 458
legraphista/Nxcode-CQ-7B-orpo-IMat-GGUF
Text Generation • 7B • Updated • 1.65k • 3
legraphista/dolphin-2.9.2-Phi-3-Medium-IMat-GGUF
Text Generation • 14B • Updated • 2.55k
legraphista/dolphin-2.9.2-Phi-3-Medium-abliterated-IMat-GGUF
Text Generation • 14B • Updated • 312 • 1
legraphista/Higgs-Llama-3-70B-IMat-GGUF
Text Generation • 71B • Updated • 294 • 8
legraphista/Qwen2-7B-Instruct-IMat-GGUF
Text Generation • 8B • Updated • 629 • 3
legraphista/Qwen2-0.5B-Instruct-IMat-GGUF
Text Generation • 0.5B • Updated • 799
legraphista/Qwen2-0.5B-IMat-GGUF
Text Generation • 0.5B • Updated • 548
legraphista/Qwen2-1.5B-Instruct-IMat-GGUF
Text Generation • 2B • Updated • 735 • 1
legraphista/Qwen2-1.5B-IMat-GGUF
Text Generation • 2B • Updated • 773
legraphista/Qwen2-7B-IMat-GGUF
Text Generation • 8B • Updated • 439
legraphista/Qwen2-57B-A14B-Instruct-IMat-GGUF
Text Generation • 57B • Updated • 60 • 2
legraphista/Qwen2-72B-Instruct-IMat-GGUF
Text Generation • 73B • Updated • 288 • 1
legraphista/Qwen2-57B-A14B-Instruct-GGUF
Text Generation • 57B • Updated • 464
legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF
Text Generation • 16B • Updated • 3.87k • 9
legraphista/DeepSeek-Coder-V2-Lite-Base-IMat-GGUF
Text Generation • 16B • Updated • 976 • 2
legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF
Text Generation • 236B • Updated • 731 • 6
legraphista/glm-4-9b-chat-IMat-GGUF
Text Generation • 9B • Updated • 458 • 5