Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

20,550

Base only

Active filters: gguf-my-repo

Edge-Quant/hito-1.7b-Q4_K_M-GGUF

Text Generation • 2B • Updated Dec 4, 2025 • 22 • 2

n0kovo/Qwen3-VL-32B-Instruct-heretic-v2-Q4_K_M-GGUF

Image-Text-to-Text • 33B • Updated Dec 16, 2025 • 613 • 6

grupo4-bisite/CodeLlama-7b-Instruct-hf-Q4_0-GGUF

Text Generation • 7B • Updated Dec 30, 2025 • 26 • 1

chenly124/Qwen3-4B-Thinking-2507-gabliterated-Q8_0-GGUF

4B • Updated Jan 21 • 9 • 1

fdtn-ai/Foundation-Sec-8B-Reasoning-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 18 • 835 • 5

OddTheGreat/Luna_12B_V.3-Q6_K-GGUF

13B • Updated Jan 31 • 41 • 1

lainlives/Qwen3-Coder-30B-A3B-IT-Heretic-Q5_K_M-GGUF

Text Generation • 31B • Updated Feb 1 • 23 • 1

Gg0999vaja/venice-uncensored-Q2_K-GGUF

Text Generation • 24B • Updated Apr 4 • 211 • 1

NidAll/supergemma4-e4b-abliterated-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 17 • 4.91k • 21

googlecs/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-Q4_K_M-GGUF

Text Generation • 35B • Updated Apr 22 • 3.05k • 14

gaoqianshen/Qwen3.6-27B-FP8-Q4_K_M-GGUF

Image-Text-to-Text • Updated Apr 22 • 888 • 1

spenceryork/galaxy-mistral-small-Q4_K_M-GGUF

24B • Updated Apr 24 • 58 • 1

wahidmounir/Darwin-36B-Opus-GGUF

Text Generation • 35B • Updated May 7 • 360 • 8

Rikunarita-ORG/Darwin-4B-Genesis-i-Q5_K_M-GGUF_Fixed

Text Generation • 8B • Updated about 1 month ago • 470 • 9

t1pe/Qwen3.6-35B-A3B-MoE384-pruned-Q4_K_M-GGUF

27B • Updated about 1 month ago • 317 • 1

brantje/Qwen3.6-35B-A3B-Kimi-K2.6-Reasoning-Distilled-Q4_K_M-GGUF

Text Generation • 36B • Updated 9 days ago • 399 • 1

Saif658/Saif-1.0-Q4_K_M-GGUF

3B • Updated 3 days ago • 56 • 1

Saif658/Saif-1-0-Coder-Q4_K_M-GGUF

3B • Updated 3 days ago • 58 • 1

Saif658/Saif-1.1-Q4_K_M-GGUF

3B • Updated 3 days ago • 59 • 1

BaybeDragon/gemma-4-E4B-it-Q4_Mobile-GGUF

Any-to-Any • 8B • Updated 3 days ago • 148 • 1

ijohn07/harness-1-Q4_K_M-GGUF

Text Generation • 21B • Updated about 18 hours ago • 1

raethehacker/NSFW-3B-Q2_K-GGUF

Text Generation • 3B • Updated Nov 23, 2024 • 101 • 2

raethehacker/NSFW-6B-Q2_K-GGUF

Text Generation • 6B • Updated Nov 23, 2024 • 155 • 3

Lucy-in-the-Sky/NSFW-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Feb 19, 2025 • 209 • 2

Lucy-in-the-Sky/NSFW-flash-Q8_0-GGUF

Text Generation • 2B • Updated Feb 19, 2025 • 48 • 2

jtjones/L3.1-Dark-Reasoning-LewdPlay-evo-Hermes-R1-Uncensored-8B-Q8_0-GGUF

Text Generation • 8B • Updated Apr 8, 2025 • 28 • 1

PipPop95/EnceladusHyperStock-24B-Q6_K-GGUF

Text Generation • 24B • Updated 4 days ago • 115 • 1

Poolaroid/EnceladusHyperStock-24B-Q4_K_M-GGUF

Text Generation • 24B • Updated 4 days ago • 203 • 1

BUT-FIT/csmpt7b

Text Generation • 7B • Updated May 21, 2025 • 317 • 17

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q2_K-GGUF

1B • Updated Jun 19, 2024 • 119