Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

20,548

Base only

Active filters: gguf-my-repo

Trendyol/Qwen3-14B-BaronLLM-v2-Q8

15B • Updated Aug 20, 2025 • 144 • 9

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 208 • 3

nopesadly/higgs-audio-v3-8b-stt-v2-Q4_K_M-GGUF

Automatic Speech Recognition • 8B • Updated 13 days ago • 180 • 2

ijohn07/Holo-3.1-4B-Q6_K-GGUF

Image-Text-to-Text • 5B • Updated 7 days ago • 365 • 2

V15h/PLLaMa-7b-instruct-Q4_K_M-GGUF

7B • Updated Jun 23, 2024 • 19 • 1

Tech-Meld/Llama3-ChatQA-1.5-8B-Q4_K_S-GGUF

Text Generation • 8B • Updated Jun 30, 2024 • 31 • 2

Bohanlu/Taigi-Llama-2-Chat-13B-Q4_K_M-GGUF

13B • Updated Aug 14, 2024 • 42 • 1

TheRains/Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 5.51k • 3

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 20.3k • 30

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 41.3k • 24

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 1.82k • 10

Maites/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 965 • 1

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 2.07k • 10

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 487 • 239

nocturne23/gemma-3-12b-it-Q4_K_M-GGUF

Image-Text-to-Text • 12B • Updated Mar 13, 2025 • 3.47k • 7

Sangto/T3Q-qwen2.5-14b-v1.0-e3-Q4_K_M-GGUF

Text Generation • 15B • Updated Mar 18, 2025 • 196 • 8

itlwas/YandexGPT-5-Lite-8B-instruct-Q4_K_M-GGUF

8B • Updated Apr 1, 2025 • 156 • 1

itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 19, 2025 • 39 • 1

rippertnt/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF

2B • Updated Apr 28, 2025 • 833k • 4

Aldaris/Qwen3-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated Apr 29, 2025 • 1.62k • 6

decerto/Qwen2.5-VL-7B-Instruct-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Jun 1, 2025 • 390 • 2

KalaiarasiS14/Llama-3.1-Nemotron-Nano-8B-v1-Q4_0-GGUF

Text Generation • 8B • Updated Jun 12, 2025 • 5 • 1

benvezzani/nomic-embed-text-v2-moe-Q4_K_M-GGUF

Sentence Similarity • 0.5B • Updated Jul 20, 2025 • 41 • 1

echos-keeper/gpt-oss-10.2b-specialized-science-pruned-moe-only-14-experts-Q5_K_M-GGUF

Text Generation • 10B • Updated Aug 13, 2025 • 216 • 2

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 263 • 27

AlicanKiraz0/Qwen3-14B-BaronLLM-v2-Q4_0-GGUF

15B • Updated Aug 22, 2025 • 358 • 15

sabafallah/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

Text Generation • 33B • Updated Sep 9, 2025 • 913 • 1

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 29.6k • 22

fdtn-ai/Foundation-Sec-1.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 3, 2025 • 88 • 1

Edge-Quant/hito-1.7b-Q4_K_M-GGUF

Text Generation • 2B • Updated Dec 4, 2025 • 22 • 2