Edit Models filters

Model Tree

Qwen/Qwen3-4B-Instruct-2507

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

249

Base only

Active filters: Qwen/Qwen3-4B-Instruct-2507

unsloth/Qwen3-4B-Instruct-2507-unsloth-bnb-4bit

Text Generation • Updated Aug 6, 2025 • 137k • 16

lmyzzz/BrainrotGPT-4B-Skibidi-Instruct-GGUF

Text Generation • 4B • Updated 7 days ago • 750 • 3

Qwen/Qwen3-4B-Instruct-2507-FP8

Text Generation • 4B • Updated Sep 17, 2025 • 767k • 79

unsloth/Qwen3-4B-Instruct-2507-GGUF

4B • Updated Aug 20, 2025 • 64.5k • 180

challychoi/Lara-TRT-Edge-Qwen3-4B-INT4

Updated about 10 hours ago • 1

lmstudio-community/Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 10.1k • 12

lmstudio-community/Qwen3-4B-Instruct-2507-MLX-4bit

Text Generation • 0.6B • Updated Aug 6, 2025 • 53.5k • 3

lmstudio-community/Qwen3-4B-Instruct-2507-MLX-5bit

Text Generation • 0.8B • Updated Aug 6, 2025 • 50.8k

lmstudio-community/Qwen3-4B-Instruct-2507-MLX-6bit

Text Generation • 0.9B • Updated Aug 6, 2025 • 50.8k

lmstudio-community/Qwen3-4B-Instruct-2507-MLX-8bit

Text Generation • 1B • Updated Aug 6, 2025 • 52.1k • 2

gabriellarson/Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 121

bartowski/Qwen_Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 11k • 23

ArtusDev/Qwen_Qwen3-4B-Instruct-2507-EXL3

Updated Aug 6, 2025 • 7 • 1

cyankiwi/Qwen3-4B-Instruct-2507-AWQ-4bit

Text Generation • 4B • Updated Aug 6, 2025 • 9.12k • 7

warshanks/Qwen3-4B-Instruct-2507-AWQ

Text Generation • 4B • Updated Aug 6, 2025 • 116k • 1

prithivMLmods/Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 272 • 2

mlx-community/Qwen3-4B-Instruct-2507-4bit

Text Generation • 0.6B • Updated Jan 2 • 21.2k • 9

mlx-community/Qwen3-4B-Instruct-2507-5bit

Text Generation • Updated Oct 9, 2025 • 23 • 1

mlx-community/Qwen3-4B-Instruct-2507-6bit

Text Generation • Updated Aug 6, 2025 • 72 • 2

mlx-community/Qwen3-4B-Instruct-2507-8bit

Text Generation • Updated Aug 6, 2025 • 101 • 4

unsloth/Qwen3-4B-Instruct-2507-bnb-4bit

Text Generation • Updated Aug 6, 2025 • 7.01k • 5

DevQuasar/Qwen.Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 7, 2025 • 86

taobao-mnn/Qwen3-4B-Instruct-2507-MNN

Text Generation • Updated Aug 7, 2025 • 44 • 2

mmnga/Qwen3-4B-Instruct-2507-gguf

4B • Updated Aug 7, 2025 • 221 • 1

cyankiwi/Qwen3-4B-Instruct-2507-AWQ-8bit

Text Generation • 2B • Updated Aug 8, 2025 • 2k • 1

ALYTV/Qwen3-4B-Instruct-2507-MLX

Text Generation • 0.6B • Updated Aug 8, 2025 • 5

mlx-community/Qwen3-4B-Instruct-2507-DDWQ

Updated Aug 8, 2025 • 33 • 2

Eslzzyl/Qwen3-4B-Instruct-2507-AWQ

Text Generation • 4B • Updated Aug 12, 2025 • 756 • 1

mradermacher/Qwen3-4B-Instruct-2507-GGUF

4B • Updated Aug 15, 2025 • 208 • 1

mradermacher/Qwen3-4B-Instruct-2507-i1-GGUF

4B • Updated Dec 9, 2025 • 339 • 3