INC4AI/Qwen3.5-397B-A17B-int4-mixed-AutoRound
Text Generation • 63B • Updated
• 638 • 2
Intel Neural Compressor
INC4AI
AI & ML interests
AI & ML interests
Recent Activity
updated
a model 4 days ago
INC4AI/Qwen3.5-397B-A17B-int4-mixed-AutoRound published
a model 4 days ago
INC4AI/Qwen3.5-397B-A17B-int4-mixed-AutoRound updated
a model 8 days ago
INC4AI/MiniMax-M2.5-int4-mixed-AutoRound Organizations
INC4AI/MiniMax-M2.5-int4-mixed-AutoRound
Text Generation • 32B • Updated
• 70 • 5
INC4AI/Step-3.5-Flash-int4-AutoRound
Text Generation • 28B • Updated
• 194 • 1
INC4AI/GLM-5-int4-mixed-AutoRound
Text Generation • 105B • Updated
• 1.08k • 2
INC4AI/ds-r1-autoround-llmc-fp8
671B • Updated
• 14
INC4AI/Qwen3-30B-A3B-Instruct-2507-FP8-2Layers
2B • Updated
• 155
INC4AI/DeepSeek-Math-V2-int4-AutoRound
Text Generation • 3B • Updated
• 9
INC4AI/unsloth-DeepSeek-R1-BF16-4Layers-Test-Only
15B • Updated
• 42
INC4AI/Qwen3-8B-FP8_STATIC-FP8-Attn-LLMC-Test-Only
8B • Updated
• 434
INC4AI/Youtu-LLM-2B-int4-AutoRound
Text Generation • 0.5B • Updated
• 6
INC4AI/WeDLM-8B-Instruct-int4-AutoRound
Text Generation • 1B • Updated
• 1
INC4AI/MiniMax-M2.1-int4-AutoRound
Text Generation • 1B • Updated
• 12 • 1
INC4AI/Qwen2.5-0.5B-Instruct-FP8-Dynamic-LLMC-TEST-Only
0.5B • Updated
INC4AI/ds-v32-exp-w4a16-test-only
3B • Updated
INC4AI/DS-V3.2-fp8-w4a16-test-only
3B • Updated
INC4AI/DeepSeek-R1_mxfp8
Updated
INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY
16B • Updated
• 1
INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY
16B • Updated
• 1.34k
INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only
16B • Updated
• 8
INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY
32B • Updated
INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY
Updated
INC4AI/Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY
Updated