RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16
6B • Updated
• 57
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation
• 0.5B • Updated
• 25
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation
• 3B • Updated
• 6
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation
• 8B • Updated
• 79
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
• 3B • Updated
• 7
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
• 0.5B • Updated
• 36
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
• 0.6B • Updated
• 128
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation
• 2B • Updated
• 8.14k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
• 2B • Updated
• 3
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation
• 2B • Updated
• 3.59k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation
• 8B • Updated
• 6.75k
• 5
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
• 8B • Updated
• 3.16k
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
• 3B • Updated
• 2.1k
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation
• 15B • Updated
• 3.65k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
• Updated
• 3.2k
• 3
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation
• 6B • Updated
• 1.3k
• 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
• Updated
• 120
• 13
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation
• 33B • Updated
• 4.9k
• 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation
• 11B • Updated
• 12.7k
• 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation
• 71B • Updated
• 337
• 2
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
• 71B • Updated
• 24.9k
• 10
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation
• 2B • Updated
• 3.48k
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation
• 8B • Updated
• 5.37k
• 2
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation
• Updated
• 3.11k
• 5
RedHatAI/pixtral-12b-quantized.w4a16
Image-Text-to-Text
• 3B • Updated
• 50
• 1
RedHatAI/Mixtral-8x22B-Instruct-v0.1-FP8
141B • Updated
• 802
RedHatAI/pixtral-12b-quantized.w8a8
Image-Text-to-Text
• 13B • Updated
• 106
• 1
RedHatAI/granite-3.1-8b-base-FP8-dynamic
Text Generation
• 8B • Updated
• 1
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
Text Generation
• 71B • Updated
• 82.2k
• 32
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation
• 71B • Updated
• 3.04k
• 21