RedHatAI/phi-4-FP8-dynamic
Text Generation
•
15B
•
Updated
•
12.4k
RedHatAI/phi-4-quantized.w8a8
Text Generation
•
15B
•
Updated
•
465
•
2
Text Generation
•
15B
•
Updated
•
160
•
1
RedHatAI/phi-4-quantized.w4a16
Text Generation
•
3B
•
Updated
•
453
•
4
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
•
8B
•
Updated
•
119
•
2
RedHatAI/Apertus-70B-Instruct-2509-quantized.w4a16
Text Generation
•
11B
•
Updated
•
112
•
1
RedHatAI/Qwen2.5-Coder-14B-Instruct-FP8-dynamic
Text Generation
•
15B
•
Updated
•
17
•
1
Text Generation
•
9B
•
Updated
•
80
•
1
RedHatAI/gemma-2-9b-it-FP8
Text Generation
•
9B
•
Updated
•
323
•
5
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
Text Generation
•
8B
•
Updated
•
28.4k
•
30
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation
•
8B
•
Updated
•
5.41k
•
19
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation
•
1B
•
Updated
•
1
RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16
Text Generation
•
2B
•
Updated
•
22
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
Text Generation
•
8B
•
Updated
•
169
•
2
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
•
1B
•
Updated
•
556
•
1
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16
Text Generation
•
11B
•
Updated
•
3.7k
•
3
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8
Text Generation
•
71B
•
Updated
•
1.73k
•
12
RedHatAI/Mixtral-8x7B-Instruct-v0.1
Text Generation
•
47B
•
Updated
•
12.4k
•
1
RedHatAI/Qwen2.5-7B-Instruct
Text Generation
•
8B
•
Updated
•
258
RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic
Text Generation
•
8B
•
Updated
•
2.38k
•
1
RedHatAI/granite-3.1-8b-instruct
Text Generation
•
8B
•
Updated
•
63
•
1
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation
•
8B
•
Updated
•
7
•
1
RedHatAI/Llama-3.3-70B-Instruct
Text Generation
•
71B
•
Updated
•
856
RedHatAI/Mistral-Small-24B-Instruct-2501
Text Generation
•
24B
•
Updated
•
31
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503
Image-Text-to-Text
•
24B
•
Updated
•
230
•
1
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8
Image-Text-to-Text
•
402B
•
Updated
•
65
•
2
RedHatAI/Llama-4-Maverick-17B-128E-Instruct
Image-Text-to-Text
•
402B
•
Updated
•
30
•
3
RedHatAI/Llama-4-Scout-17B-16E-Instruct
Image-Text-to-Text
•
109B
•
Updated
•
6.26k
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text
•
20B
•
Updated
•
204k
•
12
RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic
Image-Text-to-Text
•
109B
•
Updated
•
3.68k
•
28