---
license: mit
language:
- en
- zh
pipeline_tag: text-generation
library_name: exllamav3
base_model: zai-org/GLM-4.5
base_model_relation: quantized
tags:
  - exl3
---

exllamav3 quantizations of [zai-org/GLM-4.5](https://huggingface.co/zai-org/GLM-4.5).

[2.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/2.00bpw_H6_Revised) 84.517 GiB    
[3.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/3.00bpw_H6_Revised) 125.398 GiB    
[4.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/4.00bpw_H6_Revised) 166.280 GiB     
[5.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/5.00bpw_H6_Revised) 207.162 GiB     
[6.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/6.00bpw_H6_Revised) 248.043 GiB     
[8.00 bpw h8](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/8.00bpw_H8_Revised) 329.987 GiB