FP8 & Quantized version request.
#1
by
RedwanRafi
- opened
Please Upload the fp8 and quantized model! As most of the user own less then 16gb GPU.
Will See what I can do :-)
fjkane
changed discussion status to
closed