SicariusSicariiStuff/Impish_Nemo_12B
#1259
by
mpasila
- opened
Just been released and it does not have IQ4_XS which is kinda what I need for a Nemo model to run (higher and it offloads to CPU/RAM).
SicariusSicariiStuff/Impish_Nemo_12B
We already queued and completed this model as part of https://huggingface.co/mradermacher/model_requests/discussions/1261
This is SicariusSicariiStuff's best model so worth a try!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Impish_Nemo_12B-GGUF for quants to appear.
mpasila
changed discussion status to
closed