Warning!These quants need to be redone from scratch, please wait for "v2" uploads of each one with the new tokenizer settings to fix the endless generation issues.
· Sign up or log in to comment