Ben Kelly PRO

people commenting about how they can't run this locally are saying more about themselves than they are about anything else

wheres the spirit of innovation? get out a PC from 1997, try to get it running LM Studio, never know if you dont try!

I'll give this a try on our office GPU rig. VRAM limited to 96gb but DRAM is 1024gb attached to a 64 core threadripper.

I doubt I'll be able to pull 40 TPS on this rig, but hey, local is local!

Thx to all the Unsloth guys as usual!