Model inference speed is mind blowing!

#1
by FlameF0X - opened

Hi!

I tested the model on my i3-6006U with 12GB RAM and an HD 520 iGPU, and I was shocked! The inference speed is impressively fast for 1B parameters on such potato hardware like mine.

Love it!

Sign up or log in to comment