Comment on [deleted]

<- View Parent
kiku123@feddit.de ⁨2⁩ ⁨years⁩ ago

I agree. My 3070 runs the 8B Llama3 model in about 250ms, especially for short responses.

source
Sort:hotnewtop