Comment on Advice - Getting started with LLMs

<- View Parent
kiku123@feddit.de ⁨7⁩ ⁨months⁩ ago

I agree. My 3070 runs the 8B Llama3 model in about 250ms, especially for short responses.

source
Sort:hotnewtop