Comment on Advice - Getting started with LLMs
kiku123@feddit.de 7 months agoI agree. My 3070 runs the 8B Llama3 model in about 250ms, especially for short responses.
Comment on Advice - Getting started with LLMs
kiku123@feddit.de 7 months agoI agree. My 3070 runs the 8B Llama3 model in about 250ms, especially for short responses.