Comment on Might not be efficient, but at least it... Uhhh, wait, what good does it provide again?

<- View Parent
affenlehrer@feddit.org ⁨2⁩ ⁨days⁩ ago

At least for me the small 4-8b models turned out to be pretty useless. Extremely prone to hallucinations, not good at multiple languages and worst of all still pretty slow on my machine.

I tried to create a simple note taking agent with just file io tools available. Without reasoning they fucked up even the simplest tasks in very creative ways and with reasoning it thought about it for 7 before finally doing it.

source
Sort:hotnewtop