Comment on Might not be efficient, but at least it... Uhhh, wait, what good does it provide again?
affenlehrer@feddit.org 2 days agoAt least for me the small 4-8b models turned out to be pretty useless. Extremely prone to hallucinations, not good at multiple languages and worst of all still pretty slow on my machine.
I tried to create a simple note taking agent with just file io tools available. Without reasoning they fucked up even the simplest tasks in very creative ways and with reasoning it thought about it for 7 before finally doing it.