No amount of prompt “engineering” will help when they outright make shit up.
Comment on Bill Gates: People saying AI will create more jobs don’t understand what’s coming
fonix232@fedia.io 10 hours agoYour experience is pretty unique then.
Yes, LLMs make mistakes, but even small, self-hosted ones are pretty efficient today if you prompt them well. They're not mind reading software so you need to be able to describe the task and HOW you want it done, not just barf in some basic instructions like "write me a copy of Facebook but better".
treadful@lemmy.zip 10 hours ago
fonix232@fedia.io 8 hours ago
Yes it does. Just need to go beyond prompt. Add reinforcement loops, make it test the solution in a separate environ it can't screw up in, and have it not just INVENT things ("give me X"), but research the topic and base its solution on the rules created by the research.
This is what basically the Claude harness (not the local but the remote harness you can't see) adds to the LLM what makes it so powerful and useful. Replicate those processes and even a small 4B mode will be incredibly capable.
flicker@lemmy.dbzer0.com 10 hours ago
Like back when we had to teach people how to google shit. Tedious.
Fishnoodle@lemmy.world 10 hours ago
It sounds like you’re saying people still need to be smart enough to use them properly… Which will be a problem as people rely on them more and more, and in turn become more stupid.