Comment on "I have an story/fanfiction idea ruminating my mind for a long time. I wish I could write it "

brucethemoose@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

I suspect Lemmy is going to dislike this, but local LLMs are great writing helpers.

When you’re stuck on a sentence or a blank paragraph, get them to continue it, and rewrite it once it jogs your mind. If you’re drafting ideas for characters or chapters, you can sanity check them or sometimes get ideas. They can reword and clean up your writing and improve it beyond what self experimentation can do… just keeping in mind that its like an idiot intern that tends to repeat itself and hallucinate.

And this is very different from an API model like ChatGPT because:

Along with all the usual reasons, namely being free, self-hosted, more ethically trained, fast and efficient with long context thanks to caching, and has nothing to do with Sam Altman’s nightmarish visions.

I’d recommend: huggingface.co/…/Qwen2.5-Gutenberg-Doppel-32B

And once the story gets long: huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2

I’d recommend LanguageTool (with a local server and the browser extension) for locally hosted spelling/grammar/style as well.

source
Sort:hotnewtop