How can I use an LLM to generate a 10k word long coherent story?

Comments

• Deestan@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

  This concerns me:

  stories of 100,000+ words from a single prompt

  An LLM excels at making passable derivative work. It does not, by definition, come up with original ideas.

  What are you going to do with 100,000+ words of 100% derivative writing where anything potentially original can be summed up in a prompt of a few dozen words?

  Will this be published or sold somewhere? Undercutting or crowding out original works?

  source

  • hisao@ani.social ⁨3⁩ ⁨weeks⁩ ago

    This is a cool way to put it, but I think even just errors and randomness in reproduction of source ideas sometimes can count as original ideas. Nevertheless, I also think it doesn’t fully encompass all range of mechanisms by which humans come up with original ideas.

    source

    • Deestan@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

      Randomness can give novel combinations, sure, but we shouldn’t call than an original idea.

      As for the various ways humans come up with original ideas, they are based on a level of reflection, reasoning and thought processing. We know that’s not possible for an LLM: while they are complex in their details, the way they work is very well defined. They imitate.

      source

      • -> View More Comments
  • BlameThePeacock@lemmy.ca ⁨3⁩ ⁨weeks⁩ ago

    You think Humans aren’t pumping out 100% derivative works all the time?

    Like every shitty romance novel published. There’s only so many ways a man can woo a woman, they just change the location, randomize the set of actions from a list of things men can do to turn women on, throw in something to harm the relationship, and then come up with a set of names.

    source

    • Deestan@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

      You think Humans aren’t pumping out 100% derivative works all the time?

      Don’t worry. I don’t think that.

      A big hope I have for AI is that 100% derivative work by humans is now easier to call out. If a rock with a 9V battery could produce it, why should we value it?

      source

      • -> View More Comments
• november@lemmy.vg ⁨3⁩ ⁨weeks⁩ ago

  Why do you want to do this? What is your end goal?

  If it’s to read a story, there are already more stories in the world than you could hope to read in your entire lifetime. Written by humans, with actual intention behind them, guaranteed to be coherent.

  If it’s to create a story, well, you’re not creating anything by having an LLM do it for you.

  source
• simple@lemm.ee ⁨3⁩ ⁨weeks⁩ ago

  You need to use an LLM with a very long context length, potentially 1 million+ tokens. I don’t know if any local LLMs can even go that far, and if they can, you’ll need an outrageous amount of ram and vram.

  But honest question… Why? If you’re planning on generating fake books or stories, it’s not going to happen, you’ll create the most generic barely coherent text.

  And fair warning, if you’re trying to sell AI generated stories you’ll quickly be permabanned from any store, so don’t even try it.

  source
• xmunk@sh.itjust.works ⁨3⁩ ⁨weeks⁩ ago

  LLM generations of that length tend to go off the rails - I think generating it in chunks where you can try and guide the model back onto the rails it probably a more sane technique.

  There are several open source llms to lean on - but for long generations you’ll need a lot of memory if you’re running it locally.

  source
• kent_eh@lemmy.ca ⁨3⁩ ⁨weeks⁩ ago

  Thw 100k word part is released.

  The coherent story part is not possible with today’s LLMs, even with a much smaller word count.

  Hell, lots of human writers fail at making their stories coherent.

  source
• droporain@lemmynsfw.com ⁨3⁩ ⁨weeks⁩ ago

  What is your goal with these stories?

  source
• Battle_Masker@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

  my guy you gonna plagiarize a whole-ass book using an llm for something THAT big

  source
• some_guy@lemmy.sdf.org ⁨3⁩ ⁨weeks⁩ ago

  This is why buying books on Amazon now requires checking the author’s background to avoid buying AI slop. I never thought I’d see the day, but it became clear to me last summer.

  source
• swordgeek@lemmy.ca ⁨3⁩ ⁨weeks⁩ ago

  Don’t.

  Develop real AI, don’t rely on bullshit LLMs.

  source
• ChasingEnigma@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

  Creating a 100,000-word coherent story using an LLM with a limited context window requires strategic planning in how you manage the narrative flow, continuity, and character development over multiple sessions. Here’s a strategy tailored for this scenario:

  1. Detailed Plot Outline:

     Expand the Outline: Break down the story into smaller, manageable arcs or segments (e.g., each act could be split into several chapters). Each segment should have its own mini-outline: Major plot points Character development for that segment Setting changes Key interactions or conflicts Micro-Outline for Each Chapter: For each chapter within these arcs: Opening scenario Middle conflict Resolution or cliffhanger Character arcs within the chapter

  2. Session Management:

     Context Management: Due to the limited context window, you’ll need to manage how much information is retained from session to session: Summarize Previous Content: Before each new prompt, provide a concise summary of the previous narrative sections. This summary should include: Key events Current state of characters Unresolved conflicts or mysteries Setting and time Prompt Structure: Start with a Summary: Begin each prompt with a summary:

      Previous chapter summary: [insert summary here]. Now, write the next chapter where [describe the key elements from the micro-outline].
     
      Specify Tone and Style: If the story has a specific tone or narrative style, remind the LLM of this:
     
      Maintain the [tone/style] from previous chapters. 
     

     Length of Each Segment: Estimate how many words you can comfortably fit into one session. If your LLM can handle around 2,000 tokens (which could be around 1,500 words, depending on the model), you might aim for each session to produce a chapter of 1,500 words.

  3. Continuity and Cohesion:

     Character Consistency: Keep a running document of character details, relationships, and developments outside the LLM context. Use this to ensure consistency: Character sheets Timeline of events Plot Devices: Use recurring elements or plot devices to maintain cohesion: Recurring themes Foreshadowing elements from earlier segments Feedback Loop: After each session, review the output for: Continuity errors Character voice consistency Plot holes

     Use this feedback to adjust your next prompts or summaries to address any discrepancies.

  4. Incremental Development:

     Iterative Refinement: As you generate content, refine your prompts based on what works…

  source

  • AresUII@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

    Don’t be afraid to revise what you get by hand either

    source

    • ChasingEnigma@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

      I want to know what’s the best I can get automatically. I don’t want to do or revise anything by hand.

      source

      • -> View More Comments
• rayquetzalcoatl@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

  I am confused as to why you’re going through all this struggle! You’ll get the same results just copy-pasting big chunks of other books that humans have already put time and effort into writing :) best of luck!

  source
• FeelzGoodMan420@eviltoast.org ⁨3⁩ ⁨weeks⁩ ago

  Rip society.

  source