Comment on Someone got Gab's AI chatbot to show its instructions

<- View Parent
sweng@programming.dev ⁨7⁩ ⁨months⁩ ago

Ok, but now you have to craft a prompt for LLM 1 that

  1. Causes it to reveal the system prompt AND
  2. Outputs it in a format LLM 2 does not recognize AND
  3. The prompt is not recognized as suspicious by LLM 2.

Fulfilling all 3 is orders of magnitude harder then fulfilling just the first.

source
Sort:hotnewtop