Yes thatâs right, LLMs are context-free. They donât have internal state. When I say âupdate on new informationâ I really mean âwhen new information is available in its context window, its response takes that into account.â
Comment on AGI achieved đ¤
The_Decryptor@aussie.zone â¨2⊠â¨days⊠agoIâm not convinced LLMs as they exist today donât prioritize sources â if trained naively, sure, but these days they can, for instance, integrate search results, and can update on new information.
Well, it includes the text from the search results in the prompt, itâs not actually updating any internal state (the network weights), a new âconversationâ starts from scratch.
jsomae@lemmy.ml â¨1⊠â¨day⊠ago
KeenFlame@feddit.nu â¨1⊠â¨day⊠ago
Thatâs not true for the commercial aiâs. We donât know what they are doing