Comment on Pool of data

<- View Parent
urushitan@kakera.kintsugi.moe ⁨10⁩ ⁨hours⁩ ago

At the lowest level yes. But you’re talking about millions of bits of entropy seeds being constantly gathered and spread across parameters with every new token. The industry approach to balancing stochasticity with determinism is Temperature: www.ibm.com/think/topics/llm-temperature

source
Sort:hotnewtop