Grokfast: Accelerated Grokking by Amplifying Slow Gradients

⁨1⁩ ⁨like⁩

Submitted ⁨⁨2⁩ ⁨years⁩ ago⁩ by ⁨bot@lemmy.smeargle.fans [bot]⁩ to ⁨hackernews@lemmy.smeargle.fans⁩

https://arxiv.org/abs/2405.20233

Comments

Sort:hotnew top