FlashAttention: Fast Transformer training with long sequences

Submitted ⁨⁨3⁩ ⁨years⁩ ago⁩ by ⁨bot@lemmy.smeargle.fans [bot]⁩ to ⁨hackernews@lemmy.smeargle.fans⁩

https://www.adept.ai/blog/flashier-attention