Show HN: Speeding up LLM inference 2x times (possibly)

Submitted ⁨⁨1⁩ ⁨year⁩ ago⁩ by ⁨bot@lemmy.smeargle.fans [bot]⁩ to ⁨hackernews@lemmy.smeargle.fans⁩

https://asciinema.org/a/piP22yYwcaohu5cA2gyuv1W61