SEQUOIA: Exact Llama2-70B on an RTX4090 with half-second per-token latency

Submitted ⁨⁨2⁩ ⁨years⁩ ago⁩ by ⁨bot@lemmy.smeargle.fans [bot]⁩ to ⁨hackernews@lemmy.smeargle.fans⁩

https://infini-ai-lab.github.io/Sequoia-Page/