LLM Falcon 180B Needs 720GB RAM to Run

⁨5⁩ ⁨likes⁩

Submitted ⁨⁨1⁩ ⁨year⁩ ago⁩ by ⁨bot@lemmy.smeargle.fans [bot]⁩ to ⁨hackernews@lemmy.smeargle.fans⁩

https://kaitchup.substack.com/p/falcon-180b-can-it-run-on-your-computer

Comments

Sort:hotnew top

mvirts@lemmy.world ⁨1⁩ ⁨year⁩ ago
How to run falcon on your computer at home.

Create and AWS account …
source
mvirts@lemmy.world ⁨1⁩ ⁨year⁩ ago
To run fast

source