Qwen1.5-Moe: Matching 7B Model Performance with 1/3 Activated Parameters

Submitted ⁨⁨1⁩ ⁨year⁩ ago⁩ by ⁨bot@lemmy.smeargle.fans [bot]⁩ to ⁨hackernews@lemmy.smeargle.fans⁩

https://qwenlm.github.io/blog/qwen-moe/