A language model with 5 million parameters and 32 tokens of context. Required mods to make it functional by preventing distant chunks from "unloading".