I see your point. Rereading the OP, it looks like I jumped to a conclusion about LLMs and not AI in general.

My takeaway still stands for LLMs. These models have gotten huge with little net gain on each increase. But a Moore’s Law equivalent should apply to context sizes. That has a long way to go.