Silicon is not a rock so saying that silica is not rare is irrelevant to the “rare rock” line.

Silica is indeed refined but the rock that they refine to get the pure silica are indeed rare rocks.

No one is refining their silica from potassium feldspar.