It’s a shortcut for measurements.

It’s easier to shop “Men’s L” or 32x32 pants than remember a lot of measurements.

I think it’s different if you want your clothes to fit a specific way, but for my shopping I want to minimize the time spent shopping and get “good enough”.