It depends on how the standard was made, with the decisions generally made to fit specific reasons and no overarching standard.

There are also clothes that use more than one number. A lot of mens pants use two numbers; the same with formal mens shirts.