It’s an accessibly feature for those who can’t hold down shift and the key they want to have in uppercase (or the variant, like the exclamation point).

It’s useful for less computer savvy people or those with muscular issues.