Sure yeah I agree, I can’t tell the difference between notes a semitone apart or whatever. But the part about instrument timbre sounding different is very important. Most guitars are in standard tuning, and Emajor sounds different than Dmajor, even if you shifted up their pitch. Add to that all of our history of music and there is specific bias in how different keys and sounds are used for different feelings.