Cause wearing a suit is considered being about business. It's always been perceived as a uniform for success, or war in some elite circles. Chilling in sweats is associated with dressing down, relaxing, not handling business. Getting sweaty. You don't like it, but that's just the way the world is. You being displeased that you being in sweats doesn't invoke the same result is so inconsequential. That's not even a racial issue, it's a common thing all people are subjected too. Stop worrying bout that.
As for corny and harsh attitudes, people that give you those kind of extreme reactions are assholes anyway. That or you are carrying yourself in a way that causes people to view you as such. I've worn sweats and suits, not once have people given me any disrespect wearing either.
