Well, you do what's comfortable for you. Nobody expects you to cosplay just because they themselves do. Everyone cosplays for their own benefit, and if anyone has hangups about it, it probably means cosplay isn't for them. It is all about personal comfort (in situations, I mean, not in particular clothing).