I am not sure how one can "go overboard" wearing panties? Like any other type of underwear, you either wear them, or you don't.
Wearing them in public is not any different than wearing any other kind of undies. Its boxers, briefs, commando, diapers, or panties. And the general public never...