I wear 24/7, and have for nearly a decade now. Worn (and changed) at work in many different settings -- office, restaurant, warehouse -- people might have been (and probably are) aware, but, if it suits you, it shouldn't be an issue. Obviously, the older, hairier, and creepier your coworkers regard you, the less likely you'll be able to pull this off. YMMV.
Sisi, I don't know what the laws are in your country (I'm assuming you're not from the US and A), but, would a supervisor, manager, or even coworker make such an announcement/scene in the workplace about someone's need to toilet, even outside of established break times, it would violate many laws, and open the organization to severe legal liabilities and sanctions.
Only YOU know your work situation best. Whether you think you can or you thin you can't; you're right.
It's alot like open or concealed carry - Be personable and polite, friendly, and be open to answering questions, should they arise. At the end of the day, people would rather be understanding and accomodating - It makes them feel better about themselves