It seems like you don’t care about what people think, conditional on them being somewhat accepting of your choices. For instance, until recently you could easily lose your job because students/parents found out you are gay. Trans people still face this reality in many states, and we are currently much more likely to regress than to progress.
With regard to the toilet: especially female-to-male trans people face a big issue that they look male (and are hence considered predators in female toilets), but are banned from using male toilets. This may seem like a minor issue if you aren’t affected, but in practice it’s a big deal.
Out of the loop here, so let me get this straight: Did they build gender-neutral bathrooms that are now gendered by placing a sticker on the door? What on earth could be the purpose of that?