I don't believe washrooms are the issue as stalls guarantee a level of privacy. The issue is changing areas where women undress - including biological males.
Yes, I understand it could make people uncomfortable, but given that there are changing rooms and nobody NEEDS to get naked in the common area, I ask once again...
Which do you think will create more violence, trans women using men's areas or women's?
Trans women are going to exist and men will always have some bad apples who will creep into women's spaces or beat up trans women for existing. Which one do you think will cause more harm?
I think if you were being honest with yourself, you'd admit that you just don't really care about their safety. Perhaps victim-blaming for being trans?