Are transvestites common?

The reason why I ask this is because sometimes I'm worried that at some point I might have a relationship with a woman and later it turns out she/he was a transvestite. Another reason why I ask this is because I've watched a few movies that have transvestites that look very much like women and that made me have a bad outlook on women.