Will a man who is a Men's size Medium fit into a Women's XL?

No, I am not a transvestite, I was just looking at a shirt that I wanted on a site and the only size they had left for either gender was a Women's XL. I am a little over 5' 7", and can fit into a men's small on some brands. Will the female size be more geared to someone who has wide hips and breasts? Because if so, I the question is kind of pointless, but I don't know. Thanks.