Just throwing in my two cents.
First referring specifically to a high-school wrestling team. My high-school did not offer that activity, and it's a difficult thing to comment on.
As mentioned already, there's the danger of some jerk 'copping a feel' in which case, who's to blame? How do we determine if it was accidental, or not? In my experience in martial arts class, such a thing does not happen, at least not with any frequency, because I personally have never, nor would I intentionally 'cop a feel' and have never accidentally done so either. It's sort of natural, in a match like that, there's really little you can accomplish as far as winning goes that involves having your hands around someone's chest (male or female) likewise for the groin' so, it doesn't really matter if it's male or female those areas of the body tend to be avoided, IN JUJITSU! Keeping in mind I have never been involved in high-school wrestling, I do NOT know what moves are taught in that environment.
Now to speak about real-life self defense scenarios, along with martial arts, primarily Jujitsu, which is something I am familiar with.
As a very passionate martial artist, that was one of my greatest hurdles, was grappling (jujitsu/ground/wrestling matches) with girls, or just stand-up sparring. I'm a male, raised in a Christian family, in the Southern USA. Thus, by tradition, one is not to assault a girl. Not even playing...you don't hurt girs...you don't pretend to hurt girls, that's just the philosophy I was raised with.
I remember what my instructor in martial arts said when I was telling one of the girls this, and she was astonished by it, and was telling him. His reply was so beautifully to the point. He said, "If she hits him hard enough, he will."
See, I must first note, the dojo where I study is based primarily on self-defense, actually learning how to deal with potentially being raped, or murdered, by one, or multiple assailants.
Thus, the mentality of this dojo is, it doesn't matter if it's a man, or a woman, if they stab you with a knife, you're going to bleed, and potentially die. Knives do not magically dull in the hands of a petit female.
Thus, I learned that it's actually sexist to consider NOT fighting off a woman, it's to consider them less of a threat.
Now, relating to any sexual issues. I can tell you honestly, in the heat of a sparring match, or grappling match, you really don't have time to notice these things. Most of the females in my dojo at the time were all higher ranked then I, and in grappling matches, would tear me to pieces, I didn't have time to think about her being pressed up against me, I was just trying to free myself from whatever vicious hold she had me in long enough to get my face off the mat and gasp for oxygen lol.
So, yeah, from my personal experience, keeping in mind, I'm heavily referring back to my beginnings in martial arts when I was like 15-16 years old...practically the height of male-hormone rages.
It's also scientific. It's a proven medical fact that when someone is forced to focus on a physically/mentally streneous task hard enough, that the brain (seeking efficiency) will actually cut out 'peripheral' functions to allocate more effort into the said task. Martial arts for example: during a sparring or grappling match, I wouldn't even acknowledge if it was a male or female, you don't even perceive any of the people around you, you hear the instructor's voice as he offers advice, and you think only on how to win the match. It's that simple really.
Also, I consider refusal to spar, grapple, or wrestle a female, simply because she's a female, while chivalrous in intent, is really cruel, and unfair to her.
Keeping in mind, I've been trained in a self-defense dojo, to deal with real-world life or death situations. So, from my perspective, if a lady, God forbid, is ever faced with a larger man trying to rape her, spending all of her time wrestling other females will NOT help her, she will have needed experience dealing with someone physically larger, and stronger than herself, not to mention simple anatomy, she would need experience learning how to inflict greater pain on a male, with different anatomy than a female (not just counting the 'obvious' differences, but also things such as males naturally having less flexible joints."
In the reverse, I've had relatives whom have dated very dangerous ladies. In fact, one 16 year old relative of mine dated an 18 year old lady, and in one case at a friend's house she attempted to attack him, to physically fist-fight him, using the martial arts that he knew, he was able to successfully block her off, and then hold her back until some other people pulled her away. So, in that case, it's good that he was mentally prepared for fighting a female, otherwise that situation could have become very ugly.
I hope I've made a useful contribution to this thread, and I hope I've made my stance clear, that I'm just trying to offer my paradigm on it, not force my opinions onto others. I mean no offense to anyone, male or female.