Haha, well, it is usually conservatives who take jabs at victimhood.
You're right. Things like "It's a woman's fault if she gets raped because she was asking for it" and "I guess if gay people didn't do stupid crazy things like holding hands in public then they wouldn't get their asses kicked" usually come from the conservative camp.
However, I notice that quite often, things like "The children's parents should have a say in the sentencing of child molesters!" and "Black people voted against proposition 8 so gay people can't be getting discriminated against!" tend to come from precisely the same people. In other words, as well as having difficulty empathising or putting a set of morals that conveniently will never apply to them ahead of people's suffering, some conservatives will also very cheerfully use the struggles of victims when it suits them to make intellectually dishonest emotional appeals for the purposes of winning an argument.
(Yes, I'm generalising.

But you called me a conservative, you meanie!)
However, I'm not in any way denigrating the struggles of victims. I'm simply saying that you can't assume that because they've suffered, they are experts in some field of knowledge that most people would otherwise have to go through years of study in which to be proficient. They may well have useful insights into what it feels like to be a victim of the type that they are, and possibly the circumstances which led to their becoming a victim, and in that capacity they can offer useful data to policy-makers, psychologists, &c. But what definitely doesn't happen is that the moment something terrible happens, a shining light of truth from on high implants in your brain the ins and outs of railway engineering, the statistical likelihood of your child being abducted, or a nuanced understanding of the nature and causes of heroin addiction. In fact, it usually does precisely the opposite because a victim is emotionally involved and liable to overestimate risks. Yet to see how victims are frequently treated by the press, and by just about everyone else, come to think of it, you'd think that victims were the final authority.
Here's my lefty disclaimer. I feel great sympathy for anyone who has suffered rape, bereavement, an attack on their family member, a transport-related accident, mugging, arson, racial/sexual discrimination or abuse, domestic abuse, &c. &c. &c. But I do not want the foreign secretary to be someone whose only qualification is that she lost her entire family in the London terrorist bombings. Because she
might be a bit biased and inclined to see things in a somewhat black-and-white fashion, no?