To be fair, people can be ignorant and superstitious without religion. All it takes is a little fear and misunderstanding for people to draw the wrong conclusions. And witch hunts still happen in our culture, don't you doubt that.
Take Michael Jackson for instance. (I know everyone's probably sick of hearing about him, but it's the first example I could think of.) A jury found him not guilty. That's supposed to be enough--his name should have been clear. But due to the media parade, the fears of parents who put their empathy for small children before their reason, the assumption that a person who looks and acts weird would have weird sexuality etc... I bet that two months ago, if you had polled a thousand Americans, the vast majority of them would have thought he was a pedophile.
Now, I pay little attention to the media and I don't know or even care whether MJ was guilty. But either way, he was hounded, watched, scrutinized, despised, laughed at, and probably got a bag full of death threats on a daily basis.
We might as well have been carrying torches.