Zephcom, I am sorry that you apparently have experienced sexual harassment. NO ONE should have to endure that. I dare say that sexual harassment has been taken out of context here, though. From reading the OP and comments I see a prevailing assumption coming through; women are the victims of sexual harassment/abuse. Men are and have been sexually harassed, too. I suppose that since the sexual identity role changes going on in our culture, specifically Hollywood emulating women ruling over and dominating men and men being made to appear as irresponsible, fearsome, and incapable duds, men are now experiencing an exponential increase of sexual harassment; "affirmative action" or tit-for-tat, so-to-speak, from the many women in an authoritative position to impose sexual harassment/abuse today. I do not mean to diminish the wrongfulness of sexual harassment of women but IMO there is an unspoken practice of men being the recipients, also. Unfortunately MEN, having been NATURALLY designed with a bigger and stronger body in order to protect and provide, it is perceived as shameful for a man to admit that a woman took advantage of him in a sexual manner, even if it is limited to verbal, so the majority of women perpetrating this offense (# of cases) go unreported. It is a FACT that a woman can even rape a man. Some ignorantly think that it is not possible but it is, I assure you. It is not a matter of strength, but rather the threat imposed and just like a female giving up and letting it happen to survive, so also can a male.
You are the shepherd of your flock. That means that you are in charge of it: to protect it and discipline (train) it; "rod and staff." You are not above or excluded from your flock. You are also a member of your church. You should be protected just as any other member from abuse. I suspect that you may not have much, if any, established rules of conduct or a church disciplinary process established. Few do today. It is "unpopular." It is VERY Biblical, though. If you &/or your board will not establish AND ENFORCE rules of conduct or such you can only expect many abuses going on in the church, UNCHECKED. If I were a pastor in today's American or most other cultures, I would not counsel any one or be alone with any one without a witness (and best if a secure, incorruptible recording format); no exceptions. If not possible, then I would find another way to serve the Lord. I believe that satan is removing so many from the pulpit and elsewhere in the church with false accusations which attract a guilty pronouncement before which any due just process is even contemplated.