Anthrax, you feel weird because you have a conscience. A God-given inner voice that speaks to you when you've done something wrong, or are about to. Paul mentioned it in talking about God's Law, which informs us about what God deems to be sinful. Speaking about Gentiles (anyone who is not a Jew), who did not generally know much about God and Godly things, Paul said many of them have a natural instinct to do what is right by God's Law, even though they have never heard or been given the law. They were guided by their consciences.
Rom. 2
14 for when Gentiles, who do not have the law, by nature do the things in the law, these, although not having the law, are a law to themselves, 15 who show the work of the law written in their hearts, their conscience also bearing witness, and between themselves their thoughts accusing or else excusing them)
The conscience is the soul's warning system, which allows human beings to contemplate their motives and actions and make moral evaluations of what is right and wrong. In order for the conscience to work to it's fullest capacity, the way God intended it to, it must be under the guidance of the Holy Spirit. When you are "right" with God, your conscience tends to accuse you of the sinful things you do. When you are not "right" with God, your conscience tends to make excuses for the sinful things you do.
Do you understand what the following verses mean?
James 1
14 But each one is tempted when he is drawn away by his own desires and enticed. 15Then, when desire has conceived, it gives birth to sin; and sin, when it is full-grown, brings forth death.
It means that we are all tempted by various things, most of us have a few things in particular continually cropping up. And it's really tough in some cases. Satan is really persistent and makes some things seem pretty desirable, and good. When we yield to these desires, it is sin. Now, God has declared in his law that the act of homosexuality is a sin. But the above verse makes a distinction between having the desire and yielding to the desire. The gay tendencies that you feel are not sin in and of themselves. But they become so when you yield to the desires. Now, not all desires are sinful when yielded to, but that is where your conscience comes into play...letting you know the difference. If your conscience "pricks" you, makes you feel weird, then you should be wary of what you are considering.
The thing to remember is that God is a forgiving and merciful God. It is his desire that we turn from our own sinful desires and place our faith in Jesus Christ. When we do so earnestly, he will forgive us and lovingly give us strength to overcome those sinful desires and live in a manner that is pleasing to him.
1 Cor. 10
13 No temptation has overtaken you except such as is common to man; but God is faithful, who will not allow you to be tempted beyond what you are able, but with the temptation will also make the way of escape, that you may be able to bear it.
Jesus was tempted, maybe not with homosexuality but in things that were every bit as enticing to him as these gay tendencies are to you, yet he overcame those desires, instead wishing to do God's will in his life. And faith in him can give you that same kind of strength. It's not too late for you.
I commend you for taking a step toward God by coming to this board for advice. It is my prayer that you take the next step.