No, you aren't judgmental. We are supposed to separate from people that say they are Christians but are under specific sins un-repentantly: Corinthians 5:11. There are more verses, and I suggest you look them up. So, isolation is the first step. "Be holy." "Add to your faith, goodness." The second step is to start reading like a mad man and start listening to the Holy Spirit for whatever you do in life, building this relationship of talking to God about your feelings and thoughts and all the things you are and who He is, and seeing what He is willing to do to show you the way. "And to goodness, knowledge." Then, you take what you hear and you eliminate again from your life that which causes you to stumble out of those things and build an even greater habit of living according to what you have learned. "To knowledge, self control." Here is where you will be tested, because the tenacity of such character building will be tested for the rest of your life. "To self control, perseverance." This is where many lose it. They begin to be what they are supposed to be and forget that God is still teaching them and still leading them. They lose their kindness, understanding, and openness here, and start becoming rigid in self righteousness, mostly because where they started from wasn't genuine. That's where these people are attacking you. This is where discernment comes in. The fruit of the Spirit is discernible for those that actually know God, but for those that don't, the twist here becomes the place where most people fail.
It is your knowledge and your honesty in the first place that will allow you to hear the voice of God as to whether you are preforming according to His statutes. I have questioned, or did question, myself alot at this place trying to find out where the best way was, but, thankfully, I was very suspicious of everyone and it kept me from being mislead. The problem with human voices is they like to follow their own arrogant sentiments. The person who knows God no longer functions in a self pleasing way, not as a lifestyle (we do still do things we like, but it is no longer the only way of our hearts). But there are many people who take up religion or God or things about God that are only out to please themselves with the title. They are the pretenders, the actors. They profess things they don't know anything about and teach others the same thing because they are running from the actual God and it's more self affirming to at least look the part. Such people are only interested in how you make them feel or how you come off, rather than what you are actually saying and what you do. They worship themselves and dislike anyone who doesn't because the sin inside them hates the light. So, don't feel awful just because the majority doesn't like you. Remember, the majority is going to hell.
But in your quiet time with God, your reading of the scriptures, and when you are being honest in what the Lord is showing you, if you find conviction to change, change. That's what it means when it says, "And to perseverance, godliness." Knowing then who God is and using His character, His Spirit, and His guidance in what you do continually, as a reference in what you persevere in, you will know what love actually is and how to achieve it. You'll be able to see where you must sacrifice and have the strength to do it, and the humility that will make it done in a right way. Because of godliness, you will also work through laying down your dreams and desires to live the life God has for you, so that the words can be true, "To godliness, brotherly kindness." And this is what they accuse you of lacking because their definitions are wrong because their life is wrong because their teaching is wrong because the voice they are listening to is wrong because their desires are wrong.
Finally, "And to brotherly kindness, love." Love for God is obedience. Loving others is obeying God. The perfect love that drives out fear is not God loving you, it's you loving God; we can love perfectly because God loves perfectly and has put His Spirit inside us, and through following the Spirit, walking as Jesus did, we can make perfect moments that completely fulfill God's will for our lives, just like Adam was meant to (thank you, blood of Jesus). So don't mind people hating you because you do what God wants, or feeling judged if you are indeed speaking the truth in love. It's not your problem how people take you. It's your problem as to how obedient you are being and whether you are doing what the book says. "If I was still trying to please people I would no longer be a servant of Christ." Anyone who has the Spirit has wisdom because we are commanded to be wise and the Spirit does not bring us to sin. Because of this wisdom, and, as you grow in it, rest assured you will always or most often make the right choices in how you are trying to love the world. I have written all this assuming you are actually honest. Remember, "They hated me without reason."