Originally coming from a largely Pentecostal, Charismatic and non-denominational environment; now Orthodox Lutheran, though I currently attend a non-denominational church due to lack of choice in my area (I moved to Japan and it's the best English speaking church where I live - my other options are also non-denominations); I can sympathize with the OP as I used to feel like this. I still hold that there's value and truth in striving for peace, unity, compassion and longsuffering, for the sake of the Gospel, and to do good, to which we are called by God's grace.
However, I also think we have to be very careful in asserting that non-denomination or any other branch of Christianity to be "truly Bible-following" and Holy Spirit-led, as really every branch of Christianity claims this.
One thing I learnt through humility, is that the modern idea of the early church is quite far off from the actual proto- and early church, who were both zealous for the Gospel, but also a bit of a mixed bag, due to differences in culture and adiaphora - yet, they held to the same hope in our Lord Jesus Christ.
All denominations have their own quirks, but one danger of abandoning denominations altogether is that, by doing so, we're failing to realize that many non-denominational churches are more or less an extension of baptist, Charismatic and Pentecostal churches (certainly the ones I've been in) - and as such, hold to theology that comes from those, making the claim of purely following Scriptures void. Another more important issue is that my experience, even yesterday in church, the sermon had strong Semi-Pelagian tendencies. In hindsight I also feel like many other old heresies and errors creeps back into the church through careless, under-qualified or over-liberal Bible studies. This is perhaps a harsh claim, but it's almost like the "modern church" are facing and dealing with the same issues that already has been dealt with in the early church; it's a bit like re-inventing the wheel.
All of this is to say, we need to be careful not to assert that our own family of believers are "Bible-following", whilst denoting other families spiritually dead, legalistic or Pharisaical. Because in doing this, we are setting ourselves above others through ignorance. I know I was certainly guilty of this.
The bottomline is that man is divided, but God is not, and neither is His kingdom. We should take comfort in that there is unity in Christ. There's a famous old saying by Irenaeus: "Disagreement in fasting does not destroy unity in faith"
