Yes. They do. Studying church history gives us insight in how these denominations were formed. Usually it was because a group of believers in an established church received a new insight into some aspect of the ways of God and the hierarchy of that church threw them out, forcing them to form their own fellowship group outside of that church. Then that grew into a denomination. Then later in the history, the same thing happened in that denomination and a further new group was formed.
Of course there are some who could have stayed in the original church but they broke away by choice and not by compulsion.
What we need to do is to fully examine the Scripture concerning those who cause division:
"Now I urge you, brethren, note those who cause divisions and offenses,
contrary to the doctrine which you learned, and avoid them. 18 For those who are such do not serve our Lord [a]Jesus Christ, but their own belly, and by smooth words and flattering speech deceive the hearts of the simple" Romans 16:17-18).
What Paul is saying here is not that people are breaking away to form their own fellowship group for whatever reason. When the disciples told Jesus that a group not of their party were casting out demons, He told them not to stop them because whoever was not against them was for them. Paul said that some preach the gospel out of envy, but at least the gospel was being preached. Also, in the early church, each region had their own churches which were often quite different in character from each other,
but kept to the same true preaching of the gospel.
Those who were causing division in the church were not those who chose to form their own distinctive fellowship group, but those who were preaching another gospel and subscribing to a different Jesus than the One whom Paul preached. Therefore the division was caused by those who departed from the true preaching of the gospel, to false teaching and a false gospel.
A good example of this is in the Charismatic movement, where some have departed from the true gospel by preaching that "we are gods", prosperity, guaranteed healing, and practicing Hindu mind control by teaching positive thinking and confession, and occult practice through kundalini manifestations, and using prayer as a witchcraft technique to get the outcomes they desire. Also, the Oneness doctrine where there is no trinity, but that the whole godhead is comprised of Jesus only. All these are divisions based on false doctrine and which depart from the true gospel of Christ.
Therefore, if I belong to a church that starts to preach that there is no personal God, virgin birth, the Bible not inspired, or the resurrection of Christ, then I am not being divisive. All I am doing is leaving that church and its false gospel and finding another one that preaches the true gospel of Christ.