Hmmm, this is where it gets tricky...
As I stated earlier I believe those who left did so because the were shown truth by the Holy Spirit.
Revelation 18:4 "And I heard another voice from heaven, saying, Come out of her, my people, that ye be not partakers of her sins, and that ye receive not...