You're right, you know, the passage makes it appear that those taken were taken away by death to judgement, or something like that, and that the ones left behind were blessed.
But of that day and hour no one knows, neither the angels of heaven, nor the Son, but the Father alone. For as it was in the days of Noah, so it will be at the coming of the Son of Man. In (those) days before the flood, they were eating and drinking, marrying and giving in marriage, up to the day that Noah entered the ark. They did not know until the flood came and carried them all away. So will it be (also) at the coming of the Son of Man. Two men will be out in the field; one will be taken, and one will be left. Two women will be grinding at the mill; one will be taken, and one will be left. Therefore, stay awake! For you do not know on which day your Lord will come. Be sure of this: if the master of the house had known the hour of night when the thief was coming, he would have stayed awake and not let his house be broken into. So too, you also must be prepared, for at an hour you do not expect, the Son of Man will come. (Matthew 24:36-44)
But these passages are notoriously difficult so I'd be careful about reading much into or out of the passage without a very careful examination of parallel passages and some consideration of old testament precursors too.