If all men were meant then you have a problem. Jesus fails in his mission simply because not all men are saved. If it is indeed the intention to save all men then why are not all men saved? The reason all men are not saved is because that is not the intention - the intention is to save the elect which are made up of men and women from all different races.
In light of all the passages on predestination and election which indeed are in scripture surely the correct context of this passage does not refer to every man and woman who has ever lived.
Going back to verse 2 in this same chapter one can see it is clearly why Paul makes to call to pray for kings and rulers in authoriy - because they represent the different races and groups of people of whom the elect are made up of.