The words "all men" is used in Scripture to mean:
1) Every single man and woman
2) Every single man only
3) All nations and races
4) Every man and woman from Israel
5) Every man only from Israel
6) A great number of people (but not every single person on Earth)
7) Men from every station in life (rich and poor; ordinary and rulers; or "types of men.")
You need to see the context of how "all men" is used in order to understand what "all men" means in any particular verse.
Lets take a look at a few examples, ok?
MAR 1:37 And when they had found him, they said unto him, All men seek for thee.
This means a great number of Israelites, it does not means every single person on earth.
LUK 21:17 And ye shall be hated of all men for my name's sake.
This means a great number of lost people, it does not mean every single person on earth.
LUK 6:26 Woe unto you, when all men shall speak well of you! for so did their fathers to the false prophets.
This means all lost men and women, not every single person on earth.
ACT 2:17 And it shall come to pass in the last days, saith God, I will pour out of my Spirit upon all flesh: and your sons and your daughters shall prophesy, and your young men shall see visions, and your old men shall dream dreams:
This means men and women from every nation and race, it does not mean every single person on earth.
ACT 2:45 And sold their possessions and goods, and parted them to all men, as every man had need.
This means all the believers in this church only, it does not mean every single person on earth.
ACT 4:21 So when they had further threatened them, they let them go, finding nothing how they might punish them, because of the people: for all men glorified God for that which was done.
This means all the men and women who saw the miracle or knew the man who was healed in Jerusalem, it does not mean every single person on earth.
ACT 19:19 Many of them also which used curious arts brought their books together, and burned them before all men: and they counted the price of them, and found it fifty thousand pieces of silver.
This means all the men and women in the town that only happened to be present, it does not mean every single person on earth.
1CO 10:33 Even as I please all men in all things, not seeking mine own profit, but the profit of many, that they may be saved.
This means all "types of men and women" and certain men and women who were "Jews and Gentiles," it does not mean every single person on earth (many were not pleased with Paul....lol).
1TI 2:1-2 I exhort therefore, that, first of all, supplications, prayers, intercessions, and giving of thanks, be made for all men; For kings, and for all that are in authority; that we may lead a quiet and peaceable life in all godliness and honesty.
This means "all types of men," men from every station of life, it does not mean every single person on earth.
And finally your verse, "I, if I be lifted up, will draw all men unto Me." John 12:32
I believe this verse means not just men, but men and women from every nation on earth and therefore not just the Israelites anymore. This was a major change of events that Christ was ushering in and therefore preaching about. It was now salvation for the Gentiles!
We of course know that millions of men and women have died in their sins and are therefore in hell now without ever having heard the Gospel from the time of Christ's crucifixtion until now, so we know Christ could not possibly have meant every single person on Earth from the date of His crucifixtion until today would be drawn to Him.
Therefore the use of "all men" in this verse must be the same way the Holy Spirit uses "all men" throughout all of Scripture i.e., as a selective population.
