You're over-selling it. Chiliasm was popular in the first few centuries, but it wasn't the view. We do find it in the writings of Fathers such as Irenaeus, Hippolytus, and Justin; not so much Clement of Alexandria, Origen, and others. Even St. Justin, a Chiliast himself, says this in the Dialogue:
"I admitted to you formerly, that I and many others are of this opinion, and [believe] that such will take place, as you assuredly are aware; but, on the other hand, I signified to you that many who belong to the pure and pious faith, and are true Christians, think otherwise." - Dialogue with Trypho, ch 80
Chiliasm and Amillennialism happily coexisted within the early centuries of the Church.
What the Fathers confess is that we shall be gathered to Christ at His coming. As this is what St. Paul says in his first epistle to the Thessalonians. What they never mention is the modern notion that Christians will be beamed up into heaven. Even Chiliasts such as Justin and Irenaeus are clear that they expect the Church to be present, to face the rage of Antichrist. E.g.:
"It is manifest, therefore, that of these [potentates], he who is to come shall slay three, and subject the remainder to his power, and that he shall be himself the eighth among them. And they shall lay Babylon waste, and burn her with fire, and shall give their kingdom to the beast, and put the Church to flight." - Against Heresies, V.26.1
The problem is that there doesn't exist anything substantial to support this notion. The usual offerings from Irenaeus and Pseudo-Ephaem don't stand up to the barest amount of scrutiny. The usual quote from Irenaeus is twisted and ripped from the entirety of what he suggests--including the above mentioned where he understands the Church to be present, enduring through Antichrist's reign. The problem with Pseudo-Ephraem is even greater, primarily because the authentic Apocalypse of Pseudo-Ephraem looks nothing like the Latin-to-English translation floating around the internet by Cameron Rhoades.
What all the Gospels are rather clear on is that our Lord prophesied the destruction of the Jerusalem which took place in the year 70, and that when He came it would be an unexpected and obvious thing. It will be as lightning flashing from east to west. There will be no doubts, no second guesses, no beaming of Christians into heaven to be followed by a seven year tribulation. When our Lord comes, it is in the glory of God the Father to judge the living and the dead. Otherwise it makes no sense for our Lord, in St. John's Gospel, to say explicitly that He will raise us up on the Last Day. Likewise, it makes no sense to hear what the Apostle says in his epistles, such as to the Corinthians in 1 Corinthians 15, or to the Thessalonians in 1 Thessalonians 4. The resurrection of the dead happens at the Parousia, and not a moment sooner--this same Parousia which means the subjection of all things to the Father.
-CryptoLutheran