Sure.
"I will also relate the manner in which we dedicated ourselves to God when we had been made new through Christ; lest, if we omit this, we seem to be unfair in the explanation we are making. As many as are persuaded and believe that what we teach and say is true, and undertake to be able to live accordingly, are instructed to pray and to entreat God with fasting, for the remission of their sins that are past, we praying and fasting with them. Then they are brought by us where there is water, and are regenerated in the same manner in which we were ourselves regenerated. For, in the name of God, the Father and Lord of the universe, and of our Savior Jesus Christ, and of the Holy Spirit, they then receive the washing with water. For Christ also said, 'Unless you be born again, you shall not enter into the kingdom of heaven.' Now, that it is impossible for those who have once been born to enter their mothers' wombs, is manifest to all. And how those who have sinned and repent shall escape their sins, is declared by Isaiah the prophet, as I wrote above; he thus speaks: 'Wash you, make you clean; put away the evil of your doings from your souls; learn to do well; judge the fatherless and plead for the widow: and come and let us reason together, says the Lord. And though your sins be as scarlet, I will make them white like wool; and though they be as crimson, I will make them white as snow. But if you refuse and rebel, the sword shall devour you: for the mouth of the Lord has spoken it.'
And for this we have learned from the apostles this reason. Since at our birth we are born without our own knowledge or choice, by our parents coming together, and were brought up in bad habits and wicked training; in order that we may not remain the children of necessity and of ignorance, but may become the children of choice and knowledge, and may obtain in the water the remission of sins formerly committed, there is pronounced over him who chooses to be born again, and has repented of his sins, the name of God the Father and Lord of the universe; he who leads to the laver the person that is to be washed calling him by this name alone. For no one can utter the name of the ineffable God; and if any one dare to say that there is a name, he raves with a hopeless madness. And this washing is called illumination, because they who learn these things are illuminated in their understandings. And in the name of Jesus Christ, who was crucified under Pontius Pilate, and in the name of the Holy Spirit, who through the prophets foretold all things about Jesus, he who is illuminated is washed." - St. Justin Martyr, First Apology, Ch. 61
"'And dipped himself,' says [the Scripture], 'seven times in Jordan.' It was not for nothing that Naaman of old, when suffering from leprosy, was purified upon his being baptized, but [it served] as an indication for us. For as we are lepers in sin, we are made clean, by means of the sacred water and the invocation of the Lord, from our old transgressions; being spiritually regenerated as new-born babes, even as the Lord has declared: 'Unless a man be born again through water and the Spirit, he shall not enter the kingdom of heaven.'" - St. Irenaeus, Fragments, 34
"But give me now your best attention, I pray you, for I wish to go back to the fountain of life, and to view the fountain that gushes with healing. The Father of immortality sent the immortal Son and Word into the world, who came to man in order to wash him with water and the Spirit; and He, begetting us again to incorruption of soul and body, breathed into us the breath of life, and endued us with an incorruptible panoply. If, therefore, man has become immortal, he will also be god*. And if he is made god* by water and the Holy Spirit after the regeneration of the laver he is found to be also joint-heir with Christ after the resurrection from the dead. Wherefore I preach to this effect: Come, all you kindreds of the nations, to the immortality of the baptism. I bring good tidings of life to you who tarry in the darkness of ignorance. Come into liberty from slavery, into a kingdom from tyranny, into incorruption from corruption. And how, says one, shall we come? How? By water and the Holy Spirit. This is the water in conjunction with the Spirit, by which paradise is watered, by which the earth is enriched, by which plants grow, by which animals multiply, and (to sum up the whole in a single word) by which man is born again and endued with life, in which also Christ was baptized, and in which the Spirit descended in the form of a dove." - St. Hippolytus, Discourse on the Holy Theophany, ch. 8
*c.f. 2 Peter 1:4
I could keep going, but I figure this might be sufficient. As early and for as long as anyone talked about the new birth in Christianity it has been identified explicitly with Holy Baptism.
Don't simply take my word for it, you are welcome to see for yourself by looking at the historical record. That's what I did, and is one of the reasons why my own views on the subject changed: the words of Scripture, the testimony of the ancient Church, and the demonstrable consensus on the subject throughout the history of Christianity was simply an overwhelming amount of evidence that I had to take seriously.
-CryptoLutheran