The first instance of the formal invocation of Mary occurs in the prayers of Ephraim Syrus ( 379), addressed to Mary and the saints, and attributed by the tradition of the Syrian church, though perhaps in part incorrectly, to that author. The first more certain example appears in Gregory Nazianzen ( 389), who, in his eulogy on Cyprian, ... But, on the other hand, the numerous writings of Athanasius, Basil, Chrysostom, and Augustine, furnish no example of an invocation of Mary. Epiphanius even condemned the adoration of Mary, and calls the practice of making offerings to her by the Collyridian women, blasphemous and dangerous to the soul.795795 Adv. Haer. Collyrid.: Ἐν τιμῇ ἔστω Μαρία, ὁ δὲ Πατὴρ ... προσκύνείσθω, τὴν Μαρίαν μηδεὶς προσκυνείτω. The entire silence of history respecting the worship of the Virgin down to the end of the fourth century, proves clearly that it was foreign to the original spirit of Christianity, and belongs among the many innovations of the post-Nicene age.
History of the Christian Church, Volume III: Nicene and Post-Nicene Christianity. A.D. 311-600. | Christian Classics Ethereal Library
Here's Polycarp's belief/practice c150ad-
or (as it is in the old Latin translation) nor offer up the supplication of prayer to any other person; for as for Jesus Christ, we adore him, as being the Son of God, but as for the martyrs, we love them, as the disciples and imitators of the Lord. So that they plainly exclude the saints from any sort of religious worship, of which prayer or invocation was always esteemed a very considerable part.
Works of Dr. John Tillotson, Late Archbishop of Canterbury. Vol. 04. | Christian Classics Ethereal Library