When you say "we" are not apostles. I certainly agree that you are not one. But don't speak for others gifts and callings. Paul seem to have some who did similar where he said
1 Corinthians 9:2
If I be not an apostle unto others, yet doubtless I am to you: for the seal of mine apostleship are ye in the Lord."
"3 Since ye seek a proof of Christ speaking in me,..."
But Paul said
"Paul, an apostle, (not of men, neither by man, but by Jesus Christ, and God the Father, who raised him from the dead"
If some claim to be in the "teacher gift" to the church or "the pastor gift" to the church, this is equally tested and from God or not. The only reference we have in the NT for pastors (as a noun) is in Ephesians 4:11. The other gifts for the church are mentioned there as well such as apostle, prophets, evangelist , pastors and teachers. If we get rid of two of them there then we must get rid of pastors as well for they are only mentioned in that verse.
But this would be wrong for they are all still needed for the perfecting of the saints for the work of the ministry for the edifying of the body of Christ till we all come in the unity of the faith and of the knowledge of the Son of God unto the perfect man. In every church we will see an order from God. Paul said God set some in the church (this was a different church than the one he wrote to in the book of Ephesians) firstly apostles, secondly prophets third teachers...So the gifts to the church are still needed in every church.