This ignores Christ's statement to Peter that He would build His Church on Peter, "The Rock", and that whatsoever Peter (and the apostles) bound or loosed would be bound or loosed in heaven.
Christ was giving the Church authority. Or as my old PROTESTANT pastor put it "What's the use of having...