Jesus does not build it upon Peter.
Jesus builds His church on the confession Peter gives about who Jesus is.
So consider Jesus's church is built upon by those who confess Christ as Lord as it has been revealed to such persons by the Father in Heaven.
15 He said to them, But who do you say that I am?
16 Simon Peter answered and said, You are the Christ, the Son of the living God.
17 Jesus answered and said to him, Blessed are you, Simon Bar-Jonah, for flesh and blood has not revealed this to you, but My Father who is in heaven. 18 And I also say to you that you are Peter, and on this rock I will build My church, and the gates of Hades shall not prevail against it. 19 And I will give you the keys of the kingdom of heaven, and whatever you bind on earth will be bound in heaven, and whatever you loose on earth will be loosed[d] in heaven.
20 Then He commanded His disciples that they should tell no one that He was Jesus the Christ.
The truth must be revealed to a person by the Trinity. Ignore the keys, they are to do with Peter's apostolic authority, not building the church.
The Lord Jesus builds His church, not Peter.
He builds the church when people believe in Him and confess Jesus as Christ of God.
That is a gift that comes from above from God by revelation.
Acts 2
46 So continuing daily with one accord in the temple, and breaking bread from house to house, they ate their food with gladness and simplicity of heart, 47 praising God and having favor with all the people. And the Lord added to the church[h] daily those who were being saved.