He does not leave! And once you are born by the Holy Spirit into the family of God, you are in there forever. You cannot mak yourself unborn and you cannot divorce Him. If you become a prodigal He waits patiently until you come to your senses. Read and understand the story of the prodigal son in Luke 15. If you go astray, He,the Holy Spirit brings you back to your senses. He is the good Shepherd. He makes sure that He loses none of those who are in Jesus Christ.
The prodigal son was us all going astray, now we have all returned to the Shepherd, He leads them after this, they wont go astray now that they returned from being the prodigal straying son.
Ezekiel 34:11 For thus saith the Lord God; Behold, I, even I, will both search my sheep, and seek them out.
12 As a shepherd seeketh out his flock in the day that he is among his sheep that are scattered; so will I seek out my sheep, and will deliver them out of all places where they have been scattered in the cloudy and dark day.
13 And I will bring them out from the people, and gather them from the countries, and will bring them to their own land, and feed them upon the mountains of Israel by the rivers, and in all the inhabited places of the country.
14 I will feed them in a good pasture, and upon the high mountains of Israel shall their fold be: there shall they lie in a good fold, and in a fat pasture shall they feed upon the mountains of Israel.
15 I will feed my flock, and I will cause them to lie down, saith the Lord God.
16 I will seek that which was lost, and bring again that which was driven away, and will bind up that which was broken, and will strengthen that which was sick: but I will destroy the fat and the strong; I will feed them with judgment.
John 10:3 To him the porter openeth; and the sheep hear his voice: and he calleth his own sheep by name, and leadeth them out.
4 And when he putteth forth his own sheep, he goeth before them, and the sheep follow him: for they know his voice.
5 And a stranger will they not follow, but will flee from him: for they know not the voice of strangers.
John 10:8 All that ever came before me are thieves and robbers: but the sheep did not hear them.
9 I am the door: by me if any man enter in, he shall be saved, and shall go in and out, and find pasture.
1 Peter 2:25 For ye were as sheep going astray; but are now returned unto the Shepherd and Bishop of your souls.