The volume of water of the flood to 5 miles over the average radius of 6380 kilometers is computed thusly:
1) Convert 5 miles to kilometers – we’ll say 8 kilometers for convenience.
2) The volume of a sphere is 4/3 x pi x r[sup]3[/sup].
3) So the volume of water is 4/3 x pi x 6388[sup]3[/sup] less the volume of the Earth or 4/3 x pi x 6380[sup]3[/sup]. The volume of the water is 4/3 x pi x (6388[sup]3[/sup] – 6380[sup]3[/sup]) = 233,511,593 cubic kilometers.
4) What we now want is 4/3 x pi x (r[sup]3[/sup] – (r-0.00001)[sup]3[/sup]) = 233,511,593 cu.km.
- So, (r[sup]3[/sup] – (r-0.00001)[sup]3[/sup]) = 978,131,072
- For convenience, let y = 0.00001
- (r[sup]3[/sup] – (r-y)[sup]3[/sup]) = r[sup]3[/sup] –(r³-2r²y+y²r-r²y+2ry²-y³) =
- 2r²y - y²r + r²y - 2ry² + y³ = 978,131,072
5) Let’s agree that this is messy. Further let us agree that subtracting y[sup]3[/sup] (0.00001[sup]3[/sup] = 10[sup]-15[/sup] cu. Km.) isn’t worth the effort. After all, that’s one cubic centimeter.
6) So, 2r²y - y²r + r²y - 2ry² = 978,131,072
7) Or, 2r² - yr + r² - 2ry = 978,131,072/y = 97,813,107,200,000
8) Or, 3r[sup]2[/sup] - ry – 2ry = 97,813,107,200,000
9) Or, 3r[sup]2[/sup] – 3ry = 97,813,107,200,000
10) Or, r[sup]2[/sup] – ry =32,604,369,067
11) Using an online “complete the square calculator”, r would be about 180,567 km.
So, the distance from the surface of the earth to the shell would be 174,187 km or 108,258 miles or a little less than ½ the distance to the moon.
I used a slightly different set of radii that you did, AV1611VET. If you wish to recompute, here is the complete the square computer I found:
http://www.algebrahelp.com/calculators/equation/completingthesquare/
Figuring backward, I see that I am off by a factor of 1000. I don't know if that is my fault or that of the above website. However, 18056700[sup]3[/sup] - 18056699.99999[sup]3[/sup] yields the desired 978,131,072 from 4(a) above. So, the real answer is 18,056,700 km or 11,222,312 miles which is 50 times the distance to the moon or 1/10 the distance to Mars or 1/4 the distance to Venus.
Sorry for the inconvenience.