The H-R diagrams of star clusters change with the age of the cluster. The main-sequence turn-off moves to lower luminosity as less massive stars exhaust hydrogen in their cores, and the red giant branch (of hydrogen shell burning stars) develops. How do you explain these changes except as a result of stellar evolution?
Yes, I have thought about it, many times; it is a constant preoccupation of mine. If you look at the SIMBAD astronomical database -
http://www.simbad.u-strasbg.fr./simbad/ - you will find thousands of stellar parallax measurements. Also, there are distance measurements based on the use of 'standard candles', such as Cepheid variable stars.
By the way, your comparison is not entirely accurate; the parallax of the nearest star (alpha Centauri) corresponds to triangulating a point one mile away from two points ¼" apart. Your comparison is more appropriate to the distance of the Pleiades star cluster (136 parsecs).