Software no more “thinks” than a minute hand knows the time or the printed word “pelican” knows what a pelican is. We might just as well liken the mind to an abacus, a typewriter, or a library. No computer has ever used language, or responded to a question, or assigned a meaning to anything. No computer has ever so much as added two numbers together, let alone entertained a thought, and none ever will. The only intelligence or consciousness or even illusion of consciousness in the whole computational process is situated, quite incommutably, in us; everything seemingly analogous to our minds in our machines is reducible, when analyzed correctly, only back to our own minds once again, and we end where we began, immersed in the same mystery as ever. We believe otherwise only when, like Narcissus bent above the waters, we look down at our creations and, captivated by what we see reflected in them, imagine that another gaze has met our own.
Hart, David Bentley. The Experience of God (pp. 219-220). Yale University Press. Kindle Edition.