That's my point. That's a false distinction, unless you are standing outside, so to speak, looking in. "Communing with a book" is not a thought a literalist is able to recognize. It's like saying I don't care for Shakespeare, I just like his plays. Or go back to my example of Jesus in a Jewish perspective. Ever talked to an Orthodox Christian about icons? Maybe you should venture over to the TAW forum and ask some questions about the use of religious imagery in worship.
Even ancient "idolatry" as described by the Hebrew Bible never actually involved confusion between the symbol and the symbolized. The prophets speak of it pejoratively in that way merely to express their belief that there WAS no God behind THEIR idols, and THEREFORE they were simply worshiping wood, stone, etc. That is their unique premise, namely, monotheism. If the Philistines had been monotheists, they could have made the same case against the silly Israelites worshiping the ark of the covenant or the temple or whatever.
In your case, because you believe (as I do) that the Bible is not God's inerrant word, the accusation of idolatry makes sense; however, it will never make sense to a literalist.
Hope that makes sense. I was brief to a fault in my earlier post, but I have no interest in further discussing what I believe to be utterly conclusive. If you want any clarification on the issue please PM me.