Most things that seem crazy to one makes perfect sense from a different point of view or a different worldview. Even the 'craziest' conspiracy theory nut makes perfect sense out of their own ideas. Though I suppose that was what you were saying too.
The most extreme (as I don't think YEC is particularly crazy either) literalist position is based solely on the assertion that God would have written Genesis 1 and 2 factually therefore they must be factual. If I thought that were true, I would be YEC myself! I do try very hard to avoid assumptions or at the least to test them continuously which is why YEC didn't stick long in my beliefs -- after I was exposed to AIG by high-school peers, I found a whole lot of sense in the YEC position. It was only later when I started testing the assumptions and seeking out sources for the evidence behind AiG's claims that I found the position untenable.
If somebody assumes that Genesis 1 must be factual to be truthful, and also assumes that any other source of truth is secondary to the Bible, then there is almost by definition, no evidence that could change their mind. That is certainly logically consistant -- but the argument that there is some fundemental separation between experiments we can repeat to verify predictions and theories that only predict what evidence we should find of a hypothetical past event is fundimentally flawed and logically inconsistant. I find many YEC arguments like this to be logically flawed, but since a YEC generally assumes that truth in the Bible trumps any other source of truth (as I think I do as well*) AND assumes that Genesis 1 and 2 cannot be true if not factual, any further discussion of why they hold their position is unnecessary as any secondary point that we might disprove is really irrelevant to those two main assumptions and don't touch the basis of the YEC belief.
*Note that the qualification "I think" is solely because I don't have the brainpower at the moment to think through all the ramifications of this claim. I find immense truth in the teaching of Christ and in the compilation of the Bible, but to claim it trumps all other sources of truth really depends on a solid definition of source and of truth. For example, if the Holy Spirit is a source of truth, does it trump the Bible? Is the Bible actually a source of truth to begin with as it must be interpreted (perhaps with the help of the Holy Spirit) etc... It's way too late for me, and I don't have the energy, I just didn't want to leave it looking like my faith in the teaching of Christ was tenuous or simply remove the comment and not mention that half of what I see as basic YEC assumptions is justified.
And while I'm at it, that last sentence sucks because when you talk about "half" it's usually not singular so saying "half is justified" really bugs me. Oh well -- I'm off to bed... again... now if only God will grant me sleep toonight...
I think this pretty much "gets", or understands us.
It is not dismissive of the YEC's way of reasoning.