Trust me, I wish I did not believe Genesis 1-11 was literal history. Many of the young Earth creation "apologists" are consistently misrepresenting evolutionary theory and I am honestly embarrassed to even be connected to some of them. However, if I want to be consistent with how I interpret the Scriptures, I must take Genesis 1-11 for what it is.
Read Exodus 20:8-11
Remember the Sabbath day, to keep it holy. Six days you shall labor, and do all your work, but the seventh day is a Sabbath to the LORD your God. On it you shall not do any work, you, or your son, or your daughter, your male servant, or your female servant, or your livestock, or the sojourner who is within your gates. For in six days the LORD made heaven and earth, the sea, and all that is in them, and rested on the seventh day. Therefore the LORD blessed the Sabbath day and made it holy.
There is no way to honestly come the conclusion that the author and editors of the Pentateuch thought Genesis 1-11 was not real history. So, while evolutionary theory is a brilliant theory, it doesn't align with Scripture. You either can trust in man's ideas on our origin or trust in the only eyewitness - God.