A lot of these so-called "Protestants" forget that the historic movement involving the Reformers did not completely remove the anagignoskomena/deutercanon, but rather demoted their status. Luther, made them secondary essentially fulfilling the term "deuterocanonical" literally, where as Zwingli and Calvin demoted it even further, though they recongized its usefulness. Regardless, the Bible always had the so-called "Apocrypha" well until the late seventeenth century where after the English Civil War, it was considered a bad thing because Catholics.
Also, if you say that only the 66 books are valid and everything else heathen, then you are siding with the decision (minus the New Testament) of the anti-Christian Jewish Council of Jimena (allegedly a proper council) which removed these books from their scriptural canon because Christians were using it. Though the Reformers demoted these books based on other rationales, most modern "Protestant" Christians no nothing of history and think that just because the bible they have only have 66 Books, they think that God himself handed the Apostles the books straight into their hands, and as such Catholics added more stuff (Orthodox, what are they?).