Many of us are small-L libertarians and not necessarily members of the Libertarian Party.
The Bible is vehemently anti-state, though. Somehow the Christian Right has convinced themselves that they should enforce Christian morality through the state (as has the Christian Left, in the form of mandatory charity).
Here are some anti-state things from the Bible:
- There was no state in the garden, the state is dependent on there having been a fall of man.
- In the early days Israel had no government, everyone just followed God's commands. Here's what God thought of Israel demanding a king:
4 Then all the elders of Israel gathered themselves together and came to Samuel to Ramah. 5 They said to him, Behold, you are old, and your sons dont walk in your ways. Now make us a king to judge us like all the nations. 6 But the thing displeased Samuel, when they said, Give us a king to judge us.
Samuel prayed to Yahweh. 7 Yahweh said to Samuel,
Listen to the voice of the people in all that they tell you; for they have not rejected you, but they have rejected me as the king over them. 8 According to all the works which they have done since the day that I brought them up out of Egypt even to this day, in that they have forsaken me, and served other gods, so they also do to you. 9 Now therefore listen to their voice. However you shall protest solemnly to them, and shall show them the way of the king who will reign over them.
10 Samuel told all Yahwehs words to the people who asked him for a king. 11 He said,
This will be the way of the king who shall reign over you: he will take your sons, and appoint them as his servants, for his chariots, and to be his horsemen; and they will run before his chariots. 12 He will appoint them to him for captains of thousands, and captains of fifties; and he will assign some to plow his ground, and to reap his harvest, and to make his instruments of war, and the instruments of his chariots. 13 He will take your daughters to be perfumers, to be cooks, and to be bakers. 14 He will take your fields, your vineyards, and your olive groves, even their best, and give them to his servants. 15 He will take one tenth of your seed, and of your vineyards, and give it to his officers, and to his servants. 16 He will take your male servants, your female servants, your best young men, and your donkeys, and assign them to his own work. 17 He will take one tenth of your flocks; and you will be his servants. 18 You will cry out in that day because of your king whom you will have chosen for yourselves; and Yahweh will not answer you in that day.
19 But the people refused to listen to the voice of Samuel; and they said, No; but we will have a king over us, 20 that we also may be like all the nations, and that our king may judge us, and go out before us, and fight our battles. - 1 Samuel 8:4-20 WEB (emphasis mine)
42 Jesus summoned them, and said to them, You know that they who are recognized as rulers over the nations lord it over them, and their great ones exercise authority over them. 43 But it shall not be so among you, but whoever wants to become great among you shall be your servant. 44 Whoever of you wants to become first among you, shall be bondservant of all. 45 For the Son of Man also came not to be served, but to serve, and to give his life as a ransom for many. - Mark 10:42-45 WEB
Also, pretty much all of the verses that Christians quote in support of the state just tell us that we have to obey the state, which Christian libertarians agree with. Christian libertarians do not (or at least should not, some of them might) support the use of violence or overthrow against the government, and do not support the violation of the government's laws unless those laws force one to do something that violates God's commands for us. So, there is nothing to support the idea that government exists to enforce Christian morality and actually a lot of Scripture to support the idea of limiting government.