Ministry not being taken seriously

Pray, pray, pray! And then pray some more. It is not everyone's calling to start a church but I believe that if God wants you to start this church, you WILL know if you pray for His will to be done. Yes, the enemy may try to stop you, perhaps even working through your own family unfortunately. But know this: "What then shall we say to these things? If God is for us, who can be against us?" - Romans 8:31
I cannot tell you if starting a church is God's will in your life. Only God can tell you that. Maybe you and your husband can talk to other people who have started churches and get some advice from them. They can tell you what to expect: the good, the bad, and the ugly parts of starting your own church and also maybe give you advice on how to get started and gathering people to attend your church. God bless you!