From what you have posted, I don't see that he loves you at all. I do think that he controls you mightily and abuses you emotionally and financially, and you let him. As an outsider looking in, I think you should have never gotten involved with this guy to begin with. My heart breaks for you that you are in an emotional place that this guy looked like a reasonable choice as a spouse.
This guy will destroy you, your business, and your relationship with your son and others, unless you take back control. And you better be prepared for the backlash if you do take steps to take back control, because he will fight it, and I'm quite concerned for your safety when that happens.
Please, please, please, please, PLEASE! seek counseling and professional advice on abusive relationships, the nature of abusers and why they are attractive to you. Personally, I think you need to leave him, because abusers like this aren't really fixable.
PS, it doesn't matter about tax filing status in regards to failure to pay taxes on your business income. If the IRS comes after just you or after the both of you, you personally are still responsible to the IRS for the taxes owed. Just because he's controlling the money doesn't mean you yourself aren't legally responsible for paying the taxes. Tax debt never, ever goes away. There is no bankruptcy protection for tax debt. The IRS will find a way to get what is owed to them - be it putting liens on property you own or garnishing your social security income in your old age, your business could be shut down, etc. Also, past due taxes accumulate interest and penalties at a rate that would be considered usury with any other debtor, and almost never do those penalties get dropped.