Getting a right relationship with God through faith in Jesus Christ should be a top priority for you. Some of these other problems may be fixed if that happens.
It sounds like you have a hard-working husband who probably doesn't beat you, cheat on you, or gamble away the milk money. You shouldn't divorce a man like that. It's not good if he doesn't take initative to spend time with the children, and maybe you should remind him to do that and try to persuade him to improve, but without doing it in a nagging manner.
If you've got bad feelings toward him, that may be why he'd prefer to work and stay out of the home. If he senses that his wife doesn't love him, like him, and respect him, he may just want to work late to avoid getting an ear-full.
If you want your relationship with your husband to change, pray about it. Pray that you will having a loving, respectful, submissive attitude toward him. Read Ephesians 5 about what marriage is supposed to look like.
You could write down all the good things you can think of on a piece of paper, then throughout the week, take a portion of those things and thank God for them. Then offer him some encouragement based on that day's portion of the list when he comes home. Tell him, "I just wanted to tell you how much I appreciate how hardworking you are...." Then, encourage him about that trait. When he comes home, be at the door to greet him with a smile, a hug, and a really long kiss. Say things like, "I am so happy to see you at home." Have the kids ready to greet their daddy like that. Let him relax a while, and then go into praising him for positive traits. Then have one of those long conversations like you used to have back when you were dating. See if he doesn't try to get off early to come home after a little while of this. He may start treating you so well, too, that you'll genuinely be eager to see him at the end of the day.