Advice on Christian step parent Responsibility

I have a 17 year old son. My son was 7 years old when my husband and I met, until then I raised him on my own with the help of my wonderful parents. My husband has never had children of his own but has always claimed my son as his. My husband and I have disagreed over many areas when it has come to raising my son. In 2009 we were married and started attending church later that year, at which time my son was 15 years old. Over the last year I have made the decision to let my son live with his grandparents. I had reached a point where I felt like I could no longer handle the way my husband dealt with my son and vice versa. This was the hardest decision I have ever made. I chose to stay with my husband and try to remain true to the commitment I made with him, while knowing that my child was safe and in a loving home and I am still able to have multiple daily conversations with him and see him as often as his and my schedule will allow. The church that we attend and the bible has taught us that the man is accountable to God for what happens in his children's life; however I feel that I am the one that will be held accountable in the end because I took the decision out of my husbands hands and I am the biological parent. Can anyone shed any light on this issue biblically?