Maybe we're straining at gnats here? Let me cite a passage:
James 2:8-10
Okay, be sure to let this sink in: If you violate one, single point of the law- you are guilty of all. Any sin you commit, causes a violation of the entire law, and you are guilty of all. Did you tell a lie? You're now guilty of idolatry, blasphemy, adultery, false witness, coveting, fornication, whoremongering, breaking the sabbath, dishonoring of parents, homosexuality, murder and... masturbating.
Note the passage again. "Respect unto persons." Did you smile and say "Hello" as you passed by the white man on the street, but lower your gaze and "hope for the best" when that black teen in his 'gansta' hat walked by? You just became guilty of idolatry, blasphemy, adultery, false witness, coveting, fornication, whoremongering, breaking the sabbath, dishonoring of parents, homosexuality, murder and... masturbating.
Did you nod in greeting at the well-dressed man who you saw at church; and raise a disapproving eyebrow at the teen girl with her black goth clothing, and neon pink hair? Guess what? You're guilty of idolatry, blasphemy, adultery, false witness, coveting, fornication, whoremongering, breaking the sabbath, dishonoring of parents, homosexuality, murder and... masturbating.
How about instead of straining at gnats, we do our best to fulfill the royal law instead? And recognize that we have sin, and that through Christ, all sin and debt is paid for in full.
As the apostle writes, all things are lawful for me, but not all things edify. 1 Corinthians 10:23
So instead of straining at gnats, and binding heavy burdens on men's shoulders: just, love one another. Is that easy? Is that difficult? It can be. But if you're going to really fervently work on something: work on your love for all. Because that is what is important in the eyes of God: John 15:12, 1 Peter 1:22, 1 John 3:11, 1 John 3:23, 1 John 4:7, 1 John 4:12, 2 John 1:5, Romans 13:8