I'm not saying that the arguments can't be countered - they can. (Of course I believe that they can or I wouldn't be an atheist.

) But they take work to counter effectively, despite what you might think.
"Well what caused God? lol" misses the central tenet of the argument from contingency. We have around us a whole load of things which might not have existed. They all have "might-not-have-existed-ness" in common. The existence of all material objects is contingent in the sense that there is no logical contradiction in the notion of their non-existence. Now contingent things tend to demand an explanation. For example, it's not logically necessary that I am craving a cup of coffee, so you can ask me why I'm craving it, and I can explain to you that I'm craving it because I only had four hours' sleep. Then you might ask me why I only had four hours' sleep, and so on. Now eventually (when you get down to questions like "And why is there matter?") you're going to get to an answer that is either "Because there just is" or an answer that is "It was caused by a being whose existence and causal influence is necessary." Now, I honestly don't think that either of those answers is either completely silly or completely satisfactory. And I don't think that just stating the former is an effective rebuttal of the latter. There's a huge philosophical debate to be had about it, and it's dishonest to pretend you've won by just saying, "There just is."
"there could have never been nothing" and "infinite regress might not be a logical impossibility" are basically the same thing, and they both require a supporting argument. You can't just state them and then go to bed with milk and cookies. That's not what proper philosophy is about.