Which came first, the chicken or the egg?
Infinite regression is a hole in reality that must be reconciled.
Plainly, ANYTHING that has a beginning, is part of this chain. But this chain can not possibly exist without having a first link. A first link can not possibly be finite.
Do you understand?
I have no problem with the universe and time coming into existence at the very same time, but what I do have a problem with is the Universe and time having a beginning with no regression to come from. That is a break in logic, and frankly, sanity. You can not say something was born, but not give an answer from what.