We need to get things in balance and in my opinion too many churches have been focussing on families to the exclusion of all others.
This is a very general comment, and likely false in more cases than not. I have experience in several parishes over two diocese, and I know of a few others who definitely have a problem with young family attendance because congregations refuse to tolerate or accomodate them. In our diocese, the problem is so severe that there is no diocesan position or representative to look out for the younger part of the church - no youth pastor, nothing.
At synod I read a lot of information about the demographics about TEC and th ACC, and the analysis wasn't good. At current growth/decline rates and given the age of the congregations, people are actucally predicting when "the last Anglican will turn out the lights," and I don't remember the exact year it stated, but it was just barely beyond what (many of) our expected lifetimes would be.
There is a nursery for that... there are many rooms in God's house.
This attitude, by and large, has led people to simply not attend church at all. If I have to sit in a nursery with my son or daughter for an hour at church, there is absolutely no value or help in me attending at all. I can pray and read and watch them in the comfort of my home and request communion be brought to my house once and a while.
I find that the old-school churches (Anglican, Catholic, etc) are slow to respond to the change times. Nowadays both parents are often working, children are enrolled in far more "out of the house" activities, and as a result time as a family (for worship or otherwise) is far more limited. Not only is spending an hour and a half in a sequestered nursery completely useless, but these days it's a very precious hour and a half. It will either be time that could be spent enriching our family life, or maybe even time where we are already exhausted - and if you have the option of being exhausted while attending to your kids at home or in a nursery outside of your home, you'll take the home option.
And not all families demand free-run toddlers and babies all the time. A huge problem I have observed is a total lack of infrastructure. If we attend church 4 times a month, we'd likely have no problem leaving our kids in a nursery a couple of times a month if it was supervised, or if there was some form of church-infused childcare available. However, in our experience that is considered "pandering to young families at the expense of others," and the resources are not made available. We return to the expectation that the parents and toddlers can wait outside while everyone conducts their "worship" with "reverence."
The result in 3 churches I have attended long-term who have taken the above attitude is absolutely no young families (maybe I should say 2 churches...my current one there is still one family with toddlers left - mine).
They come, and within a month or two, they go. They know where and when they are not wanted.