We've always gone to midnight Mass, and will this year too...with our 8 year old, 6 year old, 2 year old and 5 month old. :D
It's certainly not easy, but create great, great memories.
We keep the two oldest up, but let the two youngest take naps...they'll sleep through it anyway.