Being privileged doesn't automatically means that you don't acknowledge it, or hate civil rights, or want to go back to slavery. You don't even have to come from a super elite background to be privileged.
Privilege is benefitting from the situation of your parents basically, and benefitting...