Unless we are our genetic make up, in which case we do, at least in part. Any sensible definition of "self" has to include in a way or another some of the factors, such as the brain or genetic makeup, that make up our decisions. If it doesn't, you're working with a "self" that's basically empty...