It's not about whether a person objects, but whether the actual comparison is valid. For example:
Hitler/Nazi Germany to Pol pots Cambodia: Both included genocide, a charismatic leader, facism, torture, work camps, etc. VALID COMPARISON.
Nazi Germany to abortion; both are gov sanctioned...