I definitely think that it's not necessary to like the artist as a person (or their public persona) or agree with everything they say in order to enjoy their art, if that's what you mean.

But if you mean that you actually feel hate for someone you don't know personally, who hasn't harmed you in any way and who, as far as we know, hasn't committed any crimes, while continuing to listen to their voice and lyrics - yes I do find that contradictory. Not sure why you would expose yourself to things/people that ignite hatred in you or how that would even work in practice (do you use a device to cancel out Morrissey's voice or just listen to the instrumental tracks?).