Honestly, while I don't think that it's a good idea to beat up Nazis for practical reasons...yeah, they absolutely do deserve it. The only thing stopping them from doing a hell of a lot worse to completely innocent people is a lack of power and a fear of consequences.

Freedom of speech is a good thing, but there are ideologies that it really shouldn't be extended to. Not very many, but it's not hard to draw a sane line in the sand where ideas on one side are considered to be both extremely dangerous and completely without value to society. The marketplace of ideas is great, but no one's going to let you bring mad cattle to a livestock auction. Nazism isn't like a shitty tax plan, or even like most other extreme ideologies, where there's some kernel of sanity even if the idea isn't practical or is dangerous on the whole. It's an idea that mutated from other, more normal beliefs in the late 19th to early 20th century, like a cell turning cancerous. It contributes nothing, and even if it's harmless now (or at least unable to gain control of any real power), we've already seen how quickly that can change in a crisis. Once you flip the hour glass, you can't stop the sand from running down.