Everybody deserves the right to speak their mind without fear of repression by the government.
Everybody has the right to call the speaker a fucking asshole if that is what they are.
Everybody has the right to eject someone from their space based on what they say. That's why we call it "their space".
A no-platform policy is not a violation of free-speech because a university union is not the government.
Different rules apply to the government versus private individuals and organisations because the government is supposed to be representative of "the people", rather than a private individual or organisation representative of a limited number of people.
Fascists are scum, and I should not be forced to quietly listen to their million-times-refuted ideas without speaking up myself. If I shout "fuck you" at a fascist when he says he wants me dead, I am expressing my free speech, not silencing his.
If I stove his head in with a rock, I have committed murder, and I will be put in prison. Many people think this is good/bad/whatever, but I have not violated his free speech because I am not the government.
Does that help at all?