No, it can apply to both or to any group. There are still important distinctions. One is related to an ideology and another is a religious ideology. Large segments of the KKK were dismantled by people befriending them and reasoning with them. Doing this with the religion of peace is tremendously more difficult because of all of the effort that has been put into the religion to prevent people from deconverting. Not to mention the huge number of people who think there is nothing wrong with their oppressive religion which is allowed to openly flourish in western countries. The problem with the "white racists" is that right now far more people want to see their heads on spikes rather than engage with their ideas and reason with them. They are the only ones willing to talk about certain topics that most others are not. Especially with these issues, there are people who have poisoned the well of discourse, because it is politically useful for them for people to not engage with the "white racists" and to view them as evil in totality without listening to what they actually have to say and responding to them.