Well maybe OP will respond?

I can only speak from my experience. There are plenty of people in multicultural towns who are racist and scared of muslims. You see, some people don't integrate.

In my town the vast majority of schools were around 50-70% muslim. I went to one of these schools don't feel any hate or fear of brown people. However, there are some schools (faith schools mainly) that are still very segregated and generally either 95% white or 95% asian. Now, people who go to these schools don;t seem to always grow up as tolerant as those children that went to schools which are more integrated. I have literally seen friends and family grow up in the same town, same age, but go to a different school and turn out completely different (i.e. full of hate and fear).

Personally I blame the parents that send their kids to these completely white or asian schools where there is no integration.