Strange as it may seem, I think Rafe has been given a lot of slack, even after a lot of what comes across like boasting of how much of his social philosophy he is putting into the show.

To put it in Randland terms, the reactions so far have been like when Elayne pokes Rand in the ribs with the One Power, or Egs tweaks his ear.

Give it a few episodes, let people get an idea of the general groove of the show. Then we'll see reactions akin to when Moiraine clocks Rand a good one with the Power, or when Nynaeve boots Matrim in the rear end.

Then give it a few more, let people see the first ripple effects of changed lore. That's when you'll see reactions reminiscent of when angry Far Dareis Mai beat the ever-loving fuck out of Rand.

This is my guess, at least.