I don't understand what you mean by "people who don't want to be there". Anyone who ever raid wants to be there, just for different reasons.
We were just talking about people that might have an interest in doing harcore raiding for the story, but didn't necessarily enjoy it. I am one of those people. Were I in a static and able to make the sort of time investment it requires, I'd more than likely be able to clear that content, but I don't really enjoy it. I don't like feeling like I have to log on at a certain time or I'm letting people down. I don't like bashing my head at a single boss for weeks on end because my group just can't clear it. And yet, I still like the story of things like Coil.
I tried in coil. I did. I cleared T5 (sadly, just after echo was added to it as I couldn't find a static previous to that) I found that I really didn't like what the game turned into when I felt like I had to play it. I wasn't enjoying myself. I eventually gave up and just watched the cutscenes on Youtube. You think it hurts the story to not have the fights be very challenging? Try not doing them at all, and in fact not even seeing your character in them.
Is it so wrong to suggest that people like me should be able to experience the story in-game without having to devote hundreds of hours to content we really don't like? It's not like seeing the cut-scenes gives me some in-game advantage.
In the same vein, nobody wants to do Garuda HM hundreds of time for the relic or kill adds infinitely in Diadem for 210 gear, but people do it anyway because they want the rewards.
These are both examples of poorly made content. Relic weapons were/are unnecessarily grindy. Basically no one likes Diadem, and thus very few people actually still do Diadem.
Even if you dye your gear, having everyone else wearing the same gear as your hard-earned "reward", just with a different color, really cheapens what you have.
Sure, if you only value something because other people don't have it.
friends I have who don't see a reason to raid because they've got the glamour they want.
People that literally only raid for glamour and not because they enjoy raiding are also people that shouldn't be raiding.
The only people in hardcore raid groups should be people that have fun with the actual content.
In fact, there should not be content that no one finds fun. If SE designs content for the game that nobody enjoys, they have failed. Adding an awesome reward doesn't change the fact that they made content that isn't enjoyable. Diadem is actually a great example of this.