Lemme guess. You, like me, are white, from the majority Christian culture if not actually religious and don't get affected by the biases in the industry in quite the same way that OP experiences it.

Here's the thing, though. While I have my reservations about it, bias undeniably exists. There are people out there working to raise awareness of diversity in fiction and try to fix it (#OwnVoices), but it's a process which isn't helped by white writers digging their heels in and denying there's a problem, or saying putting POC in their books would be tokenism or ruin their previous story all about white dudes, or whatever. Those are just excuses not to have to deal with the situation.

For instance, for a while I said 'my story is about a European-style society. The ethnic tension in my book is white-on-white. I don't need to put POC in my book.' But let's face it. The demographics of America, one of my biggest markets, is now, what, 40% non-white? So by not acknowledging POC exist, want to see themselves reflected in modern fantasy literature, etc, I actually did make a few significant characters non-white, and it works within the context of the story. As a fantasy writer, I can make shit up. I can put women in positions of power and have a female cardinal. I can put significant non-white communities in a north-eastern European city. I can write what I want, so if my market is asking for significant POC characters, I can damn well have significant POC characters.

It wasn't a change which affected my story, my ability to write the book I wanted to read, etc. If you fall back on the 'I don't need to state race, people can imagine the characters being whatever race they want them to be', then you're just adding to exclusion. Most white readers probably will assume the characters are white. Most POC will assume the author doesn't care enough about them to add diversity to a book. If you come out and mention that your characters are dark-skinned as a matter of routine, guess what? You're acknowledging non-white people exist and irl people get to see themselves represented.

What you're saying is, effectively, you're 'colourblind' and you refuse to feed racism by acknowledging it. However, you might not feel the effects of racism or Islamophobia, but see it happen on TV and wish it didn't exist, but that doesn't change OP's reality where it does exist, where Muslim writers may not get picked up for thrillers or have to change their name, where characters are always assumed to be white, where there is a distinct bias against etc.

If you loftily say 'I refuse to feed bias' and ignore it, you're actually ignoring the people for whom it's a real thing.

If you really did want to rise above bias, acknowledging it is the first step to dealing with it.