If you don't feel safe, then no. Be open and honest about it. Better to address it tactfully ahead of time rather than to avoid it and let it reach a boiling point. If it does reach that point, then let it go (as in move on).
Personally, I don't think it has to be a friendship destroyer...two reasonable people can reach a friendly compromise on quite a lot of things. You could always remain friends and agree to disagree, but if it's a true deal breaker than that doesn't sound like much of a friendship. If you feel strongly about it, then make these feelings known in a clear, concise manner that conveys your best intentions.
It's important for people to remember that this (covid) brings about intensely painful personal experiences for many people. Asking for a bit of compassion and understanding isn't unreasonable.
Best to be upfront with it.