That would be pretty interesting considering that society created those rules. And as this is not really a practical consideration - does not matter. Well, you are just choosing not to consider it, it absolutely have devastating practical consequences.
I don't get why you think society can not be wrong about rules it creates. If govt declares two stick added to two stick totals five stick tomorrow and everyone who disagrees goes to jail, it still does not make it right.
The fact you don't agree with the rules really doesn't matter on bit and it does not make the punishment 'invalid'.
2 + 2 = 4 is just as valid as 2 + 2 = 5 then ?