I have no such problem with OG Alps switches, it's a problem specifically with this one keyboard that has Matias switches. I don't know if it's specific to my instance of Matias switches, or all Matias switches.

Considering I have tried to remove the tactile leaf and swap the spring, I think there might be something wrong with the other leaf (contact) or housing. I have tried the same things with OG black Alps from Dell AT101W and while I didn't like their stock feel either, linearized were good to me.

At this point, I'm either missing something, or need to replace housings: either by newer Matias, or OG Alps. I'm trying to figure out, if newer Matias will work, because of backlight (they're transparent).