Opportunity cost. Each time they use to teleport, they forgo an attack (maybe except the Eladrin, depending on its build). The Barbarian can only attack once instead of twice if it uses Ghostwater Dive. And from personal experience, it's uncommon for enemies to be damaged by the Fiery Teleportation if the druid is using it to teleport itself.

Also, ranged attacks. All of these short-range teleports have the requirement that the destination must be a space that the players can see. More often than not, if the players can see the space, the enemies can also see the space. Which means that enemies with ranged attacks should still be able to target them.