No, not for that reason alone, that would be just part of the "totality of the circumstances." The major points he'll argue would be that he and his wife were living in NC and you started calling her there and breaking them up and luring her from NC to Alabama. Those treacherous phone calls were contacts with NC. And he'll probably say you were grooming her to leave him way back when you lived there (if they were married then).

Look, you've got an argument that there's no jurisdiction over you in NC, it's definitely something you and your lawyer should argue because it disposes of the whole case if you can win that argument. But my guess is that you may be on the losing side of the jurisdiction argument.