First, there is absolutely no rational excuse for a pig like that to make any woman feel threatened. I'm sorry there are people like this in the world.
Second, I'm not a woman so I can't even guess what it would have felt like to be in a situation like that, but if it had been me in your place and he pulled up, parked, stared, followed, etc, I even as a man would have been uncomfortable as well, so you're not alone.
You said he parked in front of you. I would have backed up 20 or so feet, just to make the point of "you're too close, a-hole." If he backed up I would would have moved in front of him. If he moved back in front of you I would have turned the car around and pointed it in the opposite direction.
You said he then got out and stood at the back of his truck, which at that point means he would have been standing in front of your car. I would have laid on the horn and not let up until he left or someone else showed up to find out what all the noise was about.
When he followed you, you should have led him right to a police station.
Consequences are the only thing these people understand. You let him control the situation; you needed to take control. Point/counterpoint... none of anything I suggested above would have ended the situation immediately, but all of it would have been different than the way he wanted it to go, and THAT'S how you take the power back -- by not letting him have it in the first place. He had the power because you let him dictate where he was going to park, where he was going to stand and stare at you and he not only dictated when you left but also where you didn't go as well, which is to say that you didn't go fishing and you didn't go home.
You have all the power and courage you need, you just need to stop reacting to him and start making him react to you.
Peace.