I definitely recommend talking to him about all of this.

From what you say you're angry as your younger self and the couple you both had then in making what was an mutually agreed decision. . That while it was right for the 19 year old you and the early relationship you are also holding onto pain from it. ( it can have been both the right decision and a painfully hard one afterall)

The conversation should be honest and open and maybe with a professional too. As it could be a scar, mis directed self angry etc

Overall in the relationship that needs healing or walking away from and only thought being 100% open can the relationship between you to get stronger or less hurtful.