As the other commenters have said, this guy is manipulating you and using emotional blackmail to keep you attached to him. Block him and don't look back, don't feel guilty, don't feel like a bad person because of it. His intentions aren't honest and he's constantly trying to influence you into getting into a kind of relationship you don't want.

In the future you might take this as a pretty handy lesson. Be kinda wary of accepting money or gifts from people, invariably they will want something in return and invariably it will have a high cost. They will expect you to pay it back at some point. Not all people, but enough to be careful about these kinds of things.