It really doesn't matter. Things that don't give a direct income do need to be built. We have 3 options:
this is one view and there are others. Each society decides what it wants and what it can have depending on the hand it's been dealt. For example, Saudi Arabia had no income taxes or debt for a really long time since oil revenue was rolling in. That is slowly going away. Resource poor places on the other hand have always needed someway to make money for these things. In the past it was by owning the mean of production (state run banks, companies, post services). As that goes away some other means are needed.
NB: there is of course such a thing as too much debt or unnecessary debt.