I think the extra zest of this kind of attractiveness is that he is in a position of power in all these circumstances, but he doesn't abuse it or even use that in any way.

Interestingly, my father was a doctor and he was exactly like that (though he was quite conventionally attractive). It was a different time back then and he was able to bring that kind of charisma bourne out of warmth and patience to all aspects of his life. Waiters were always falling all over themselves for him, we never sat in the seats we actually paid for anything (baseball games, theater, the circus). Even bankers would take him off the line to give him their full attention in their offices for small transactions.