Why would he (let alone I) have to feel shame because of how others judge a ridiculously unimportant and genetic trait like height? The people who feel the need to create insecurities in others to make themselves feel better are the issue here.

His personality, his behaviour and his kindness are what would give him worth in my eyes and make me proud of him; not his height. Likewise, I'm 5'9" and have dated a 6'4" man just like I've dated a 5'6" man. I couldn't care less about a partner height, it's not an important factor to me - romantic attraction, an emotional bond, shared passions and interests is what I look for in my relationship.