I also remember 1 comparing Ian and Barbara seeing the TARDIS to "the savage Indian with his red skin" seeing the steam engine, but the issue isn't whether or not he said things that are problematic, the issue is how his portrayal in TUAT fits into his arc.

If TUAT was supposed to take place right before 1's regeneration then he shouldn't have still been the hardheaded old man who occasionally spouted some very 60's views, he should have been the man who had learned to let go of all that because that was his whole arc. His portrayal in TUAT makes it seem like he learned nothing at all throughout his lifespan and that's what does his legacy a disservice. It'd be like if at some point in the future Capaldi died and another actor was brought in to portray the end of 12's life, but instead of portraying him as he was near the end of his arc when he finally realized that he was indeed a good man who could still save people, they chose to portray him as he was in the beginning when he had to read from cards just to talk to people.