I am inclined to think saner minds in Congress would prevail to oppose an unsound Trump and remove him from office.

That isn't the worst case scenario. The worst case scenarios is that Trump isn't an obvious dictator, but makes it far easier for the next president to be one.

Consider: The Supreme Court attempts to prosecute Trump. Trump and the GOP successfully paint this as a partisan attack on Trump by a liberal court, since the American public does not believe Trump is corrupt by a supermargin. Republicans in Trump rally around Trump because the environment is highly partisan and the country is polarized.

Trump successfully ignores the Supreme Court. Half of the public supports him, and the reputation of the court is greatly diminished. For the military to try to remove him, it would result in open civil war with Congress and half the population supporting Trump.

Trump serves out his 8 years peacefully. His legacy is that the power of SCOTUS is greatly reduced. In the next generation, a similar demagogue President can now ignore SCOTUS much more freely, since the precedent of increased Presidential power is now set.