I always hate teams that say to rebuild. Tell me how those expansion teams that did well. What did the beginning Jaguars and the Ravens do, that the Browns can't? I always hated the rebuilding process. I'm pretty sure the OL and D-line are always the starting points. Why not start there? I never understand why these teams don't look at what they're doing wrong and fix it. Even building a team around a veteran QB and attempting to go to the playoffs would be a step in the right direction.
I've been looking at their pro-football-reference site and I see one thing unfortunately rising above the rest. They almost never have a good offense. Since the start of the of the Bill Belichick era in 1991 they've had 4 seasons of top 20 offense in points. 2 of which led to playoff births and 3 winning seasons. They've had some years of above average defense, but never scored enough points to change that.
The Browns need a better GM and Coach because using Rookie QBs to change the offense without a veteran backup to teach them is just plain stupid. To win, you have to have a good supporting cast on both sides of the ball.