Those are fair points. My initial thoughts:
Your fourth point led me to another issue too--we would be taking the popular vote into account to skew the Congressional vote. Would this skew the vote unfairly? Could it give unfair power to a very dedicated, politically-aligned minority?
Suppose in this system we have strong voter suppression and apathy. Suppose 40% of constituents form a voting bloc that elects a minority party that has perhaps 40-45% of the seats in Congress. By combining the popular vote with a congressional vote as described above, it would be possible for the minority party to pass legislation without the majority party having any say. We could end up with minority rule.
Perhaps tweaking the rules a bit would help? Instead of citizens directly voting, perhaps each state forms a voting bloc, and the popular vote can override politicians' votes. Going state by state presents additional feasibility challenges though, in that it would either require an even more dramatic change in our voting system or would dramatically slow down proceedings when senators' votes are disputed.
---
Thanks for the feedback. It seems this concept would need a lot more consideration, but it still might have merit if these weak points can be addressed