My opinion: Go ahead and leave that government job but first find a job that is closer. That is a rough commute. I understand your debts but that commute is going to take a toll on your mental and physical well-being.

Look at it this way: You got your first job offer in the private sector so you know you've got options. Now, keep applying and find the best private sector job that will pay more and have a closer commute.

As for leaving the government world, that's leap many people don't want to do but only you know if it's worth it. I'll share my personal experience: I left a government job making 82k, I paid hardly nothing for Healthcare, vacation accrual with the years, State pension, not too bad of a commute. Sounds pretty sweet right? It was fucking hell. I worked under an elected official, hours were 60+, always on call, boss would bother me on days off weekends for stupidest shit, passive aggressive boss, toxic coworkers, etc. It had taken a toll on my health that I quit it. People were shocked that I left such a coveted position, but it was the best damn thing I ever did. Took me like 6 months to shake off the crippling anxiety and moods that had taken over me. It was completely worth it to me. So, if you're thinking "am I making a mistake?" You have to pick mental health. Always. If you're mentally okay, you will find a way to muster strength each work day and work to paying off your bills. Won't be easy, but it'll be harder if you're mentally and physically sick from being at work. Good luck.