people will judge you for just about anything, but ill tell you a quick story.
2.5 years after college i could not stand my office job at all. I had a plan to make some money but wanted to go traveling for a year or so. I was nearly suicidal at the time.
When i quit, i could definitely feel everyone judging me, the change of perception, etc. Anyway, I left to travel for a month every few months. People kept asking me what i did, etc. etc, when i would get another job, blah blah blah.
My plan to make money on my own started to work.. and extremely well. However, a friend of mine talked to a professor at my university and told them what I was doing. upon hearing what i did, there response was something on the lines of "Well i thought he was much smarter than that, that's too bad". Kind of disheartening... but I made $100k+ that month alone.
So since then i don't give a damn at all