It depends on your own resiliency. Do you think you can handle a trip that manifests your worst fears and worries? This is why people tell you to take into account set (how you feel) and setting (where you are) because shrooms amplify everything you are experiencing exponentially.
If you do it, know how to meditate or have some benzos on hand and a trip sitter because your worst nightmares may come to life with the wrong mindset.
On the other hand, it's possible that you might have the best trip of your life or you push through the bad trip and learn something life changing and invaluable.
In the end, it comes down to whether or not you are ready to struggle and accept whatever comes your way. If you have this mindset, go for it. If not, don't risk it.