I feel I'm prone to this anxiety too but I also believe experiencing psychedelics (especially at the beginning) really changed me for the better, though subtly, through forcing me to confront situations where I had to completely surrender myself to something impossible to understand: buy the ticket, take the ride as they say.

That may not sound like a glowing review but I've really never had a bad trip... it's not always euphoric or profound either in my experience, though it definitely is at points (and really the worst I've ever had is falling into thought-loops but it's not hard to break out of those, take a walk outside or drink some water etc.) though I absolutely recommend trying it if you're otherwise okay psychologically.

Doesn't have to be a full tab either, you can work up from 1/4 or 1/2 (just wait at least a week for tolerance). As others mention I second having a friend as a trip-sitter, but it's not necessary and I did fine on my own (plus I think being able to really learn about it on the internet definitely helped initial confidence). Anyway this has devolved into a wall of text, but I hope at least my anecdotal evidence can be helpful.