Its fine.
The kinds of crime I heard about are the exact same as anywhere else you might visit. Paris, NYC, Rome, etc. all have bad actors, but the Colombian government has taken extra steps to keep the tourist areas relatively clear of like muggings and shit.
And once you leave the cities, the people just get nicer.
The one time I thought I was being scammed/taken advantage of, it turns out my Spanish just sucked ass and I was actually getting a 3 course meal for about $3.
I went to tiny ass towns, up to the mountains, in the desert, etc. and it was perfectly fine.
It kind of blows your mind how things work. Like, you might need to just wait around on the side of the road for a bus to come by and pick you up. And as a solo traveler with only a loose grasp of spanish, I was sorta worried at some points... But I was never done dirty. When the bus driver tells you to cross the street and just wait for another bus, without any signs or indication that you are in the right spot, they aren't bullshiting you.
Or if someone says, 'just wait for the 'guys in the pickup truck and pay them 10 mill' and they'll take you into the desert. They mean it.
I highly recommend you go. I accidentally showed up during the 'Flower Festival' in Medellin, stayed for 4 days, loved every minute of it. Left for 3 days, and said "fuck it" and went back for more of Medellin. If you can plan to go during a festival like I did, you'll love it.