I actually grew up in scarborough so im going to give you a different perspective... There is 2 different Scarboroughs where people on one side don't really see the other. You living by the zoo is almost Pickering and barely the core of Scarborough, you can hop on the highway and literally go anywhere without having to see the core of Scarborough. The Scarborough I grew up in is Markham and Eglington, Galloway, Parma court, 400 and etc. These are hoods and spread out throughout Scarborough, as a kid we had to take the ttc and go around these areas where you could actually get shot for no reason, I would see robberies on a daily basis. I can go back now in my late 20s and not really feel threatened but I'm not there everyday just occasionally pass by to get food which is the same for someone like you. Living in scarborough might be an enjoyable experience due to your circumstances but I would not raise a family there as your kids will be exposed to the Scarborough mentality one way or another, maybe not in grade school depending on your location but high school in scarborough is a really shitty experience.