I workout 6 days a week for 2 hours. It is a HUGE part of my life and I'm not giving it up and I don't think you should either. I don't think you're exercising too much. Definitely make time for old friends, but it's much easier if your friends/family understand what you're going through... maybe you can get them gym passes to see if they want to come with you to see what it's about. You can always incorporate outdoor activities to do with your family that will count as your exercise. Maybe you guys can go on a hike, play some touch football in the park, sign up for a race (like a bubble or mud run), play Just Dance on Wii, just anything active... bring them into your world.

Also, as I'm reading this, I'm thinking about my own transition from having regular non-gym friends to having gym friends. I'm telling you, it's better to have friends that also like to workout. You're in another world now. You can still have your regular friends/family. But let me tell you, it's much better to have friends that also understand your life.