Financially, I'm fine!
You and your wife are supposed to be a team. So it's a bit concerning that you mostly mention "I".
I just enjoy the idea of a motorcycle because of the freedom while riding it. Speed is not a concern with me.
Just look at statistics and the accidents that happen. Even if YOU're not the one speed driving, you're in a vulnerable position. Especially with a kid on the way, you should make sure that your wife and kid can survive without you (in case you will go through with buying/driving a motorcycle).
Also, I just love how aggressive the challengers look. As I said before, speed is not a factor, but it's nice to know I can get somewhere when I need to.
Again, you didn't answer my question. Would your family be able to live without a car? If you have a baby on the way, I'm not sure why a Challenger would be your first choice right now.