Well do I have bad news for you... The joycons are the weakest part of the switch, they also seem to be the part of the switch that hits the ground first when dropped. In every video I saw of them being dropped and all that, it was always the joycon.
With that being said there's obviously no tests but I'm going to assume that the joycon part is still the weakest part of the system. Anyways since it's all a single part, if it breaks it all breaks.
You also lose out on some of the switch titles. Any game that may need the dock or tabletop mode isn't an option. No Mario party, no multiplayer games with friends together, and all that good bonding stuff.