Ok well assuming everyone is ok with this ooc and are good friends, you could easy have your character very hurt. You could voice this to the group and depending on the relationships in the group (I recall the barbarian apologizing) maybe this could be one of the first times your character has opened up to the group about himself or why he is so obsessed with the key. You could take it the vengeful route and explore your characters quest to exact revenge as he was just violated by his traveling companions, and like you said long con them and hurt them.

Personally, I’m not one for openly hurting the group for a prolonged period but the idea that this gives you a chance to forgive and have the group open up about the concerns they had (since I assume they had a reason for doing that to you) and you can connect with the other characters and strengthen the bond you guys have through dialogue. It’s not uncommon for things like this to happen in the real world and have a sit down talk that ends up making you better friends then when it started.