I understand you both , i know that no one should force the other to do something and you both messed up at some point.
Men generally feel bad when those stunts don't succeed. Just give him time to let this awkward situation go and if he really likes you he will come back but when he's going to come and apologize don't forget to say that it was a bit silly of you to stay at a guy house and not expect sex.