If the victim identified you and called police, you might be arrested or issued a summons for the violation. You would then prove it was accidental/unintentional in court. In truly accidental cases, especially if the RO'd person immediately leaves upon realizing the victim is present, it would not be considered a violation of the order.

In places where both victim and RO'd must be in the same place at the same time, the RO'd must not make contact with or otherwise engage the victim.

However, it's a common tactic by stalkers to continue stalking the victim, and then plead ignorance in court. So it's best to avoid any areas where the victim was known to frequent, and quietly leave immediately if you do see the victim.