Everything is physical. Literally everything. I don't know why you're implying that the scans would not reflect the mindset of a person. scans show wildly different results when someone is eating food vs writing for example. It's all physical. if you associate with women more, you're building momentum to be more relatable to their observed patterns and behaviours. Mirror neurons so to speak. yes, that IS physical.

Are you claiming that the bed of the stria terminalis develops differently in men and women because of societal gender roles?

no of course not, because none of the evidence would show that the stria terminalis grows in a female body the same way it does in a man's body. Ergo, the idea that you would be born with a mismatch is purely a psychological phenomenon.