While it's great when players take notes (I have a couple who take very good notes - helps me out too, if I'm being frank, with names and small details I forget myself), I don't consider it a matter of respect. Some people are in the game in-the-moment, and I expect as the DM/arbiter/author of my game to have to remind my players of certain events/details, big or small, cause obviously I'm more familiar with it (and I think that's easy to take for granted on the GM side of things).

If someone is routinely so checked out that they can't retain even basics about the game, that's an issue or cause for concern, but I don't hold note-taking (or lack thereof) against my players.