Why Ward Boundaries?

Honestly the entire concept is a myth to me, at least from my experiences. Because of my work schedule/weekends and nightshift, we've bounced from Ward to Ward, sometimes in different stakes, while still having our home Ward. Nobody really said anything and it didn't affect our membership, except not really having callings. I feel like any bishop or stake president who says you have to attend your home ward or your membership could be in jeopardy or you could lose your temple recommend, etc, is just a flex of authority, but doesn't come straight from the top? I'm only speaking for my own experiences and those of close family and friends. Any experiences where the opposite occurred?

/r/exmormon Thread