Guildbrook Farms on YouTube brought up another point that in the end encouaged them to move to their own perfect piece of land. They lived in a mostly rural area that had new developments in recent years, with property values in the millions. It wasn't nearly as populated there before these developments. Those properties influenced a neighborhood covenant that was reevaluated every 10-15 years or something. The covenant restricted the allowed livestock and prevented them keeping goats. They never knew about it until someone pretty much told them to get rid of their goats. It's all on their channel, probably in their "what mistakes we should have avoided" type video about 1-2 years ago.

In short words, speak with the neighbors before buying if possible and check for any neighborhood covenants or agreements that would put restrictions on your land.