Sorry it is: Except for maybe sports involving horses, golf is played by a certain demographic far and beyond anything else. The only "group" of people I know that plays golf is finance people, doctors and retirees. My dad plays golf, has even when he was working construction. However, he seems to be the last of his breed. Yah is this a generalization, sure, but when I get paired into a group, that is 90% of who I get paired with.
For example: Golf Magazine Covers with the exception of Tiger, they are all white guys, much like the group that plays.
Here is a graph of average golf demographics
Average income of regular golfers
Again, another graphic on golf demographics
So while you maybe be able to pickup a set of clubs and head out reasonably cheap, to "get into" the sport you are usually fairly well off, male and white.