There is really no point unless you're trying to become some kind of scholar. You're not going to use all the kanji to begin with, and out of those you're only going to use a fraction of the readings.

Native speakers' vocabularies already have gigantic differences. In many languages some native speakers only know about 3,000-10,000 words, while others know in the range of 50,000-90,000. As a learner of a foreign language, you can already reach a quite solid degree of everyday fluency between 1,000 and 2,000 words.

If you're going for all kanji with all readings, you're learning what would normally come with an extremely high vocabulary in an out-of context fashion without even learning the according words. That's ridiculously inefficient. Also the patterns in which readings are used are often difficult to understand through logic, while an intuitive understanding grows naturally.

So learn as much about the kanji as you need to tell them apart, and then just learn a lot of words. A sense for kanji readings will come naturally.