I've played 250 games on Teemo with 8/10 games building AP shroom over on hit: https://na.op.gg/summoners/na/taehe%20is%20faraz
Here's my take:
Bottom line - can you make AP Teemo work? Absolutely. It's all subjective and I really think it comes down to playstyle preference, but with the current meta, PTA is probably the most "optimal" build at the moment. I put that in quotes because it doesn't necessarily mean all the time. For instance, you're not going to be able to proc your PTA or get a lot of free hits on a Malphite during laning or say, Ekko jg.