He wants me way more than I want him, unfortunately. I do like him, but I wouldn't say its proper love at this point.

I usually try to avoid thoughts about what one "should" feel and instead embrace the good in the present with an openness to further growth. Circumstances will determine the level of possible "love" moreso than an arbitrary timeline. Also, it's okay if one of you is more into the other, just be honest with him about where you currently stand and where you think you might get to.

We cant make proper conversation that's on the level of banter I personally like.

This part seems the deeper flag to me. If you two don't engage too well conversationally, I doubt there's much long-term compatibility there. That said, I agree with /u/TaTaToophy that, as long as you're honest with him about where you stand, maybe you guys can still enjoy a fun, more casual relationship together.