Im in the same boat. I enjoyed the game, but with friends being all over the place in terms of levels/factions/playing time, it just kinda whittled down until I unsubbed. After all, Ive always had an on-off relationship with WoW, which I always seem to come back to (if even only a few months at a time).
After re-researching the game in hype for buy2play, I did realize some things Im not a fan off, though. In my opinion, the game just has too few classes. Yes, it has a lot of build diversity which basically are custom classes, but you only have the four mega-standard baseline archetypes (tanky melee, jack-of-all-trades, stealthy and spellcaster). I know the builds change this, but just the idea of having to be a "nightblade" which uses dark magic (even if you dont use those skills at all) instead of just a neutral "rogue" or something is weird. Same goes for Dragonknight. It sounds dumb, but I kinda wish the classes were more baseline to begin with. Like, I could have the option to be a heavy armor warrior who jus smacks you with a huge axe. Yes, I know you can do that, but the minute you have to use a class skill, Im not a warrior anymore, but a dragonknight who breathes fire and has wings.
I guess what I mean is that the four classes are based upon the more fantastical versions of their archetype, which isnt necessarily common for a Elder Scrolls environment. Youre not a mage, your a deadric sorcerer. Youre not a warrior, youre a dragonknight who lives and breathes fire. Youre not a rogue/theif/agent, youre a spellsneak nightblade with dark siphoning magic. And then you have the templar which is the typical paladin "jack of all trades, master of none" blindlingly flashy yellow magic weapons class.
I guess this is the reason Im basically only looking into stamina 2h/bow builds atm... It will probably change as I play more and get used to it, but my previous point, plus the different style of combat (Im used to the spamming of WoW and SWTOR, while ESO is paced more like LoL/DotA2 in MMO form, especially at lower levels where you dont have a lot of resources.