I started playing during Kazuha's 1st banner and decided to skip him for Ayaka AND Yoimiya AND Raiden. I'm going to skip Kazuha again. I can easily 36 star (max possible) Abyss every single rotation.

Kazuha is a good unit, but it's just that, a good unit. The thing about Genshin is that there are A LOT of good units. You are definitely NOT going to suffer if you skip Kazuha.

Pull for who you like more. I personally ADORE my Yoimiya and she's a staple in my team (along with Zhongli). You're leaning towards Yoimiya more so go for it. If you're somewhat confused then try out Klee in her trials as her banner is before Yoimiya. Some people find Klee's kit clunky so have a shot at it and see how you feel.