Surf brands only exist to sell merch to non surfers who have an idealized lifestyle in their head. With that said most of my t shirts and shorts are surf brands because I can get them for $5 a pop when I get a new wetsuit at warehouse sales. I would never pay sticker price for surf brands.
Hybrid shorts were a cool idea, and all brands seem the same to me. I have owned a number of them, but would never intentionally go surfing or even swimming with them. I can already fit my phone and slim wallet in the single pocket of my normal boardies.
Patagonia is known for quality and mostly ethical sourcing compared to others. They also have a lifetime repair warrenty for all their clothes.