I plan to invest in Hawaii since I live here. While the market here is expensive, ...

Investing in what you know makes good sense, but consider what would happen if everyone thought like you. If Hawaii has a relatively large number of wealthy people, and they all try to invest their money in Hawaii, then they'll end up bidding against one another - and pushing prices too high. I'm not really telling you what to do, but that's something to consider. Learning something/somewhere new may be worthwhile (and that's probably what professionals are hired for).

I don't want to squander it.

Great priority. The two main ways of squandering are 1) spending, and 2) theft/mis-management. So:

1) Don't spend it. With that kind of money you should never touch the principal for your own use. It'll generate more than enough income to life off of forever - if you protect and preserve the principal.

2) Protect the principal, which brings me to:

I looked through the last 3 years and while they have had OK returns, over the last few months I've taken $100K out and invested it on my own making much more returns percentage wise. Should I take more control of the investments?

You should definitely watch your money closely. You're not used to this kind of money, so you need to spend lots of time merely learning how to oversee the people who manage your money. What are the doing? How is it invested? What are the objectives and the means thereto?

Maybe their #1 priority is the same as yours: "I don't want to squander it." Their relatively low returns may be 100% necessary to preserve the assets... and the returns you made on the 100k may be unsustainably high.