It didn't pick up all of the displays right away upon setup, but plugging and replugging the DP cable sorted itself out
Update: It seems like this is a reoccurring issue that happens when waking up from sleep (or powering on). (Not sure if this is Apple or CalDigit's to blame but external display support on macOS has been spotty at best for the longest time soooo ...)
I'm gonna try throwing BetterDisplay at this mess and make an update on how it went.