Had to make my own portaudio and rtl-sdr binaries. The available packages weren't compatible somehow. Also wxWidgets wxPack doesn't include OpenGL support but it's easy enough to compile.
Each now on it's own canvas with shared GL Context