Pipewire multi-source sound skipping

Hi,

To report and maybe discuss an issue. After upgrading to 22.10 (moving to pipewire) I notice a problem where if I listen to something on multiple sound sources one source gets sound skips.

For instance. I am listening to youtube videos on firefox and open and play some video in VLC. The VLC sound will have dropouts.

Is there something I can adjust to help this or do I have to go back to pulseaudio?