Sound drops when streaming from Windows

Hi there,

I purchased Parallels to use a Windows-only headset that has active cooling (HP Mindframe) because in summertime, my Sony WH-1000XM4 get really warm. I got it all working now and the setup was a breeze. So now I am streaming Spotify from Windows 11 while working in OSX. Unfortunately, the sound from Spotify drops very often: sometimes when I switch a window in OSX, or when I switch a tab in Chrome... or sometimes when I do nothing. It drops for a really short period, like a tenth of a second but it happens to often to listen to music "pleasantly".

Important details:
- The headphones are connected with USB and I set the preference to connect it always to Windows.
- I am using a USB-C dongle because I am on a MacBook Pro (2018 model)

Any suggestions is welcome. I have switched off the sound sync option in Parallels but that did not change it.