How to re-assign new USB device

Hi there,
Sometimes when I connect a new USB device such as a mouse or external hard-drive, and assign it to Parallels using the 'New USB Device Detected' box, I need to re-assign it from Parallels back to Mac again. However, once the initial assignment is chosen, there is no option to re-assign it that I can see. For instance, if I unplug and replug the USB device, the initial selection box doesn't reappear. Is there a way to do this, to make Parallels forget the initial assignment choice so that the 'New USB Device Detected' box re-appears, without rebooting parallels?

This issue occurs often so it would be great to have a workaround for it.

Thanks