I had three VM control windows open (using the Open menu), but none of them was running (all were in stopped state). When I selected Quit from the Parallels Desktop menu, it did not quit the application, but, rather, closed the topmost window. The same thing when Quit was clicked again. Finally, when there was only one window open, Quit actually quit the application. This is clearly incorrect behavior and is reproduceable. Definitely a bug.