Not true. If, for instance, I have several processes running in the guest system, the guest system could be stealing resources (CPU, disk usage) from the main OS, even when it's not needed.
Moreover, even when the host machine is doing 'nothing', there is still an overhead for the VT...