screensaver remote desktop

Configured RAS to idle connections after some time, but if a client's desktop goes to a screensaver and subsequently revived (unlocked) it causes the idled session to become active again despite the remote application is minimized to taskbar at the client. This is true on 16.5 and 15. How do I...