Just had the same issue this afternoon, using the latest beta build.
Again, host was active, but the client was inactive and went to screensaver. When I came back to the client, it was on all 3 screens but quickly went to just one screen as described above.