Caavo has a feature that allows it to switch to a different device automatically when activity on that device is detected. (e.g. pressing a button on the AppleTV remote will cause Caavo to switch to the AppleTV input). This way, the user can grab the original remote for any given device if that's what they'd prefer to use and Caavo will automatically switch to that input.
Sometimes this can happen accidentally if a button is accidentally pressed on a remote, or someone is using an app to interact with a device connected to Caavo.
If you find that this is happening too often you can turn this off for the offending device by using the Caavo remote to go to Settings> Devices> [Device Name]> Control Settings> Auto-Switch Settings and deselect the options displayed.