When setting up your AppleTV, if you successfully complete the remote pairing step but control fails to work, please ensure you have Home Sharing enabled on your AppleTV. Here's where you can find the setting:
AppleTV V4 and greater:
Settings > Accounts > Home Sharing
AppleTV V3:
Settings > Computers > Home Sharing
