Just going to add to this so I can save myself later, but also help others. With the Apple TV set up on the IP driver with the HomeKit Bridge, it took actually removing the power cord (30 seconds) to power cycle my AppleTV to get control back; simply doing the restart through the AppleTV menu did not work.