Well i'm glad I wasn't the only one who had this issue. CEC was turned off on all devices so it wasn't that (that was like step one of troubleshooting lol).
I actually did get it temporarily working... by having the IP address removed after finding the apple TV.
Don't know why or how but it seemed to fix it... but then Control released the new 4k Driver and it seemed to fix the issue all together.