Yes, you need to press the "connect" buttons on both the XBOX and the controller after powering them both on.
On the XBOX, the connect button is near the memory slots (to the right). On the controller, the "connect" button is on the back, between the Left and Right buttons.