I'm assuming Poul means using the Hand tool to scroll within the Layers panel. I agree that this would be a nice usability feature. I scroll within the Layers panel all the time and it would be great to be able to do so without taking the time to precisely click on the scrollbar.
Even better would be if the hand tool would pan within the Layers panel as if you were click-dragging the bar in the scrollbar. That way you could quickly pan/scroll through the entire panel with one click-drag.