Canvas moving while zooomed in

Whenever zoomed into my canvas, no matter what tool im using it moves the canvas. But when the canvas is fit to the screen it dosent happen. How do i change this so i can zoom in and use the brush tool?