Raised by DCT on behalf of all users whose devices don't have touchscreen or a trackpad.
Navigating by only using the vertical and horizontal scroll bars is painful. It's poor UX for anyone who has to do it.
I don't think it's possible to improve that experience, so clicking and dragging is the suggestion. If there are any other alternatives I am open to them.