For Libreoffice Draw, is there a preference you can set somewhere whereby when you hold the middle mouse button down you can pan around the document?
No, at least in LibreOffice 6.3.6.
But, if no object is selected, you could use the arrow keys to move around.
With nothing selected turning the wheel will scroll up and down, Shift+Wheel scrolls horizontally. Ctrl+Wheel zooms