Finally got 3d camera mouse pan working correctly with smooth lerp movements.
This allows rotation around any point where the mouse is, not just the centre of the screen, and unlike other "drag scrolling" i've seen, this maintains the exact spot on the ground that was grabbed, as well as correct perspective when zoomed.