Simply change it so you dont click anything to scroll?
Or add scroll arrows that cover the buttons and add a arrowSprite (Not) Overlapping buttons to your button click event.
De-activate your buttons while scrolling is active.
As the developer you have to come up with how you want something to work.