Thanks, I probably should have mentioned that I've got different object types.
I'm trying to create windows/panels which are 9-patches and under those could be sprite objects.
I think just adding a condition of if Mouse cursor is not over the panel to click events of things will do the trick.