You can avoid selecting the TexBox by simply unfocus it when you drag the sprite:
Sprite| DragDrop is dragging -> TexBox| set unfocused.
But the TextBox is always above the game canvas, so you will drag the sprite along behind the TextBox.
If you want to avoid that, you have to make your own TextBox.