Could you just edit the collision polygon on your character sprite to only have the points around the sword?
That or take the sword out of your player sprite, so you have 2 sprites, and pin the sword to the player sprite where it belongs?
Kinda new also so I may be way off ;)