Did it solve your problem?
Otherwise the last thing I can think of is to check if your object might be invisible on the host and you're not destroying what you think you are destroying. A synced object can be visible to one peer and not another if your events call for it.