I sometimes encounter a similar problem too , the way I solved it is by add another condition to the "On Destroyed" condition.
For example I setup a variable called LayoutDone and had it set to false by default then setup the condition for the destroyed event as:
"On Destroyed" and "LayoutDone = false" > Do actions here.
Hope that helps.