there are 2 ways that I have used
you can add a variable to your objects (for example USAGE) and give it a value for each of your layouts or sub-layouts in your GUI. Then when you are running through your objects, only destroy those with the right value in the variable. It's pretty efficient.
the second mode is to use containers. all the parts of the gui construct are loaded at the same time and destroyed at the same time. load one, get them all, destroy one, destroy them all. it's a bit messy if you have multiple gui structures using the same objects, but it is a very quick way to build or destroy a multi-object combination.