Without example Capx it's always a bit hit/miss to give any performance hints. Have you checked this with multiple browsers and with debug window active.. With it, you should be able to see what's taking the time.
As far as I know .. all active (marked visible) objects that are at the visible screen area are drawn. So IMHO it would be smarter to move unused elements outside the visible screen instead just hiding them behind the background.