Just because they are invisible, doesn't mean they might not still be checking for collisions, calculating their current positions etc...so I guess it depends on the situation (especially behaviors and events involved)
I guess the best way to find out for sure would be to create a really exaggerated benchmarking project with an on-screen FPS counter.. starting with 2 visible layers loaded with sprites, and the ability to hide or destroy one of the layers...you might also want to make it so you could also start all the sprites on the hidden layer to start rotating and/or moving as well. This should answer your question in no uncertain terms.. I also suggest testing this benchmarking program on your target devices to see if the deference is more extreme on any given platform.
Best of luck,
Mike