As far as I know, sprites are only loaded in the layouts they are present in, so that shouldn't be your problem.
To make your game have less lag, you'll need to pinpoint exactly what is causing the lag.
The first thing that I would suspect is your ragdoll physics - this can take tons of processing power, especially if you have too many objects requiring physics calculations.