Layout size wouldn't really be an issue.
You need to provide more information, such as:
How are the Layouts constructed, i.e. Tilemaps, single large images, lots of sprites, lots of effects etc.
Try using debug and profiler. This will help determine where the problem might be.