Images for each layout are loading separately. You can try to add all these sprites onto the Loader layout to "cache" them, but I am not sure if this will help.
I still think it's not the image size that's causing slowness.
Try this test - create an empty project. Import all 600+ sprites, put them all to a layout, but don't add them to a container. See how fast this layout will load?