You might want to also look at how much data are to be transferred into memory between the two layouts.
If your game layout is using huge images that need to be read and uncompressed, it's natural that it takes time, especially on weaker hardware.
Try to post a capx of your project to see if anything can be "optimized" specifically for mobiles.