I don't know what optimizations Ashley's introduced, but figuring the width, and height of every object has to be expensive.
As far as post scale goes, I can't think of anything that would help as far as the system goes.
There's a camera plug by Linkman2004 you might check out
No idea if it does layer, or layout scales.