Margin and layout size don't mean anything for performance (it doesn't matter what their values are at all). Offscreen is meant by anything outside of the game's window (you can't see it while playing basically).
Offscreen may not be rendered by the GPU but they'll still have events run for them (by the CPU). Ashley hasn't done any optimization for the collision checking so doing lots of collision checks on far away objects is a bad idea.