I think I was using 640x480, but I think I had something on z as well so as you can imagine....
Any way I wasn't planning on doing per pixel, more like per tile... like displaywidth/sprite.width, I just forgot the tile size.
The thing is now that that's fixed this works perfectly fine starting with 32x32 tiles, but if I go down to 16 there is a noticeable drop in fps, and no its not in a loop.
Here's a cap if someone wants to verify
http://files.getdropbox.com/u/666516/funwitharrays.cap