Okay. So for some reason when I move the tilemap to -16,-16, which is where I had it so I could use it to create a boundary around the edge of the layout, everything gets wonky, including the collision polygons.
I moved it back to 0,0, and now it's fine. :/