The first one was made with the construct beta, and the 2nd one isn't even a modification of the file I posted. :(
I could easily make the sprite smaller itself, but I was considering the fact that if I have a 24 pixel high hole, a 24 pixel high object should just slide through. Plus with how it's designed, I'm not going to make the sprite smaller.
What I would consider a good work-around is keeping the same sprite size but making the collision box for it smaller somehow. I could actually use that sort of thing for gameplay dynamics
EDIT: Found it, it was under Sprite then it was the option below ORIGIN, Collision Polygon. Still find it weird that a 24x high sprite can't fit into a 24x high hole.
Also why does the sprite when you jump sometimes go into the ground 1 pixel? (turned on pixel rounding to make it more apparent)