I think this is what your experiencing..
It's due to the nature of the physics behaviour. Solids cant occupy the same space so will always attempt to "push out" when they are forced to overlap. I dont see any way around this other than avoiding using physics.