I have run into similar issues with other complex movement behaviors and the simple answer is to just add the Custom Movement behavior and use the action Push Out Solid. Note: if the parameter "Opposite Angle" does not work, try "Nearest", and then try the action Push out Solid at Angle.
One of those should work!