Although I'm not sure why you use lerp for this and why you let it go on for so long when after 0.99 the difference isn't even visible anymore,
It's always possible to get vectorX and vectorY from the physics behaviour and move the object by that many pixels in the x and y direction while the scale is changing..