When I was making my action game I had it so when there is boss fight, the layout scale changes from 1.0 to 0.5 (zooms out). When the layout scale changed, the object (that every tick set angle to the mouse) had an offset-ish, angle, it's hard to explain so I have an example project here.