It's not glitching, it works like it should.
You can increase the value for the vector. The best solution is to use different values for when the player is moving towards the bullet, moving away from the bullet, and not moving.
Also, you can temporarily disable controls.
I gonna try the disable controls methods, but, thanks for the tip! But, do you know why they just got an so low push-up? Like, in some other projects just works normaly, in mine can't.