You definitely want to keep the bullet speed positive.
I did have to set both the 'thrown items' angle as well as bullet angle for the direction to take effect (Which I found weird). But none of that should effect your gravity.
Do you maybe have a max speed set that has the bullet continue to gain speed? Or do you reset your bullet speed after it's in the air. Those might overpower the gravity and make it seem like it's not working