Make sure the original direction of your sprite is facing right.
Example:
<img src="https://cdn1.iconfinder.com/data/icons/defaulticon/icons/png/256x256/arrow-right.png" border="0" />
Make sure in the bullet behaviour properties set angle is set to yes.