You can set that on the layer's properties you wish to or not to move on the Parallax options.
For things that you wish to stay in the same place, like life, time and score you set zero on X and Y.
That will do the trick.
For effects of the background passing by you have to test different values of the parallax.
Don?t forget that those items, may it be the background or the HUD, should be in a different layer than the player.