How long are you applying the force for (in seconds)? Or is this a one-tick force and not a force applied over time? I think you're probably applying force over time, but I can't be certain from your question.
Box2D compensates for framerate by modifying the each-tick result of an applied force depending on delta time. The idea being that, when a force is applied over a period of time then the change in velocity will always be the same no matter what the frame rate. This is a way to measure impulse, which is why applying an impulse to an object is framerate independent so that the velocity change is always the same.
Whether you are applying the force in one tick or over a period of time, this means that:
If you are applying a force over time, do not change the magnitude of the force.
If you are applying the force in one tick to cause a desired change in velocity, do not use a force - apply an impulse instead.