I’m not following what specific issue you’re having with the physics behavior. You mention something about it not working with setting position?
Box2d, chipmunk, matterjs, and most 2d physics engines are velocity based. So joints and collision response is solved by applying impulses. It still kind of handles it when object positions are set directly, but it doesn’t usually look as good.
The physics behavior does have a little extra where when you drag a physics object and let go it updates the velocity so it’s thrown, but that’s extra. I’m guessing that is undesired behavior for you?
There is an alternate way physics can be simulated and that’s with position based dynamics, but there isn’t a library for that as far as I know.
However, let’s take a step back. What kind of physics simulation are you after? What would you like it to do, and how is the physics behavior failing?