So I don't know for sure why it is happening. It was the actual Mouse.X Mouse.Y that was moving in the debug menu. What I think was happening was the cursor would teleport, move the camera, then teleport back before the camera technically moved so it was just in a loop of moving its own position back and forth based on the camera. To fix it I have a separate object with a fast-moving MoveTo behavior follow it around rather than setting its position.
Also thanks for the replies, really helped me re-think the problem