One quick note on this...I was helping another dev out during my Office Hours today, who was running into this perf issue, on a game using the Physics behavior.
Something that might not be obvious (I missed it initially), you can get the same improvement in performance even running from Visual Studio if you use the "Run without debugging" (Ctrl+F5) command.
Switching the build from debug to release won't help, if you still run in debug mode from VS.