It's odd because if you don't add a Windows 8 object under there, then you won't get any trouble over the project being in test mode, but if you add a Windows 8 object then the default for Test Mode is Yes and you can have trouble running the project once it's exported.
If you've added a Windows 8 object (under Object Types in the Projects tab) then you can set Test Mode to No.