VR preview does not actually close

Whenever I press ESC to exit VR preview, it seems to keep running in the background. This is problematic because whenever I make changes to the project settings, these changes are not reflected unless I completely shut down unreal and restart it. Is there another way to close out of the preview so that it actually stops running and my changes will be reflected the next time I press VR preview? (I am using the HTC vive if that helps)