So awhile ago while refactoring I had moved my Maps folder and apparently this is not reflected in the project settings startup map settings. I didn’t realize there was a problem until I went to package my app for Windows and the resulting EXE was crashing. I happened to see from the stack trace that it crashed trying to load the map from its old location. In going back to the project settings I see it has the startup map path in red, so it knows something is wrong.
I would recommend that a) when moving/renaming a map referenced by the startup map property have the editor just fix it up or b) before packaging your app give an error message telling you to fix the startup map manually or c) have the EXE give a map not found error instead of just crashing or d) all of the above.