Error when saving a map while uploading to cloud service, when reopening project, map is deleted

I use a cloud backup service for backing up data, which works fine, but when I tried to save the map while project files were getting uploaded, I got an error, and when I reopened the project my map was gone (everything black, all placed things were gone). This doesn’t happen when I pause the uploading process before working on my project (like I usually do, uploading everything when done instead).

I don’t know how many people actually do this but it might be worth taking a look into. Here’s a video (some loud shooting sounds at the end): - YouTube

I’ll attach some logs too. Log 1 Log 2

Hello,

I have attempted to reproduce your issue, but have experienced a few different results. The first time I attempted it, I got no error message in the editor, but when I downloaded the project again and opened it, the map was gone as you stated.

The second and third times I tested, I was not able to complete my upload to cloud storage, as once I saved the map the download paused and did not finish. Have you seen this behavior as well?

I didn’t actually test downloading the project again, but it should be the same as the local copy is what’s getting uploaded. I tested it a bit more and saw that as long as you don’t save the map when you’re not actually uploading the map you’re fine, but if you save as the map is getting uploaded (the map file with lots of numbers appended to it) you get an error and the next time you run the project it’s gone.

I didn’t test to see what would happen if you saved again after getting the error though, if it fixes things or doesn’t change anything.

I was able to upload everything to cloud storage. There were some hickups on certain files but I think that was just my connection being slow. The only real times you would run into this bug (with cloud storage) is if you saved the files right after starting a new project (while the map was being uploaded), if you accidently saved the file twice in a row, or manually save after an autosave (if that actually saves the map, I’m not sure).

The easiest way to reproduce this is creating a new project, wait for everything to upload, then save a couple of times until you get an error.

It is not recommended that you upload your project to cloud storage while it is open. This can definitely cause corruption in certain files if you are attempting to access them while they are being uploaded.

If you are using cloud storage as a form of source control, have you considered using perforce or another form of source control? Take a look at our documentation for source control and see if this is something that would work for you:

Yes, since I found out about this I’ve been looking into perforce. I will probably move the UE4 project folder out of the cloud folder, then use a local perforce server with cloud backups of the perforce data folder (I don’t really need backups of the versioning). If this even works.

This way saving in UE4 should work normally and I can still backup the project by checking it out to perforce. Theoretically of course… I haven’t tested this setup yet.

That sounds like a better plan, and it allows you much more control over how you store your project and keeps you from losing tons of work.

With the documentation provided as well as the numerous Answerhub posts you can find regarding how to get source control working, you should be well on your way to setting it up.

Have a great day

I couldn’t actually get this to work, the perforce workspace had to be the same folder as the UE4 project, and from there it seemed impossible to check out the project to multiple locations. I am stuck with manual backups for now which isn’t ideal, but better than data loss I guess…

As far as your issue itself goes, have you tried to use another cloud storage service, such as Google Drive and see if you get the same error when saving your map(s)?

Yes, Google Drive does the same thing, when you save while the map is getting uploaded you get an error, then when you reload the project the map is gone.

Looking through the logs it looks like UE4 saves the map with a hash to a folder, then moves this new file to the original map location and overwrites it, but because of the original file getting accessed it can’t get overwritten so strange things happen. I don’t see why this would lead to everything disappearing from the map though. I could understand if the map stayed the same (without the saved changes), but if it couldn’t be saved, why is something changing? (Stuff getting deleted from the map)

This is what made me file this as a bug, but it could just be a design thing which had unintended consequences in this particular case.

For this particular issue, I recommend not uploading the project while it is open, or saving files while they are being uploaded, as this is definitely something that can cause corruption.