Problems cooking large project

Hey! I have a project with content around ~150gb and many little objects, like 200,000 of them. I have 32GB ram and good powerful PC. I get no errors while I cook, but unreal randomly stucks up on some files, like little meshes I have, and cooks them like forever. CPU usage is high, memory grows, disks writes are made, but this can go on for many hours without any progress. Log just shows typical output, no errors or anythings.

Besides that, I am trying to use iterative build to track the issue, but Unreal always starts from scratch if I use packaging option. If I use ‘File - > Cook Content for Windows’, iterative seems to work, but oddly, it often processes same files over again.

This is so confusing and frustrating!

Is that only me? Can be the issue that I am running out of memory or something, and that eventually makes it run forever? I started with typical non-iterative builds first, but nothing I change in options help.

I am under Windows 10 x64, Unreal 4.18

add -iterate to your build command

I tried this. I also ended up building using command line. There are no solutions yet. I had to modify source code directly for ‘iterate’ block. Else it would always start from beginning. The issue is that is saves database registry only at the end, hence if that point is not reached, all hopeless. My my direct editor source code modification did the trick.

I packaged my project using command line. My engine is a source build engine.

When I add -iterate to the package command line, the cooker skip most of the files if some files are modified, or skip cooking if none. See the log below.

Cook: LogCook: Display: Creating asset registry
Cook: LogCook: Display: Iterative cooking summary for WindowsNoEditor,
Cook: Considered: 5010,
Cook: File Hash missmatch: 368,
Cook: Packages Kept: 4642,
Cook: Packages failed save kept: 25,
Cook: Missing Cooked Info(expected 0): 0
Cook: LogCook: Display: Iterative cooking summary for WindowsServer,
Cook: Considered: 5004,
Cook: File Hash missmatch: 368,
Cook: Packages Kept: 4636,
Cook: Packages failed save kept: 31,
Cook: Missing Cooked Info(expected 0): 0
Cook: LogCook: Display: Sandbox cleanup took 14.993 seconds for platforms WindowsNoEditor WindowsServer iterative true