UI Never streaming texures always loaded

After running memreports for the game I’m working on we have found that all Never Streaming textures are being loaded all of the time, even if not needed. Most of these are UI textures that should never stream anyway. Menu screens, loading screens, etc. We even created a large non-streaming texture that wasnt referenced by anything, not a material etc, and it still loaded in!

Whats the best way to work with UI textures? Is there a way to stop Never Streaming textures loading in when not needed? Can TextureGroups_UI be used somehow?

I found a vague mention of setting non-streaming mip allocations on this link: Reporting Texture Streaming Metrics | Unreal Engine Documentation

NonStreaming Mips:
The amount of memory used by non-streaming allocations. If those allocations regularly fluctuate by more than the safety pool value, this will affect the streaming pool budget, and should be avoided (by either decreasing the allocations or increasing the safety pool).

Would setting these allocations help with the problem above? If so, how do I set them? I can’t find anymore information on them.