Icon does now show up in win explorer

Hello.
I have recently added an icon for a game using the unreal engine. It shows up both on the top of the game window in the packaged version and in the taskbar, yet not in the windows explorer. This is the opposite problem than most of what I have seen when researching the issue.
I did put the icon as a 256x256 .ico file in the “windows game icon” section in the packaging options. How do I solve this?
Thanks in advance!