Dedicated Server does not load Steamworks dependency

Since upgrading my projects to 4.20 from 4.19.2, the Dedicated Server builds of the games no longer load the Steamworks modules correctly when starting. OnlineSubsystemSteam is specified in the projects Build.cs inside of DynamicallyLoadedModuleNames, and the client loads them as expected.

The temporary fix for this issue is to copy everything from

WindowsServer\Engine\Binaries\ThirdParty\Steamworks\Steamv139\Win64

to

WindowsServer\Game\Binaries\Win64

during the staging process, but this is not intended and creates client artifacts in the binaries folder.

Has anyone else encountered this issue, or know of a solution?