If I were to use UE4 to create a scene and then take a screenshot of it for the purpose of using it to create the cover art for a book I will be selling, would I have to pay royalties to Epic Games?
No, there would be no royalties for that under the EULA.