I can’t seem to find any documentation or examples of how one would go about integrating UE4 tests into a continues integration testing pipeline. The idea would be to have a git hook that rebuilt the game and ran a variety of functional tests and report any anomalies (like tests failing). I have found ways of executing automated tests from the cmd line but not a way to have the window close after all tests are run and an easy reliable method for getting the results of the tests.
Hey lifthansa47!
For WastepaperBin VR I figured out that you can run commands via the editor to run the tests and then Exit:
UE4Editor.exe "../../../../WastepaperBinVR/WastepaperBinVR.uproject" -Game -ExecCmds="Automation RunTests WastepaperBinVR, Automation Quit" LOG="TestLog.txt" -log
Test TestLog.txt file I think will appear in the Engine logs (not the game project’s logs) directory. I never got it running on our CI, though. Evaluating the Log is probably not trivial either 
Hope this helps somehow at least, though.
Cheers,