I’m in the process of trying to create a sort of “VR magic window” experience where I’d simulate the viewport of a second camera inside of a plane in the view of my main camera. Essentially, picture-in-picture, but instead of with a simple 2D render target, it would need to be 3D to get the effect right.
My idea at the moment would be to use a SceneCapture2D for each eye, but I’m uncertain how I would go about injecting the RenderTarget from that for each specific eye. At the moment I have just a single SceneCapture2D locked to the movement of the HMD working, but the effect is obviously flat because it’s just a 2D rendering on a plane of the 3D scene, and that plane itself may be stereoscopic but the content inside is not.
I don’t know enough about how each eye is rendered in UE4, and haven’t started diving in the code yet because I figured I’d ask here for advice first. Will it take a complete re-write and destruction of the rendering pipeline or is it possible to do a quick hack to get something working?
Thanks