How to use live camera feed as an augmented reality world?

Hey there,

We’re completely new working with Unreal Engine trying to create something like this video for a 2 week full time project, but instead of doing it on a handheld device like in the video we want to do it with an Oculus Rift. (After stepping through the portal it becomes a full VR experience).

Now my idea was to use DroidCam and tape my phone onto the Oculus Rift to create a similar idea. Being completely new to Unreal I can’t figure out how to use the camera feed as a map to walk through, because I’ve only found guides on how to project live camera feed onto a surface or put it in a frame in my HUD.

So my question is: How do I use the live camera feed as a world to walk through in Unreal Engine? Does it have something to do with projecting it as a map or level? Is it even possible at all?

Thanks in advance!