x

Search in
Sort by:

Question Status:

Search help

  • Simple searches use one or more words. Separate the words with spaces (cat dog) to search cat,dog or both. Separate the words with plus signs (cat +dog) to search for items that may contain cat but must contain dog.
  • You can further refine your search on the search results page, where you can search by keywords, author, topic. These can be combined with each other. Examples
    • cat dog --matches anything with cat,dog or both
    • cat +dog --searches for cat +dog where dog is a mandatory term
    • cat -dog -- searches for cat excluding any result containing dog
    • [cats] —will restrict your search to results with topic named "cats"
    • [cats] [dogs] —will restrict your search to results with both topics, "cats", and "dogs"

How to use Vive Controller as a virtual camera at the same time the HMD is working

I found tons of example videos(like these :

but I haven't found a proper tutorial. It seems easy and everyone seems to be doing well but I'm new to Unreal and I'm struggling with it for weeks.

What I'm trying to do is, the player will use only a HMD and a controller, and the other controller will be attached to the camera as a Virtual camera. When I play, I want one screen to display a HMD view and another screen to display a Virtual camera view.

I understand how to track the controller as a camera. I made the camera component as a child of the controller. But I coudn't find out how to make them work at the same time. The position and rotation value of HMD is mixed with the value of the controller and it keeps getting messy.

To sum up,

  • 1st player(walking around in the level) : one HMD, one controller(left)

  • 2nd player(virtual camera): view from the other controller(right) attached to real camera

  • play at the same time

If the first player uses the controller to teleport, I hope the second player will also move along.

How do I modify the blueprint on a VR template to make this possible?

Product Version: UE 4.18
Tags:
more ▼

asked Jun 25 '18 at 01:17 PM in Using UE4

avatar image

28agarwaen
13 1 3 7

(comments are locked)
10|2000 characters needed characters left
Viewable by all users

1 answer: sort voted first

Hey 28agarwaen,

I'd be happy to help you out with this. I made the blueprints for the MR video in your Pulse Design Group link.

What you're saying about mixed inputs absolutely makes sense. Are you setting your virtual camera controller to operate as a 2nd player? You will then need to launch the program as 2 players instead of 1.

Epic says there are some better MR video resources on the way. Have you looked at what may be available in 4.19 or 4.20?

Steve

more ▼

answered Jul 05 '18 at 07:05 PM

avatar image

SBiegun_PDG
26 1 3 5

avatar image 28agarwaen Jul 06 '18 at 05:52 AM

Thank you for your answer. Of course I checked that blueprint. But there were some missing parts and I had to figure out. What does it mean to launch the program as two players? That was the most obscure part. I found a way to use spectator mode and it worked anyway but that way doesn't require a projection box like yours. Tell me how you did it please.

avatar image SBiegun_PDG Jul 06 '18 at 02:16 PM

I should preface this by saying that I made the MR video back in like 4.12 or something, so there are probably a lot of redundancies and deprecated blueprints at play. Furthermore, I've learned a ton since then and my approach was super sloppy.

The first player would operate as normal with 1 controller. The Vive Tracker was set up in the 1st player's BP (note: this probably doesn't need to even be in the 1st player's BP anymore) and a "scene capture component" node was attached to the tracker. That scene capture component would output a texture, which is fed into this blueprint that is placed underground or far away in a secluded part of the scene: alt text

Then, make sure your camera rig blueprint in your scene (from that 2nd picture) is set to be player 2. Lastly, go to the dropdown next to "play" and choose 2 players:

alt text

At this point, you should have 2 screens pop open when you play - one for the VR user, one for non-VR. If I recall correctly, we had some issues getting the 1st player to actually render VR to the headset when launching with 2 players, but that may be resolved at this point. Then we simply screen captured with OBS to record the video.

Hope that helps,

Steve

snip4.png (54.9 kB)
(comments are locked)
10|2000 characters needed characters left
Viewable by all users
Your answer
toggle preview:

Up to 5 attachments (including images) can be used with a maximum of 5.2 MB each and 5.2 MB total.

Follow this question

Once you sign in you will be able to subscribe for any updates here

Answers to this question