Synch video frames with tracking data?

[aliasense]

Hi,

Is there a way to synchronize video frames from webcam with the rendering and tracking data from Vive Tracker?
We want to match up each camera frame to the precisely correct tracking data. We are using media player to get a texture of the video.
For mixed reality / virtual studio applications. Probably we would need some kind of timecode to synch tracking data and camera images. Or is there another solution? Any ideas?

We would prefer doing this with mediaplayer texture rather than the new MRC framework so we have more flexibility on how to compose the camera image into the rendering.

Thanks in advance.

[toma.e]

came in the forum for exact same reason, following for answers

[Rectus_SA (Rectus)]

I’m curious about this too. It’s possible that it might require more low-level hardware access than regular webcam APIs provide though. You’d need to be able to know exactly when the camera exposes the frames and be able to tie the timestamp to each individual frame.