VR Hands FPS Slowing Down

Heyo all;
So in VR I have my hands out in front of me. I then bombard the scene with physics actors until the frame rate starts to suffer. The Frame rate of my HMD movement stays way high so thats good. But the VR hands frame rate drops dramatically. How ever the physics objects frame rate stays higher than the hands. Its appears there is a priority in place that keeps the HMD movement though the scene at top, then the physics actors, then all the rest. Does anyone know how to up the priority of the VR hands actors movement? Any help is greatly appreciated.

Same Here…

Turns out there is some very tricky asynchronous code going on in the background. It basically keeps people from getting motion sick. Anyways. I don’t think there is a “solution” per say. More so I just needed to understand what was happening.