How to make a VR multiplayer?

Hi, so I’m trying to make a LAN multiplayer VR game and so far I the server set up. I can join the session as host and client, but when the client joins the session the controls are broken and neither can teleport. They stay at the same position (the center of the level) and both can look around but the controls aren’t working.
Also the hand meshes are in a whole different position.
Any thoughts on how to solve this?

Thanks.