My VR Climbing System is not working as expected.

I am making a vr climbing system for a game I am working on. However there is a weird drift when moving. When i click the trigger I would want for the hand to lock on to the cliff instead it drifts. Here its a link to my code and a video of what I am talking about.

https://streamable.com/video/6st25