How to make just handle of gun the only part i grab?

I have a basic gun model I made in blender. I want only the grip to be the part you can grab/pick up the weapon with. I have the pickup cube from the VR demo but that applies it to the entire gun and also it uses the trigger button ( on Oculus ) not the grab button if anyone knows how to change that as well.

Thank you