How to interact with 3d widgets without ray trace

Hello,

I’m trying to get a 3d widget menu to be interacted with in the same way it would be if added to viewport. So basically, the player interacts with it, and then all their input goes to the menu and they can control the menu with their controller.

Thanks!