Precomputed Lighting Scenarios: Problem with MotionController in VR

Hello!
Currently i am working with Precomputed Lighting Scenarios in VR. Setting up the Levels and switching between them works pretty good. The only issue i have is, when i switch from my Day-Scene to my Night-Scene the hands of my MotionController from the Day-Scene are also shown in my Night-Scene.(As shown in the Images below)
So has anyone experience with this issue or knows how to solve it?
I am very thankful for any tip.