Switching input modes for pause menu not working??

I have created a User interface system that relies on switching between inputs. However, When I exit the pause menu, I am able to move around perfectly fine, but as soon as i left click, its as though i’m still in UI & game mode and not game only mode. The camera is no longer tracked by the mouse and the only way to move the camera is by holding down the left click and moving the mouse around.