Camera Shake or Jitter when using Physics impulses

I am using impulses to control my character in a zero g environment sort of like EVA mode in kerbal space program, but first person. If I collide with something, the camera starts shaking, and I lose control of the character. Is this due to a setting I am missing or do I need to use something other than impulses to direct my character?

Fixed it. Camera was using controller rotation instead of freely moving with the capsule.