Should I hide actors that are not in field of players view?

Should I hide visual component of actor (without destroying it) when it leaves players field of view to gain a better performance? I don’t really know how world rendering works and guess when object is out of camera view it doesn’t render, so constant toggling visibility would only make things worse, but I just want someone to make me sure about that.