Lighting channels not working correctly

I have a spotlight component attached to a player character that is set to channel 2 but it still affects the environment which is channel 0. It’s not consistent tho, only on random objects. I’ve unticked everything I can find in the lighting details.
I’m using this light as an ambient for the character and I don’t want it to affect the environment.

Any ideas?