Multiple physical materials playing on a single mesh that uses multiple material slots?

[outerlimit1111]

I have a house mesh that uses 3 different materials (and therefore 3 different physical materials respectively), but when I walk on it doesn’t play my footsteps like a mesh with a single material would.