Destructible Mesh wrong collision

I try to collide my box with my custom house model. It works for the house if I give it proper collision. However, when I use a Destructible Mesh instead, it seems the mesh uses a different type of collision which doesn’t work well anymore.

See: 2019-04-01 15-24-55 GIF | Gfycat

How can I fix this issue?