Destructible Mesh Damage Only Applied When Line Trace Hits Specific Part of Mesh

I have a destructible mesh setup, and a line trace to deal damage to it, but the line trace only works on certain parts of my mesh. Heres a video Unreal My Problem - YouTube