It seems there’s a difference in the AnimDynamics results of an opened (non compiled) anim BP and a compiled anim BP. After compiling the anim BP it looks like it’s supposed to.
The non compiled version moves way more than after compiling, like the gravity scale isn’t set to 1 before compiling or something.