Drag visuals spawns in top-left corner

Hello.
I have managed pretty much most of my inventory system to work, however, I have got a small but still quite annoying problem with drag & drop feature, that I use for things like dropping items out of inventory.

The “slots” I am using are pretty much irregular rectangles and are shown in form of a scrollbar.
The problem is, that when the drag visual is spawned, it spawns in the top-left corner of the widget, that calls the operation.
Then in fractions of a second, it moves to the correct place according to the offset I set. But the movement is still often really visible.

In the picture below, the red rectangle is the widget that calls the operation, and the blue arrow shows the movement from the corner to the cursor.

https://s14.postimg.org/rytqk5z81/image.png

And my blueprint:

https://s14.postimg.org/3wcwoyarl/image.png

If you want, I can later provide some better footage of this issue.

Thank you in advance.