Detect click on object transformed by World Position Offset?

I have objects that are transformed by World Position Offset and I would like to detect when user clicks on them in game. I know that objects deformed by material (GPU) don’t change their collision, but maybe there is some workaround?

For example, a cube is rotated in GPU, through material:

Is there a way to detect if user clicks on the object if he clicks on the deformed part (outside CPU collision)?