Rotate Physics Handle from center of grabbed object

Guys, how can i rotate handle from center of grabbed object? I tried to do regrab in center and back, when rotation finished, but in this case object little falls :frowning:
P.S. Sorry my english