Keeping the world scene scale at default, but scaling up VR user

So we have a fairly large detailed scene that we are trying to scale down to table size, so that when you are in VR mode, it feels and looks like a miniature city.

There are issues that come with this however. (If we need to make a change to the scene, we need to scale it back up. Painting foliage / trees can become a hassle) and I’m almost certain there are many more unforseen issues that may arise the further we go down this scaling route.

I was hoping there was a way to keep the scale of the scene at normal defaults and scale the scene a different way. (Much like the VR Mode Editor where you can shrink the scene using the two trigger buttons and pulling your hands away from each other)

Any ideas? Thanks.

Any potential options would be helpful. Thanks.