Thousands of object that simulates physics

Hello,

In our project we would need to simulates physics on thousands of small objects, like small rocks, with which we would be able to interact (push, pull, etc.) problem is, we can"t enable physics on instanced static mesh, you can’t interact directly with particles and having thousands of meshes with physics is all but efficient. Are we missing any options available ?

Thank you.