Too many physics objects touching causes jittering?

Usually these https://i.imgur.com/WE6EdEH.png and probably a couple settings you find in the Project Settings Physics Category.

Try to make your Bodys dampen faster usually helps a lot. The biggest Problem is that one Body get into another Body and trys to correct his Position bumping in another Body again ant the cycle of jittering continous. So if your Bodys start to jitter less there is a good chance they reach the Treshold where they say its not perfect but good enough and go to Sleep.

If your Game Design allows it there is the Option to send those Bodys to sleep via Code or Disable/Enable Simulation at any moment you see fit. You can also turn of Start Awake that will keep them Sleeping at the beginning until something bumps into them.

Good Luck and have Fun =)

I know this is probably normal and unavoidable but say I NEED all these objects to have physics and to be touching each other. What ways are there to stop the jittering?

This doesn’t seem to solve the issue unless I make them have so much drag they basically don’t fall at all.
Also I tried putting the bodies to sleep as well. They wake up instantly because they are being acted upon all the time. I basically have a 2 story building built out of physics objects all with gravity enabled.