Devices do have limits, regardless of optimization tricks. 100k objects is going to be pushing it, even without physics.
I'm not very familiar with physics, but one idea that came to mind would be to use a helper tilemap object that is immovable. When your objects come to a rest, turn off their physics and swap tiles to ones with collisions where they are overlapping the object.