SAM3D-Phys: Towards Multi-Object Interactive Simulation in Real World

Researchers introduced SAM3D-Phys, a framework for turning real-world multi-view images into physics-ready 3D scenes.

It reconstructs the scene, completes partially observed objects with SAM3D, and then recovers each object’s pose and texture.

The system uses physics-constrained optimization and mask-guided appearance refinement to keep objects scene-consistent.

This makes reconstructed scenes usable for multi-object interactive simulation, with applications in robotics, AR/VR, and scene understanding.