R e a l i t y
P r o m i s e s

Reality Promises: Virtual-Physical Decoupling Illusions in Mixed Reality via Invisible Mobile Robots

Princeton University
ACM Symposium on User Interface Software and Technology (UIST) 2025

Virtual-Physical Decoupling Illusions

Reality Promises simultaneously manipulate user perception and physical reality, thereby creating two branches of reality that are decoupled and recoupled as needed for a magical experience.


Skynet

We propose the robot control engine Skynet which provides user-co-aligned mobile robot manipulation with inside-out tracking, navigation, inverse kinematics, event monitoring, and event prediction for tight synchronization with the experience.


SplatiMate

SplatiMate is an on-device & standalone 3D Gaussian splatting system which introduces the concept of robot-aware multi-cone-casting for visually hiding the mobile robot and rendering object animation effects.


RealityGoGo

We introduce RealityGoGo as an embodied interaction technique, designed deliberately for the specifics of interacting with spatially distributed objects and surfaces in augmented reality. It enables selecting, inspecting, and placing objects by leveraging geometric and semantic informationabout the scene and its properties.