Vr real and virtual fusion interaction system and method based on large space positioning and dynamic rendering

Abstract

This invention discloses a VR virtual-real fusion interaction system and method based on large-space positioning and dynamic rendering. The system includes: a physical space modeling module to generate a spatial risk field function; a hybrid positioning engine that uses tightly coupled extended Kalman filtering to fuse SLAM visual features and UWB / Bluetooth AoA data to calculate pose, and integrates a long short-term memory network for predictive compensation in case of visual failure; a spatial synchronization and dynamic scheduling module to allocate rendering and bandwidth resources; a virtual-real fusion rendering unit that dynamically generates a fused video stream containing virtual scenes and boundary warnings; a low-latency transmission network that distributes the video stream based on WiFi 7 with a latency of no more than 15ms; and a terminal presentation and closed-loop correction module that displays and transmits IMU data to correct pose. This invention achieves highly robust positioning, dynamic boundary warning, predictive resource scheduling, and multimodal interaction closed loop, significantly improving the immersion and safety of large-space multi-person VR experiences.

Images