The embodiment of the invention provides a multi-
modal virtual-real interaction sand table display method and device, and the method comprises the steps: constructing a multi-
modal virtual-real interaction sand table based on a
digital earth through a digital twinning technology and an MR / VR / AR technology in combination with an entity sand table, and according to a spatial position identification code generated by the real-time image information of the earth entity sand table, carrying out hierarchical
pose adjustment on the earth virtual sand table, so that the
pose of the earth virtual sand table and the
pose of the earth entity sand table are completely matched with a
visual angle, and obtaining a virtual-real fused sand table. According to a multi-stage scene architecture and a mixed rendering pipeline, virtual-real fusion rendering is carried out on the sand table to obtain a virtual-real rendering sand table, multi-player thought
collaborative interaction is realized by combining multi-form interaction means such as a keyboard, an operating lever, a
handle, gestures, voice and a
laser pen, and when a user changes a
viewport, the virtual-real rendering of the sand table is realized. And displaying the sub-scene content according to the scene streaming
radius. According to the application, the efficiency and flexibility of display and interaction of the multi-
modal virtual-real interaction sand table can be improved.