Immersive virtual sandbox simulation public display system and method

Abstract

The present invention discloses an immersive virtual sandbox simulation public display system and method, which includes a VR head display device, which is used to display a virtual sandbox scene according to instructions from a viewer; a handle assembly, which is communicatively connected to the VR head display device, and is used to transmit operation instructions from the viewer to the VR head display device. The VR head display device includes a head cover body, a display unit, a storage module and a control module arranged in the head cover body; the display unit is used to display a virtual sandbox scene; a plurality of virtual sandbox scenes are stored in the storage module, and each sandbox scene corresponds to a sandbox scene in simulation; the control module is used to transmit the sandbox scene to be displayed to the display unit according to instructions from the viewer. The present invention can immersively experience and track the changes of the sandbox scene loaded in real time and the scene during the game process. The viewing is not limited to a single position and viewing angle, and any position in the scene can be selected for panoramic viewing.

Description

Technical Field

[0001] The present invention belongs to the field of artificial intelligence technology, relates to electronic sandbox technology, and in particular to an immersive virtual sandbox simulation public display system and method. Background Art

[0002] Electronic sand table refers to software that simulates business operations through a computer network system. Electronic sand table has the characteristics of wide display content, advanced design techniques, display means, and the highest technological content. With the development of the times and the advancement of science and technology, people's ideas and appreciation levels have also greatly improved, and sand table has also developed in the direction of diversified functions, intelligence, art, and humanity.

[0003] Application document CN202022592987.4 discloses a holographic 3D intelligent interactive digital virtual sandbox. Users wear 3D glasses and display the sandbox model through a 3D display screen, which can realize full-scene mobile viewing. The viewer can be positioned through a motion capture camera to obtain real-time viewing information. The interactive component allows the user to issue instructions so that the sandbox model can be moved, rotated, and other control operations. However, the display of the holographic 3D virtual sandbox relies on a display stand, which is expensive and not easy to carry. At the same time, the sandbox display system based on the display stand can only be viewed outside the sandbox, and cannot be immersed in the actual scene to watch.

[0004] Application document CN202110802083.6 discloses an immersive sandbox display system, which pre-stores scenes and enters a scene for immersive viewing according to the viewer's choice. Although this virtual sandbox immersive experience greatly improves the displayability of the scene and the viewer's participation compared to traditional 2D multimedia displays or physical sandbox displays. However, it only displays pre-stored scenes, all content in the scene is fixed, and the viewing angle and position are also fixed, which is insufficient in the expressiveness of the scene. The sandbox display lacks interactive diversity, and the interaction between the viewer and the system often only exists in scene switching functions, rather than interacting with the scene content. Summary of the invention

[0005] The purpose of the present invention is to address the deficiencies in the above-mentioned prior art and to provide an immersive virtual sandbox simulation public display system and method, which can provide immersive experience and tracking of real-time loaded sandbox scenes and scene changes.

[0006] The inventive idea of ​​the present invention is to design an immersive sandbox display system that can be used for public display through VR (virtual reality, virtual reality technology), through which the audience can immersively watch the real-time updated sandbox deduction process in a panoramic way. The system first maintains a virtual sandbox scene through VR technology based on the imported sandbox scene, and then updates the sandbox scene in real time based on the association and data transmission between VR and the Unity3D engine. The audience can switch the viewing position at any time through the VR handle to watch the panoramic shots at different positions on the sandbox. Compared with the display display method of the traditional sandbox, this system allows viewers to freely switch viewing positions during the sandbox deduction process, and have a good immersive experience.

[0007] Based on the above inventive ideas, the present invention provides an immersive virtual sandbox simulation public display system, which includes:

[0008] A VR head display device, used for displaying a virtual sandbox scene according to instructions from a viewer; the VR head display device comprises a head cover body, a display unit, a storage module and a control module arranged in the head cover body;

[0009] The display unit is used to display the virtual sandbox scene;

[0010] The storage module stores a plurality of virtual sandbox scenes, each of which corresponds to a sandbox scene being simulated;

[0011] The control module is used to transmit the sandbox scene to be displayed to the display unit according to the instruction from the viewer;

[0012] A handle assembly, which is connected to the VR head display device for transmitting operation instructions from the viewer to the VR head display device;

[0013] The power supply is used to power the VR headset and handle components.

[0014] In the above-mentioned immersive virtual sandbox simulation public display system, the virtual sandbox scene is a scene file stored in the storage module. The scene file is designed by other conventional simulation models (such as Unity3D engine), which belongs to the prior art and will not be explained in detail here; the sandbox scene involved can be a game scene, earthquake simulation, mudslide simulation or historical story simulation, etc. The VR head display device is connected to the Unity3D engine in communication (for example, via USB connection or wireless WiFi pairing connection); the Unity3D engine transmits the real-time data of each object in the simulated sandbox scene to the VR head display device control module, and the control module sets each object in the sandbox scene (including position and status information, etc.) with the received real-time simulation data, and stores it in the storage module.

[0015] The above-mentioned immersive virtual sandbox simulation public display system, the display unit includes a first display subunit and a second display subunit. The first display subunit includes two display modes: a sandbox scene carousel mode and a bird's-eye view mode. In the sandbox scene carousel mode, the icons associated with each virtual sandbox scene stored in the storage module are played in the first display subunit in a set order; in the bird's-eye view mode, the first display subunit fully displays the selected virtual sandbox scene. The second display subunit is used to display the virtual sandbox scene observed with the selected position of the virtual sandbox in the first display subunit as the observation position.

[0016] In the above-mentioned immersive virtual sandbox simulation public display system, the handle assembly includes a first handle and a second handle, and the first handle and the second handle are simultaneously connected to the control module of the VR head display device in communication. The control module executes the corresponding operation instruction based on the signal from the first handle and / or the second handle, combined with the mapping relationship between the first handle and / or the second handle signal and the operation instruction. The mapping relationship between the first handle and / or the second handle signal and the operation instruction is stored in the storage module. The mapping relationship between the first handle and / or the second handle signal and the operation instruction includes:

[0017] (i) When the first handle is clicked alone, the information of the entire sandbox is displayed in real time, including but not limited to the three-dimensional size of the sandbox scene, the current game status, etc.;

[0018] (ii) When the first handle is controlled to select any position of the first display subunit or the second display subunit, the position parameters of the current position are displayed; or when the first handle is controlled to select any object in the sandbox displayed in the first display subunit or the second display subunit, the status information of the current object is displayed. For example, when a tank in battle is selected, its current health, bullet storage, position information and / or speed information are displayed;

[0019] (iii) controlling the first handle and the second handle to click at the same time to select a display mode; the display modes include: a sand table scene carousel mode, a bird's-eye view mode, and an immersive viewing mode; when entering the sand table scene carousel mode, controlling the first handle to select a sand table scene to be viewed; when entering the bird's-eye view mode, the entire sand table scene can be viewed from the periphery of the sand table through the first display subunit; when entering the immersive viewing mode, controlling the second handle to select any position in the first display subunit, and displaying the sand table scene with the current position as the observation position in the second display subunit;

[0020] (iv) Double-click the first handle, and the first display subunit displays a time progress bar, and a time point is selected from the time bar for viewing.

[0021] The above-mentioned immersive virtual sandbox simulation public display system also includes a voice analysis unit, which is used to convert the voice signal from the viewer into text, match the converted text with the instruction library, and send the matched operation instructions to the control module. The control module transmits the sandbox scene to be displayed to the display unit according to the operation instructions.

[0022] The above-mentioned immersive virtual sandbox simulation public display system can also realize synchronous viewing by multiple viewers. At this time, the sandbox scene carousel mode includes an "other" option interface in addition to different sandbox scenes; multiple viewers wear VR head display devices at the same time, with the selected viewer as the main controller and other viewers as slave viewers; the slave viewer selects the "Synchronize other users" option from the "other" option interface, and a list of all VR head display devices in use will be displayed. The slave viewer only needs to select the VR head display device corresponding to the main controller for synchronous viewing. Control the first handle and the second handle to click at the same time to exit the synchronous viewing mode. The VR head display device list is a list of currently connected devices that is actively requested to be transmitted by the Unity3D engine when the VR head display device is started, and is saved to the storage module.

[0023] The immersive virtual sandbox simulation public display method provided by the present invention comprises the following steps:

[0024] S1 The viewer wears a VR headset;

[0025] S2 turns on the VR headset and enters the sandbox scene carousel mode;

[0026] S3 selects the sand table scene to be viewed and enters the bird's-eye view mode; the entire virtual sand table scene is displayed in the first display sub-unit;

[0027] S4 controls the first handle and the second handle to click at the same time to enter the immersive viewing mode; the first display subunit is reduced to a set size and a topographic map of the sandbox scene is presented at the same time; any position in the topographic map of the first display subunit is selected, and the virtual sandbox scene observed with the selected position of the virtual sandbox in the first display subunit as the observation position is displayed on the second display subunit.

[0028] In the above step S3, when the first handle is controlled to be clicked alone, the information of the entire sandbox is displayed in real time, including but not limited to the three-dimensional size of the sandbox scene, the current game battle status, etc.; when the first handle is controlled to select any position of the first display subunit, the position parameters of the current position are displayed; or when the first handle is controlled to select any object in the sandbox displayed in the first display subunit, the status information of the current object is displayed. For example, when a tank in the battle is selected, its current health, bullet storage, position information and / or speed information will be displayed.

[0029] In the above step S4, any position in the topographic map of the first display subunit is selected and associated with the sandbox scene coordinates, so that the viewer can be placed in the sandbox scene and can have a panoramic view of the surrounding environment. In a preferred implementation, a light spot mark is associated with the viewer's position (that is, the sandbox scene coordinates) to mark the viewer's position. At this time, the viewer can continue to select any position on the map for viewing. When the viewer controls the first handle and the second handle to click again, the bird's-eye view mode can be restored.

[0030] The above-mentioned immersive virtual sandbox simulation public display method also includes step S5, controlling the first handle to double-click, the first display subunit to display a time progress bar, and selecting a time point from the time bar for viewing.

[0031] The above immersive virtual sandbox simulation public display method, when multiple viewers synchronously watch a sandbox scene, further includes step S6, where the selected viewer is used as the main controller, and the other viewers are slave viewers, and the slave viewers synchronously watch the sandbox scene selected by the main controller. In a specific implementation, the main controller performs operations according to step S3, or S3 and S4; the slave viewers perform operations according to the following steps:

[0032] Enter the sandbox scene carousel mode from the viewer, select the "Synchronize other users" option from the "Other" option interface, and then select the VR headset device corresponding to the main controller from the VR headset device list for synchronized viewing.

[0033] In the above step S6, the first handle and the second handle are controlled to click at the same time to exit the synchronous viewing mode and enter the sandbox scene carousel mode.

[0034] In the above-mentioned immersive virtual sandbox simulation public display method, in step S3, step S4, step S5 or step S6, the voice signal from the viewer can be processed by the voice analysis unit, the voice signal from the viewer can be converted into text, the converted text can be matched with the instruction library, and the matched operation instructions can be sent to the control module, and the control module can transmit the sandbox scene to be displayed to the display unit according to the operation instructions.

[0035] Compared with the prior art, the immersive virtual sandbox simulation public display system and method provided by the present invention has the following beneficial effects:

[0036] (1) The system of the present invention combines the advantages of traditional sandbox display technology and the immersive experience of new VR technology. The display system can provide an immersive experience and track the changes in the sandbox scene loaded in real time and the scene during the game. The viewing is not limited to a single position and perspective, and any position in the scene can be selected for panoramic viewing.

[0037] (2) The system of the present invention enables good interactivity between the viewer and the system in the sand table display; the system of the present invention supports the viewer to interact with the scene by voice or handle, and can select the viewing position or view parameters such as object information and terrain information in the scene.

[0038] (3) The system of the present invention is associated with a sandbox simulation system (such as the Unity3D engine) and can display the sandbox scene in real-time simulation. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 This is a schematic diagram of the structure of an immersive virtual sandbox simulation public display system provided in Example 1 of the present invention.

[0040] Figure 2 This is a schematic diagram of the structure of a VR head display device in Example 1 of the present invention.

[0041] Figure 3 This is a schematic diagram of the structure of an immersive virtual sandbox simulation public display system provided in Example 2 of the present invention.

[0042] Figure 4 Schematic diagram of the multi-viewer synchronous viewing process in Embodiment 3 of the present invention.

[0043] Figure 5 This is a schematic diagram of the sandbox scene carousel mode in Example 3 of the present invention.

[0044] Figure 6 A schematic flow chart of an immersive virtual sandbox simulation public display method provided in Example 4 of the present invention.

[0045] Figure 7 A schematic flow chart of an immersive virtual sandbox simulation public display method provided in Example 5 of the present invention.

[0046] Figure 8 A schematic flow chart of an immersive virtual sandbox simulation public display method provided in Example 6 of the present invention. DETAILED DESCRIPTION

[0047] The technical solutions of the embodiments of the present invention are clearly and completely described in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work belong to the present invention.

[0048] Example 1

[0049] The immersive virtual sandbox simulation public display system provided in this embodiment is as follows: Figure 1 to Figure 2As shown, it includes a VR head display device, a handle assembly and a power supply. The VR head display device is in communication connection with the handle assembly. The power supply supplies power to the VR head display device and the handle assembly.

[0050] The VR head display device is used to display a virtual sandbox scene according to instructions from the viewer. The VR head display device includes a head cover body, a display unit, a storage module and a control module arranged in the head cover body; the main control module is connected to the display unit and the storage module respectively.

[0051] The headgear body can adopt the conventional headgear design used in VR head display devices in the field.

[0052] The storage module stores several virtual sandbox scenes, each of which corresponds to a sandbox scene in the simulation. The virtual sandbox scene is a scene file stored in the storage module. The scene file is designed by other conventional simulation models (such as Unity3D engine), which belongs to the prior art and will not be explained in detail here; the sandbox scene involved can be a game scene, earthquake simulation, mudslide simulation or historical story simulation, etc., and the explanation is given here by taking the sandbox game as an example. The VR head display device is connected to the host running Unity3D via USB to achieve communication connection. Through USB, Unity3D transmits the real-time data of each object in the sandbox scene obtained by simulation to the VR head display device, and the control module of the VR head display device sets each object in the sandbox scene according to the received real-time data (including position and status information, etc.), and stores the real-time data in the sandbox scene file corresponding to the storage module. Therefore, the position information and status information of each object in the sandbox scene in the storage module (such as the position and health of the tank in the sandbox game, etc.) are obtained by real-time simulation of Unity3D and transmitted to the VR head display device. Multiple VR headsets can be associated with a Unity3D engine at the same time. Different viewers wearing different VR headsets can independently watch the sandbox display in real time. All users connected to the Unity3D engine viewing system can choose their favorite viewing mode and viewing position.

[0053] The display unit is used to display a virtual sandbox scene. The display unit includes a first display subunit and a second display subunit. The first display subunit includes two display modes: a sandbox scene carousel mode and a bird's-eye view mode; in the sandbox scene carousel mode, the icons associated with each virtual sandbox scene stored in the storage module are played in the first display subunit in a set order; in the bird's-eye view mode, the first display subunit fully displays the selected virtual sandbox scene. The second display subunit is used to display the virtual sandbox scene observed with the selected position of the virtual sandbox in the first display subunit as the observation position. In the immersive viewing mode, the first display unit can be presented in the upper right corner of the second display unit as a translucent topographic map. The light spot mark can also be associated with the viewer's location to mark the viewer's location.

[0054] The control module is used to transmit the sandbox scene to be displayed in the storage module to the display unit according to the instructions from the viewer; at the same time, according to the real-time deduction data transmitted from Unity3D, each object in the sandbox scene is set (including position and status information, etc.).

[0055] The handle assembly is used to transmit the operation instructions from the viewer to the VR head display device. The handle assembly includes a first handle and a second handle, and the first handle and the second handle are simultaneously connected to the control module of the VR head display device for communication. The control module executes the corresponding operation instructions based on the signal from the first handle and / or the second handle, combined with the mapping relationship between the first handle and / or the second handle signal and the operation instruction. The mapping relationship between the first handle and / or the second handle signal and the operation instruction is stored in the storage module. The mapping relationship between the first handle and / or the second handle signal and the operation instruction includes:

[0056] (i) When the first handle is clicked alone, the information of the entire sandbox is displayed in real time, including but not limited to the three-dimensional size of the sandbox scene, the current game situation, etc.; the Unity3D engine can also send the real-time analysis data and text explanation to the VR head display device synchronously, so that the real-time analysis data and text explanation are provided while the sandbox scene is being played, thereby improving the viewing effect;

[0057] (ii) When the first handle is controlled to select any position of the first display subunit or the second display subunit, the position parameters of the current position are displayed; or when the first handle is controlled to select any object in the sandbox displayed in the first display subunit or the second display subunit, the status information of the current object is displayed. For example, when a tank in battle is selected, its current health, bullet storage, position information and / or speed information are displayed;

[0058] (iii) controlling the first handle and the second handle to click at the same time to select a display mode; the display modes include: a sand table scene carousel mode, a bird's-eye view mode, and an immersive viewing mode; when entering the sand table scene carousel mode, controlling the first handle to select a sand table scene to be viewed; when entering the bird's-eye view mode, the entire sand table scene can be viewed from the periphery of the sand table through the first display subunit; when entering the immersive viewing mode, controlling the second handle to select any position in the first display subunit, and displaying the sand table scene with the current position as the observation position in the second display subunit;

[0059] (iv) Double-click the first handle, and the first display subunit displays a time progress bar, and a time point is selected from the time bar for viewing.

[0060] In this embodiment, the left handle is used as the first handle, and the right handle is used as the second handle. Control of the first handle and the second handle can be achieved by clicking the handle buttons.

[0061] The power supply is used to power the VR headset and handle components.

[0062] The working principle of the above-mentioned immersive virtual sandbox simulation public display system is: the viewer wears a VR head display device and sends an operation signal to the control module through the first handle and / or the second handle; the control module sends the sandbox scene to be displayed to the first display subunit or the second display subunit for display based on the mapping relationship between the first handle and / or the second handle signal and the operation instruction.

[0063] Example 2

[0064] This embodiment is a further improvement on the immersive virtual sandbox simulation public display system based on Embodiment 1.

[0065] like Figure 3 As shown, the immersive virtual sandbox simulation public display system provided by this embodiment also includes a voice analysis unit for converting voice signals from viewers into text, matching the converted text with an instruction library, and sending the matched operation instructions to the control module, which transmits the sandbox scene to be displayed to the display unit according to the operation instructions.

[0066] The immersive virtual sandbox simulation public display system provided by this embodiment simplifies the operation process and also provides convenience for viewers who are not convenient for manual operation.

[0067] Example 3

[0068] This embodiment is a further improvement on the immersive virtual sandbox simulation public display system based on the first or second embodiment, which can realize the simultaneous viewing requirements of multiple viewers. Figure 4 As shown, multiple viewers wear VR head-mounted display devices at the same time, with the selected viewer as the main controller and the other viewers as slave viewers.

[0069] like Figure 5As shown, the sandbox scene carousel mode of the VR title device display unit includes not only different sandbox scenes, but also an "other" option interface; when the viewer selects the "Synchronize other users" option from the "other" option interface, a list of all VR head display devices in use will be displayed. The viewer only needs to select the VR head display device corresponding to the main controller for synchronous viewing. Control the first handle and the second handle to click at the same time to exit the synchronous viewing mode. The VR head display device list is the list of currently connected devices that the Unity3D engine actively requests to be transmitted when the VR head display device is started, and is saved to the storage module.

[0070] Example 4

[0071] This embodiment provides an immersive virtual sandbox simulation public display method, such as Figure 6 As shown, using the immersive virtual sandbox simulation public display system provided in Example 1, the following steps are performed:

[0072] S1 The viewer wears a VR headset.

[0073] S2 turns on the VR headset and enters the sandbox scene carousel mode.

[0074] After turning on the VR headset, a floating screen (i.e., the first display unit) will appear in front of the viewer. The screen will rotate the sandbox environments currently available for viewing (i.e., the sandbox scene carousel mode). Each selectable sandbox environment corresponds to a sandbox game that is currently being played. The viewer can select any sandbox and enter the sandbox environment directly by clicking the first handle, or enter the sandbox environment by clicking the "play" button on the screen with the first handle.

[0075] S3: Select the sand table scene to be viewed and enter the bird's-eye view mode; the entire virtual sand table scene is displayed in the first display sub-unit.

[0076] When the first handle is controlled to click alone, the information of the entire sandbox is displayed in real time, including but not limited to the three-dimensional size of the sandbox scene, the current game battle status, etc.; when the first handle is controlled to select any position of the first display subunit, the position parameters of the current position are displayed; or when the first handle is controlled to select any object in the sandbox displayed in the first display subunit, the status information of the current object is displayed. For example, when a tank in the battle is selected, its current health, bullet storage, position information and / or speed information will be displayed.

[0077] S4 controls the first handle and the second handle to click at the same time to enter the immersive viewing mode; the first display subunit is reduced to a set size and a topographic map of the sandbox scene is presented at the same time; any position in the topographic map of the first display subunit is selected, and the virtual sandbox scene observed with the selected position of the virtual sandbox in the first display subunit as the observation position is displayed on the second display subunit.

[0078] Select any position in the topographic map in the first display subunit and associate it with the corresponding coordinates of the sandbox scene, so that the viewer can be placed in the sandbox scene and can have a panoramic view of the surrounding environment. In a preferred implementation, a light spot mark is associated with the viewer's position to mark the viewer's position. At this time, the viewer can continue to select any position on the map for viewing. When the viewer controls the first handle and the second handle to click again, the bird's-eye view mode can be restored.

[0079] Example 5

[0080] This embodiment is a further improvement on the embodiment 4.

[0081] This embodiment provides an immersive virtual sandbox simulation public display method, such as Figure 7 As shown, it also includes step S5, controlling the first handle to double-click, the first display subunit displays a time progress bar, and selects a time point from the time bar for viewing.

[0082] When watching the sandbox simulation, since the sandbox game is carried out in real time, if the viewer wants to start watching from an earlier time point, he can also double-click the first handle button and select a past time point from the time progress bar to watch.

[0083] Example 6

[0084] This embodiment is a further improvement on the basis of Embodiment 4 or Embodiment 5, and can enable multiple viewers to watch the same sandbox scene synchronously.

[0085] This embodiment provides an immersive virtual sandbox simulation public display method, such as Figure 8 As shown, when multiple viewers synchronously watch a sandbox environment, step S6 is also included, with the selected viewer as the main controller, and the other viewers as slave viewers, and the slave viewers synchronously watch the sandbox scene selected by the main controller. In a specific implementation, the main controller performs operations according to step S3, or S3 and S4; the slave viewers perform operations according to the following steps:

[0086] Enter the sandbox scene carousel mode from the viewer, select the "Synchronize other users" option from the "Other" option interface, and then select the VR headset device corresponding to the main controller from the VR headset device list for synchronized viewing.

[0087] Control the first and second handles to click at the same time to exit the synchronized viewing mode and enter the sandbox scene carousel mode.

[0088] In addition, in the immersive virtual sandbox simulation public display method provided by Example 4, Example 5 or Example 6, in step S3, step S4, step S5 or step S6, the voice signal from the viewer can be processed by the voice analysis unit, the voice signal from the viewer can be converted into text, and the converted text can be matched with the instruction library, and the matched operation instructions can be sent to the control module, and the control module can transmit the sandbox scene to be displayed to the display unit according to the operation instructions.

[0089] In summary, the main advantages of the immersive virtual sandbox simulation public display system and method provided by the present invention are:

[0090] (1) Display the real-time computing sandbox simulation process through a virtual reality environment;

[0091] (2) Through virtual reality technology, viewers can immersively watch the sandbox simulation in bird's-eye view or panoramic mode;

[0092] (3) Through motion interaction or voice analysis modules, any viewer can easily control the system;

[0093] (4) The system provides situation display and scene information display, allowing viewers to grasp the overall information of the sandbox simulation.

[0094] Those skilled in the art will appreciate that the embodiments described herein are intended to help readers understand the principles of the present invention, and should be understood that the protection scope of the present invention is not limited to such specific statements and embodiments. Those skilled in the art can make various other specific variations and combinations that do not deviate from the essence of the present invention based on the technical revelations disclosed by the present invention, and these variations and combinations are still within the protection scope of the present invention.

Claims

1. An immersive virtual sandbox simulation public display system, characterized in that: include: A VR head display device is used to display a virtual sandbox scene according to instructions from a viewer; the VR head display device includes a head cover body, a display unit, a storage module and a control module arranged in the head cover body; the VR head display device is communicatively connected with a Unity3D engine; the Unity3D engine transmits real-time data of each object in the deduced sandbox scene to the control module of the VR head display device, and the control module sets each object in the sandbox scene according to the received real-time data and stores it in the storage module; The display unit is used to display a virtual sandbox scene; the display unit includes a first display subunit and a second display subunit; the first display subunit includes two display modes: a sandbox scene carousel mode and a bird's-eye view mode. In the sandbox scene carousel mode, icons associated with each virtual sandbox scene stored in the storage module are played in the first display subunit in a set order; in the bird's-eye view mode, the first display subunit completely displays the selected virtual sandbox scene; To achieve simultaneous viewing for multiple viewers, the display mode also includes an "Other" option interface. Multiple viewers wear VR headsets at the same time, with the selected viewer as the master controller and the other viewers as slave viewers. The slave viewer selects the "Synchronize with other users" option from the "Other" option interface, and a list of all VR headsets in use will be displayed. The slave viewer only needs to select the VR headset corresponding to the master controller to start simultaneous viewing. The second display subunit is used to display the virtual sand table scene observed with the selected position of the virtual sand table in the first display subunit as the observation position; The storage module stores a plurality of virtual sandbox scenes, each of which corresponds to a sandbox scene being simulated; The control module is used to transmit the sandbox scene to be displayed to the display unit according to the instruction from the viewer; A handle assembly is connected to the VR head display device for transmitting operation instructions from the viewer to the VR head display device; the handle assembly includes a first handle and a second handle, and the first handle and the second handle are simultaneously connected to the control module of the VR head display device for communication; the control module executes the corresponding operation instruction according to the signal from the first handle and / or the second handle and the mapping relationship between the signal of the first handle and / or the second handle and the operation instruction; the mapping relationship between the signal of the first handle and / or the second handle and the operation instruction is stored in the storage module; The mapping relationship between the first handle or / and the second handle signal and the operation instruction includes: (i) When the first handle is clicked alone, the information of the entire sandbox is displayed in real time; (ii) when the first handle is controlled to select any position of the first display subunit or the second display subunit, the position parameters of the current position are displayed; or when the first handle is controlled to select any object in the sandbox displayed in the first display subunit or the second display subunit, the status information of the current object is displayed; (iii) controlling the first handle and the second handle to click at the same time to select a display mode; the display modes include: a sand table scene carousel mode, a bird's-eye view mode, and an immersive viewing mode; when entering the sand table scene carousel mode, controlling the first handle to select a sand table scene to be viewed; when entering the bird's-eye view mode, the entire sand table scene is viewed from the periphery of the sand table through the first display subunit; when entering the immersive viewing mode, the first display subunit is reduced to a set size and a sand table scene topographic map is displayed at the same time; controlling the second handle to select any position in the topographic map of the first display subunit, and displaying the virtual sand table scene observed with the selected position of the virtual sand table in the first display subunit as the observation position on the second display subunit; using a light spot mark to associate with the viewer's position to mark the viewer's position; (iv) double-clicking the first handle, the first display subunit displays a time progress bar, and a time point is selected from the time progress bar for viewing; Power supply, used to power VR head display device and handle components.

2. The immersive virtual sandbox simulation public display system according to claim 1 is characterized in that: It also includes a voice analysis unit for converting the voice signal from the viewer into text, matching the converted text with the instruction library, and sending the matched operation instructions to the control module. The control module transmits the sandbox scene to be displayed to the display unit according to the operation instructions.

3. An immersive virtual sandbox simulation public display method, characterized in that: The operation using the immersive virtual sandbox simulation public display system according to claim 1 or 2 comprises the following steps: S1 The viewer wears a VR headset; S2 turns on the VR headset and enters the sandbox scene carousel mode; S3 selects the sand table scene to be viewed and enters the bird's-eye view mode; the entire virtual sand table scene is displayed in the first display sub-unit; S4 controls the first handle and the second handle to click at the same time to enter the immersive viewing mode; the first display subunit is reduced to a set size and a topographic map of the sandbox scene is presented at the same time; any position in the topographic map of the first display subunit is selected, and the virtual sandbox scene observed with the selected position of the virtual sandbox in the first display subunit as the observation position is displayed on the second display subunit.

4. The immersive virtual sandbox simulation public display method according to claim 3 is characterized in that: The method further includes step S5, wherein the first handle is controlled to be double-clicked, and the first display subunit displays a time progress bar, and a time point is selected from the time progress bar for viewing.

5. The immersive virtual sandbox simulation public display method according to claim 4 is characterized in that: When multiple viewers watch a sandbox environment synchronously, step S6 is also included, with the selected viewer as the main controller and the other viewers as slave viewers; the main controller performs operations according to step S3, or S3 and S4; the slave viewers operate according to the following steps: the slave viewer enters the sandbox scene carousel mode, selects the "Synchronize other users" option from the "Other" option interface, and the slave viewer selects the VR head display device corresponding to the main controller from the VR head display device list to perform synchronous viewing.

6. The immersive virtual sandbox simulation public display method according to claim 5 is characterized in that: In step S3, step S4, step S5 or step S6, the voice signal from the viewer is processed by the voice analysis unit, the voice signal from the viewer is converted into text, the converted text is matched with the instruction library, and the matched operation instruction is sent to the control module, and the control module transmits the sandbox scene to be displayed to the display unit according to the operation instruction.

Images