Virtual reality VR panorama construction system and method based on multi-user cooperation

Abstract

The invention discloses a virtual reality VR panorama construction system and method based on multi-user cooperation, and relates to the field of virtual scene construction, the system comprises an intelligent management center, and the intelligent management center is in communication connection with an equipment management module, a data acquisition module, a database module, an interaction management module, a data analysis module and a data visualization module; the data acquisition module is used for acquiring equipment data and environment data; the database module is used for storing initial virtual scene information and other reference data; the interaction management module is used for editing and processing the initial virtual scene information by a user through equipment and associating the initial virtual scene information with other users to generate associated information; the data analysis module obtains a movement track of a related user according to the associated information and the equipment data and generates corresponding virtual panoramic information according to the movement track and other reference data, and the data visualization module visually displays the virtual panoramic information; according to the invention, the interactivity when the user visits the related scenic spots is effectively improved.

Description

Technical Field

[0001] The present invention relates to the field of virtual scene construction, and specifically to a virtual reality (VR) panoramic construction system and method based on multi-user collaboration. Background Art

[0002] With the development of science and technology, more and more technologies have moved from the laboratory into people's lives, including virtual scene technology, driverless technology, and related intelligent robots, etc.; these technologies are becoming more and more mature; virtual scene technology has a wide range of applications in aspects such as architectural design, tourism, cultural heritage protection, and game entertainment for people, bringing great convenience to people's lives; With the prosperity of the tourism industry, more and more people start to travel; many scenic spots of historical interest and former residences of famous scholars have been developed, and then more and more people just take a cursory look and take a photo, without really experiencing their inner cultural heritage; therefore, how to construct a virtual panoramic scene space of relevant tourist attractions through corresponding intelligent terminals, realize multi-person interaction and cultural relic interaction; improve people's understanding and knowledge of relevant cultural attractions, and make tourists more involved is the problem we need to solve. For this reason, a virtual reality (VR) panoramic construction system and method based on multi-user collaboration are provided herein. Summary of the Invention

[0003] In order to solve the above technical problems, the purpose of the present invention is to provide a virtual reality (VR) panoramic construction system and method based on multi-user collaboration.

[0004] The purpose of the present invention can be achieved by the following technical solutions: A virtual reality (VR) panoramic construction system based on multi-user collaboration includes an intelligent management center, and the intelligent management center is communicatively connected to a device management module, a data collection module, a database module, an interaction management module, a data analysis module, and a data visualization module; The device management module is used to associate relevant intelligent terminal devices with corresponding users and manage the relevant intelligent terminal devices; The data collection module is used to collect relevant device data and environmental data; The database module stores corresponding initial virtual scene information and other reference data; The interaction management module is used to edit and process the initial virtual scene information according to the relevant data of the corresponding user obtained by the data collection module, and generate corresponding association information by associating with other users; The data analysis module is used to analyze and process the relevant data obtained by the data collection module and the interaction management module of the intelligent terminal device corresponding to the relevant user according to the association information, and obtain corresponding virtual panoramic information; The data visualization module is used to visually display the acquired virtual panoramic information.

[0005] Furthermore, a device verification unit and a device management unit are provided in the device management module; The device verification unit is used to verify relevant intelligent terminal devices, input corresponding device information for them, set corresponding device numbers for the relevant intelligent terminal devices according to the input device information, and associate the corresponding device numbers with the device information; The device management unit is used to associate relevant users with corresponding intelligent terminal devices; a corresponding application window is provided, and users submit corresponding user applications through the corresponding application window, review relevant information in the user applications, determine whether to grant the user the permission to use the corresponding intelligent terminal device, and determine whether to associate the user with the intelligent terminal device with the corresponding device number according to the review result.

[0006] Furthermore, a device acquisition unit and an environment acquisition unit are provided in the data acquisition module; gyro sensors, magnetic sensors, positioning devices, and image acquisition devices are installed in all the intelligent terminal devices; The device acquisition unit acquires the data information collected by the gyro sensor and the magnetic sensor; the gyro sensor obtains the motion state and acceleration of the corresponding intelligent terminal device by measuring the rotation state of the gyro itself; the magnetic sensor obtains the orientation information of the intelligent terminal device through the magnetic field strength and direction at its location; The environment acquisition unit acquires the data information collected by the positioning device and the image acquisition device; the positioning device is used to obtain the position information of the corresponding intelligent terminal device; the image acquisition device is used to collect relevant gesture information and image information.

[0007] Furthermore, an initial virtual scene unit, an interaction storage unit, and an animation storage unit are provided in the database module; The initial virtual scene unit is used to store the initial virtual scene information in the relevant scenic area, and the initial virtual scene information includes the facility layout and virtual character information in the corresponding scenic area; the interaction storage unit is used to store the interaction points in the relevant scenic area; the animation storage unit is used to store the animation works at the corresponding positions in the relevant scenic area, and the corresponding positions are associated with the corresponding interaction points, and the animation works are the explanatory displays corresponding to the cultural backgrounds of the corresponding scenic spots.

[0008] Furthermore, a corresponding user editing unit and a user interaction unit are provided in the interaction management module; The user editing unit is used for relevant users to perform editing processing according to the facility layout and virtual character information in the initial virtual scene information stored in the database module. The user performs interactive processing through an intelligent terminal device to edit the facility layout and virtual character information in the relevant scene; obtains corresponding gesture information, where corresponding gesture key information is set, compares and analyzes the obtained gesture information and the gesture key information to obtain its editing purpose, and completes corresponding editing according to the editing purpose; generates corresponding editing information according to the editing result. The user interaction unit is used for relevant users to complete corresponding user interactions. An interaction application window is set, and the corresponding user submits an interaction application through the interaction application window. The interaction application includes the device number of the intelligent terminal device of other users, obtains the position information of the intelligent terminal device of other users, obtains the distance difference between the two position information according to the obtained position information, sets a distance threshold, and when the distance difference is less than or equal to the distance threshold, the interaction application is valid. The valid interaction application is sent to the corresponding user device, and other users judge whether to cooperate with this user in interaction; associates the corresponding users according to the result; generates corresponding association information.

[0009] Furthermore, an environment analysis unit and a device analysis unit are set in the data analysis module. The environment analysis unit is used to obtain the image information, editing information of the relevant intelligent terminal device, and the initial virtual scene information stored in the database module and perform analysis processing on them. Perform difference processing on the image information and the initial virtual scene information to obtain the corresponding difference, and update the corresponding initial virtual scene information according to the obtained difference; combine the obtained editing information with the initial virtual scene information to obtain the corresponding interactive virtual scene information. The device analysis unit is used to analyze the interconnected intelligent terminal devices according to the association information, obtain the corresponding motion state, acceleration, and corresponding orientation information of the corresponding intelligent terminal devices, and integrate them; the device analysis unit sets a corresponding three-dimensional coordinate system according to the orientation of the scenic area, sets the position of the corresponding intelligent terminal device as the corresponding coordinate point in the corresponding three-dimensional coordinate system, and analyzes the motion trajectory of the coordinate point according to the corresponding motion state, acceleration, and corresponding orientation information to obtain the corresponding motion trajectory; compares and analyzes the obtained motion trajectory with the position information of the corresponding interaction point. When the motion trajectory coincides with the corresponding interaction point, the corresponding animation work is obtained, and the corresponding animation work is combined with the interactive virtual scene information to generate the corresponding virtual panoramic information.

[0010] Furthermore, the data visualization module is used to obtain relevant virtual panoramic information and perform visual display according to the obtained virtual panoramic information.

[0011] Compared with the prior art, the beneficial effects of the present invention are as follows: By monitoring the movement trajectories of users through various devices installed on intelligent terminal devices, and marking the initial virtual scene by obtaining the corresponding gesture information of users, the impression of tourists on scenic spots is strengthened and their participation is improved; In addition, according to the associated information of users, the corresponding movement trajectories of users are obtained, the relationship between the movement trajectories and the interaction points is analyzed, the corresponding animation works are obtained, the animation works are combined with the corresponding virtual scene information to generate the corresponding virtual panoramic information, and the obtained virtual panoramic information is displayed, enabling users to achieve multi-person interaction and improving people's understanding and awareness of cultural scenic spots. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is the schematic diagram of the present invention; Figure 2 is the schematic diagram of the method. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0013] As Figure 1 shown, a virtual reality (VR) panoramic construction system based on multi-user collaboration includes an intelligent management center, and the intelligent management center is communicatively connected to a device management module, a data acquisition module, a database module, an interaction management module, a data analysis module, and a data visualization module; The device management module is used to associate relevant intelligent terminal devices with corresponding users and manage the relevant intelligent terminal devices. The specific implementation process includes: The device management module is provided with a device verification unit and a device management unit; The device verification unit is used to verify relevant intelligent terminal devices. The specific implementation process includes: The device verification unit is provided with a registration window and a login window; The registration window is used to register unregistered intelligent terminal devices. The intelligent terminal device submits a corresponding registration application through the registration window. The registration application includes the production batch number, certificate number, and device information of the corresponding intelligent terminal device; the submitted registration application is sent to the intelligent management center, and the intelligent management center audits it. According to the corresponding audit result, it is judged whether to grant the permission to set the virtual scene to the corresponding intelligent terminal device; if the intelligent management center audits and passes, it grants the permission to set the virtual scene to it, sets a corresponding device number for the intelligent terminal device, generates a corresponding login password according to its device number, and sends the generated working code and login password to the corresponding intelligent device terminal; if the intelligent management center audits and fails, it does not grant the permission to set the virtual scene to it; The login window is used to verify the device of a registered intelligent terminal device. The intelligent terminal device inputs the corresponding device number and login password through the login window; the input work code is matched with the production batch number corresponding to the intelligent terminal device. If the match fails, the login permission is not granted. If the match is successful, the input work code is matched with the corresponding login password. If the match fails, the login permission is not granted. If the match is still successful, the login permission is granted; The device management unit is used to associate relevant users with corresponding intelligent terminal devices. Its specific implementation process includes: A corresponding application window is set in the device management unit. Users submit corresponding user applications through the corresponding application window. The user applications include the user's name, ID number, and mobile phone number. The relevant information in the user applications is reviewed to determine whether to grant the user the permission to use the corresponding intelligent terminal device. If the review is passed, the user is associated with the intelligent terminal device with the corresponding device number. If the review fails, the user is not associated with the corresponding device; The data collection module is used to collect relevant data in the corresponding scenic area. Its specific implementation process includes: The data collection module includes a device collection unit and an environment collection unit; the data collection module is associated with the corresponding intelligent terminal device, and corresponding sensors are installed on the corresponding intelligent terminal device; the device collection unit and the environment collection unit are respectively used to obtain the relevant data collected by the corresponding sensors; Gyro sensors and magnetic sensors are installed in the intelligent terminal devices; The device collection unit integrates the data information collected by the gyro sensor and the magnetic sensor; The gyro sensor is installed in the corresponding intelligent terminal device. By measuring the rotation state of the gyro sensor itself, the motion state and acceleration of the corresponding intelligent terminal device are obtained; The magnetic sensor is installed in the corresponding intelligent terminal device. By measuring the magnetic field intensity and direction at the location of the corresponding intelligent terminal device, the angle between the current device and each direction is obtained, and then the orientation information of the intelligent terminal device is obtained; A positioning device and an image acquisition device are installed in the intelligent terminal device; The environment collection unit integrates the relevant data of the image acquisition device; The positioning device is used to obtain the location information of the corresponding intelligent terminal device; The image acquisition device is used to collect relevant gesture information and image information to obtain the gestures of the users using the corresponding intelligent terminal device; The data acquisition module uploads the obtained relevant information to the data analysis module; The database module is used to store relevant information within a relevant scenic area, which is provided with an initial virtual scene unit, an interactive storage unit, and an animation storage unit; The initial virtual scene unit is used to store the initial virtual scene information within a relevant scenic area; the initial virtual scene information includes the facility layout and virtual character information related to the corresponding scenic area; The interactive storage unit is used to store the interactive points within a relevant scenic area; The animation storage unit is used to store the animation works at the corresponding positions within a relevant scenic area, and the corresponding positions are associated with the corresponding interactive points. The animation works are the explanatory displays corresponding to the cultural backgrounds of the corresponding scenic spots; The interaction management module is used for the corresponding interaction management measures for relevant devices. The specific implementation process includes: The interaction management module is provided with a corresponding user editing unit and a user interaction unit; The user editing unit is used for relevant users to perform editing processing based on the facility layout and virtual character information in the initial virtual scene information stored in the database module. The user performs interaction processing through an intelligent terminal device to edit the facility layout and virtual character information in the relevant scene; corresponding gesture key information is provided, and the gesture key information respectively includes corresponding selection, movement, rotation, and zoom gesture styles; obtain the gesture information of the corresponding user intelligent terminal device, compare and analyze the obtained gesture information with the gesture key information, obtain the editing purpose, and complete the corresponding editing according to the editing purpose; generate corresponding editing information according to the editing result; The user interaction unit is used for relevant users to complete corresponding user interactions. An interaction application window is provided, and the corresponding user submits an interaction application through the interaction application window. The interaction application includes the device number of the intelligent terminal device of other users. Obtain the position information of the intelligent terminal device of other users, obtain the distance difference between the two position information according to the obtained position information, set a distance threshold. When the distance difference is less than or equal to the distance threshold, the interaction application is valid, and the valid interaction application is sent to the corresponding user device, and other users judge whether to cooperate with this user in interaction; if other users pass the relevant interaction application, associate them with the corresponding user and generate corresponding association information. If other users do not pass the relevant interaction application, do not associate them with the corresponding user; The data analysis module is used to analyze and process the relevant data obtained by the data acquisition module and the interaction management module of the intelligent terminal device corresponding to the relevant user according to the association information. The specific implementation process includes: An environmental analysis unit and a device analysis unit are provided in the data analysis module; The environmental analysis unit is used to obtain the image information, editing information of relevant intelligent terminal devices, and the initial virtual scene information stored in the database module, and perform analysis and processing on them. It performs difference processing on the image information and the initial virtual scene information to obtain the corresponding difference, and updates the corresponding initial virtual scene information according to the obtained difference; it combines the obtained editing information with the initial virtual scene information to obtain the corresponding interactive virtual scene information; The device analysis unit is used to analyze and process the mutually related intelligent terminal devices according to the associated information, obtain the motion state, acceleration, and corresponding orientation information of the corresponding intelligent terminal devices, and integrate them; the device analysis unit sets a corresponding three-dimensional coordinate system according to the orientation of the scenic area, sets the position of the corresponding intelligent terminal device as the corresponding coordinate point in the corresponding three-dimensional coordinate system, and analyzes the motion trajectory of the coordinate point according to the corresponding motion state, acceleration, and corresponding orientation information to obtain the corresponding motion trajectory; it compares and analyzes the obtained motion trajectory with the position information of the corresponding interaction point. When the motion trajectory coincides with the corresponding interaction point, it obtains the corresponding animation work, and combines the corresponding animation work with the interactive virtual scene information to generate the corresponding virtual panoramic information; It should be further noted that in the specific implementation process, when the relevant user does not generate the corresponding associated information, when its motion trajectory coincides with the corresponding interaction point, the corresponding virtual panoramic information is still generated; compared with the generation of the corresponding associated information, the editing information of the corresponding user does not exist in the virtual panoramic information; The data visualization module is used to obtain relevant virtual panoramic information, perform visual display according to the obtained virtual panoramic information, associate with the relevant virtual panoramic information according to the motion trajectory of the relevant user, and display it; A virtual reality (VR) panoramic construction method based on multi-user collaboration includes the following steps: Step S1: Verify the relevant intelligent terminal devices, set the corresponding device numbers for them, and associate the corresponding users with the corresponding intelligent terminal devices; Step S2: Collect relevant device data information, image information, and gesture information of the users corresponding to the intelligent terminal devices; and perform analysis and processing on them, and judge the motion trajectory of the user according to the obtained device data information; Step S3: Set the initial virtual scene information, interaction points, and animation works in the corresponding scenic area, obtain the gesture information of the corresponding user, judge whether the user edits the initial virtual scene information according to the gesture information, and generate editing information according to the editing result; Step S4: The user interacts with the corresponding device by enhancing the interaction application. After the interaction is completed, the corresponding user generates corresponding associated information, and analyzes and processes the obtained image information, editing information, and initial virtual scene information to obtain corresponding interactive virtual scene information; Step S5: According to the corresponding associated information, analyze the movement trajectory of the smart terminal device corresponding to the relevant user based on the corresponding associated information, and analyze the obtained movement trajectory and the interaction points to determine whether the corresponding animation work is obtained; Step S6: Combine the obtained animation work with the interactive virtual scene information to generate corresponding virtual panoramic information, and visually display the corresponding virtual panoramic information.

[0014] The above embodiments are only used to illustrate the technical method of the present invention and not to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical method of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical method of the present invention.

Claims

1. A virtual reality VR panorama construction system based on multi-user collaboration, characterized in that: It includes an intelligent management center, which is communicatively connected to a device management module, a data acquisition module, a database module, an interactive management module, a data analysis module, and a data visualization module; The device management module is used to associate relevant intelligent terminal devices with corresponding users and manage relevant intelligent terminal devices; The data acquisition module is used to collect relevant equipment data and environmental data; The database module stores the corresponding initial virtual scene information and other reference data; The interaction management module is used to edit the initial virtual scene information according to the relevant data of the corresponding user acquired by the data acquisition module, and associate with other users to generate corresponding association information; The data analysis module is used to analyze and process the relevant data obtained by the data acquisition module and the interaction management module of the intelligent terminal device corresponding to the corresponding user according to the associated information, and obtain the corresponding virtual panoramic information; The data visualization module is used to visualize the acquired virtual panoramic information.

2. A virtual reality VR panorama construction system based on multi-user collaboration according to claim 1, characterized in that: The device management module is provided with a device verification unit and a device management unit; The device verification unit is used to verify the relevant smart terminal device, enter the corresponding device information, set the corresponding device number for the relevant smart terminal device according to the entered device information, and associate the corresponding device number with the device information; The device management unit is used to associate relevant users with corresponding smart terminal devices; a corresponding application window is set up, and the user submits the corresponding user application through the corresponding application window, reviews the relevant information in the user application, determines whether to grant the user the authority to use the corresponding smart terminal device, and determines whether to associate the user with the smart terminal device with the corresponding device number based on the review result.

3. A virtual reality VR panorama construction system based on multi-user collaboration according to claim 2, characterized in that: The data acquisition module is provided with a device acquisition unit and an environment acquisition unit; the smart terminal devices are all equipped with a gyroscope sensor, a magnetic sensor, a positioning device and an image acquisition device; The device acquisition unit acquires data information collected by the gyroscope sensor and the magnetic sensor; the gyroscope sensor acquires the motion state and acceleration of the corresponding smart terminal device by measuring the rotation state of the gyroscope itself; the magnetic sensor acquires the orientation information of the smart terminal device through the magnetic field strength and direction at its location; The environment acquisition unit acquires data information acquired by the positioning device and the image acquisition device; the positioning device is used to acquire the location information of the corresponding intelligent terminal device; the image acquisition device is used to acquire relevant gesture information and image information.

4. A virtual reality VR panorama construction system based on multi-user collaboration according to claim 3, characterized in that: The database module is provided with an initial virtual scene unit, an interactive storage unit and an animation storage unit; The initial virtual scene unit is used to store initial virtual scene information in the relevant scenic area, and the initial virtual scene information includes the layout of relevant facilities and virtual character information in the corresponding scenic area; The interactive storage unit is used to store interactive points in relevant scenic spots; the animation storage unit is used to store animation works at corresponding positions in relevant scenic spots, the corresponding positions are associated with corresponding interactive points, and the animation works are explanations and displays corresponding to the cultural background of the corresponding scenic spots.

5. A virtual reality VR panorama construction system based on multi-user collaboration according to claim 4, characterized in that: The interaction management module is provided with a corresponding user editing unit and a user interaction unit; The user editing unit is used for the relevant users to edit the facility layout and virtual character information in the initial virtual scene information stored in the database module, and the users perform interactive processing through the intelligent terminal device to edit the facility layout and virtual character information in the relevant scene; obtain the corresponding gesture information, wherein the corresponding gesture key information is set, compare and analyze the obtained gesture information and the gesture key information, obtain the editing purpose, and complete the corresponding editing according to the editing purpose; generate the corresponding editing information according to the editing result; The user interaction unit is used for the relevant users to complete the corresponding user interaction, wherein an interaction application window is provided, and the corresponding user submits the interaction application through the interaction application window, the interaction application includes the device number of the smart terminal device corresponding to the other user, obtains the location information of the smart terminal device corresponding to the other user, obtains the distance difference between the location information of the two according to the obtained location information, sets the distance threshold, and when the distance difference is less than or equal to the distance threshold, the interaction application is valid, and the valid interaction application is sent to the corresponding user device, and the other user determines whether to interact and cooperate with the user; the corresponding users are associated according to the results, and the corresponding association information is generated.

6. A virtual reality VR panorama construction system based on multi-user collaboration according to claim 5, characterized in that: The data analysis module is provided with an environment analysis unit and a device analysis unit; The environment analysis unit is used to obtain image information, editing information of the relevant intelligent terminal device and the initial virtual scene information stored in the database module and analyze and process them, perform difference processing on the image information and the initial virtual scene information, obtain the corresponding difference, and update the corresponding initial virtual scene information according to the obtained difference; Combining the obtained editing information with the initial virtual scene information to obtain corresponding interactive virtual scene information; The device analysis unit is used to analyze and process the mutually related smart terminal devices according to the related information, obtain the motion state, acceleration and corresponding orientation information of the corresponding smart terminal devices, and integrate them; The device analysis unit sets a corresponding three-dimensional coordinate system according to the corresponding orientation of the scenic spot, sets the position of the corresponding intelligent terminal device as a corresponding coordinate point in the corresponding three-dimensional coordinate system, performs motion trajectory analysis on the coordinate point according to the corresponding motion state, acceleration and corresponding orientation information, and obtains the corresponding motion trajectory; compares and analyzes the obtained motion trajectory with the position information of the corresponding interaction point, and when the motion trajectory coincides with the corresponding interaction point, obtains the corresponding animation work, combines the corresponding animation work with the interactive virtual scene information, and generates corresponding virtual panoramic information.

7. A virtual reality VR panorama construction system based on multi-user collaboration according to claim 6, characterized in that: The data visualization module is used to obtain relevant virtual panoramic information and perform visualization based on the obtained virtual panoramic information.

8. The method for constructing a virtual reality VR panoramic construction system based on multi-user collaboration according to claims 1 to 7, characterized in that: The following steps are involved: Step S1: verify the relevant smart terminal device, set the corresponding device number for it, and associate the corresponding user with the corresponding smart terminal device; Step S2: Collect relevant device data information, image information, and gesture information of the user corresponding to the smart terminal device; And analyze and process it, and determine the user's movement trajectory based on the obtained device data information; Step S3: setting the initial virtual scene information, interaction points and animation works in the corresponding scenic area, obtaining the gesture information of the corresponding user, judging whether the user edits the initial virtual scene information according to the gesture information, and generating editing information according to the editing result; Step S4: the user interacts with the corresponding device by raising an interaction application. After the interaction is completed, the corresponding associated information is generated for the corresponding user, and the acquired image information, editing information and initial virtual scene information are analyzed and processed to acquire the corresponding interactive virtual scene information; Step S5: analyzing the acquired motion trajectory and the interaction point based on the motion trajectory of the intelligent terminal device corresponding to the relevant user according to the corresponding association information, and determining whether to acquire the corresponding animation work; Step S6: combining the acquired animation work with the interactive virtual scene information to generate corresponding virtual panoramic information, and visually displaying the corresponding virtual panoramic information.

Images