Virtual venue touring method based on digital twinborn technology

Abstract

The invention discloses a virtual venue touring method based on a digital twinning technology, and relates to the field of digital twinning technologies, and the method comprises the steps: S1, virtual touring platform firmware preparation: selecting a plurality of virtual touring interaction devices used for being installed in a venue designated site; s2, platform network configuration: defining an access entrance, an access path and an access condition of a pre-established stadium digital twin platform, and allocating access / access authority to the virtual touring interaction device; s3, building sightseeing logic of the stadium digital twin platform; and S4, user application: generating real-time scene conditions based on the live-action information acquired by the stadium digital twin platform, the reservation record of the stadium reservation platform or statistical data generated by the people flow statistical system at the stadium entrance, and making a response by the stadium digital twin platform according to the touring logic in S3. The method and the system have the effect of relieving crowding of people during field sightseeing of the venue.

Description

Technical Field

[0001] The present application relates to the field of digital twin technology, and in particular to a virtual venue touring method based on digital twin technology. Background Art

[0002] Digital twins use physical models, sensors, operation history and other data to integrate multi-disciplinary, multi-physical quantity, multi-scale, and multi-probability simulation processes, complete mapping in virtual space, and thus reflect the entire life cycle of the corresponding physical equipment.

[0003] At present, digital twin technology is flourishing and has been applied in factories, parks, warehouses and other scenarios. Various venues are no exception. However, in many venues, digital twin technology is mainly used to achieve: real-time monitoring, management personnel entry and exit; patrol, real-time fire management, etc. It cannot provide much help for the crowded venues during holidays and events, long queues and crowds of tourists. The development of VR technology has provided more possibilities for virtual space. Therefore, this application proposes a new technical solution. Summary of the invention

[0004] In order to alleviate the problem of crowding during on-site venue visits, the present application provides a virtual venue tour method based on digital twin technology.

[0005] This application provides a virtual venue tour method based on digital twin technology, which adopts the following technical solutions: A virtual venue tour method based on digital twin technology, comprising: S1. Virtual tour platform firmware preparation, which includes: Optional multiple virtual tour interactive devices for installation in designated areas of the venue, wherein the virtual tour interactive devices include a large display screen and a VR unit; S2. Platform network configuration, which includes: Define the access entrance, access path and access conditions of the pre-established venue digital twin platform, and assign access / access rights to the virtual tour interactive devices; If a personal terminal accesses / accesses the venue digital twin platform and meets the access conditions, the corresponding access / access rights will be allocated to the personal terminal; S3. Establish the tour logic of the venue digital twin platform, which includes: If the current scene conditions meet the preset virtual tour opening conditions, and the virtual tour interactive device is connected or the connected personal terminal is bound to VR identification information, the preset tour mode 1 is allocated and executed; wherein the tour mode 1 includes calling / generating a human body model, receiving the interaction instructions of the virtual tour interactive device or the personal terminal and controlling the human body model to respond; If the current scene conditions meet the preset virtual tour opening conditions, and the connected personal terminal is not bound to VR identification information, the preset tour mode 2 is assigned and executed; wherein the tour mode 2 includes generating viewing points and interactive points based on the preset point tour rules; S4, user application, which includes: generating real-time scene conditions based on the real-scene information obtained by the venue digital twin platform, the reservation records of the venue reservation platform, or the statistical data generated by the crowd counting system at the venue entrance, and the venue digital twin platform responds with the tour logic in S3.

[0006] Optionally, the tour logic of establishing the venue digital twin platform also includes: Divide the virtual space into multiple exhibition areas according to the exhibition area layout or exhibition area division rules uploaded by the designated authority unit; Call real-time monitoring data; Perform portrait / body recognition based on real-scene monitoring data and count the number of visitors to each exhibition area; The exhibition areas are sorted from small to large according to the number of people, and guidance information is generated based on the exhibition areas with fewer people; wherein the guidance information includes offline guidance voice and / or text.

[0007] Optionally, the tour logic of establishing the venue digital twin platform also includes: Call the operating parameters or number of people in each exhibition area of ​​the platform and determine whether the preset high load condition is reached. If so, execute the diversion process; The diversion process includes: generating a virtual tour path according to the arrangement of exhibition areas, viewing points and interactive points.

[0008] Optionally, the tour logic of establishing the venue digital twin platform also includes: Perform preset exhibition area commonality analysis based on the number of visitors to each exhibition area, and update the virtual tour path according to the analysis results and high commonality priority rules.

[0009] Optionally, the commonality analysis of the exhibition areas includes: Based on the number of visitors to each exhibition area, the exhibition areas are sorted according to the rule of arranging the number of visitors from small to large, the display data of each exhibition area after sorting is extracted, and the correlation between each exhibition area is analyzed and evaluated to obtain the analysis results.

[0010] Optionally, the tour logic of establishing the venue digital twin platform also includes: The average number of people in each exhibition area in the preset sampling time T1 before and after the guide information is generated, before and after the virtual tour path is generated, and before and after the virtual tour path is updated, and the large flow of people is analyzed and evaluated to see whether it is caused by the location of the exhibits; Based on the evaluation results, suggestions for venue layout adjustments will be sent to the designated management party.

[0011] Optionally, the virtual tour opening conditions include: Perform preset crowd flow analysis based on the number of people entering the venue entrance and the number of reservations. If the analysis result exceeds the capacity threshold, request the administrator to open virtual tour access rights.

[0012] Optionally, the tour logic of establishing the venue digital twin platform also includes: If a temporary pairing request is received from a virtual tour interactive device or a personal terminal, the view sharing process is executed; The vision sharing process includes: Temporarily binding the virtual tour interactive devices and / or personal terminals corresponding to the same temporary pairing requirements; Define the unit that first initiates the temporary pairing request as the party whose vision is shared, and the other paired units as the party that receives the vision; The real-time image of the party whose vision is shared is sent to the party receiving the vision, and the party receiving the vision stops controlling the matching human body model.

[0013] To sum up, the present application includes the following beneficial technical effects: by connecting VR devices to the digital twin platform of the venue, tourists can not only conduct online virtual tours through the VR devices provided by the venue, but also use their own VR devices for online tours in other locations, thereby alleviating offline traffic. At the same time, a tour mode is set for tourists who do not use VR devices offline, and tourists can conduct tours by simply clicking on the large display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a schematic diagram of the main process of the method of this application. DETAILED DESCRIPTION

[0015] The following is combined with Figure 1 This application is described in further detail.

[0016] An embodiment of the present application discloses a virtual venue touring method based on digital twin technology.

[0017] Reference Figure 1 , the virtual venue tour methods based on digital twin technology include: S1. Virtual tour platform firmware preparation, which includes: Optional multiple virtual tour interactive devices for installation in designated areas of the venue, wherein the virtual tour interactive devices include a large display screen and a VR unit; it can be understood that an adapted VR unit is selected according to tour needs, and the VR unit can be a head-mounted VR glasses and an equipped Bluetooth handle for operation, while the VR glasses are connected to the large display screen for data via a data transmission module.

[0018] S2. Platform network configuration, which includes: Define the access entrance, access path and access conditions of the pre-established venue digital twin platform, and assign access / access rights to the virtual tour interactive devices; If a personal terminal accesses / accesses the venue digital twin platform and meets the access conditions, the corresponding access / access rights will be allocated to the personal terminal; It is understandable that the pre-established venue digital twin platform has imported the three-dimensional model of the entire venue. At the same time, tourists can also access it using personal terminal devices. It is not limited to VR devices in the venue. Tourists can also use their own personal VR devices to visit in other locations, reducing the occurrence of missed appointments due to large flow of people.

[0019] S3. Establish the tour logic of the venue digital twin platform, which includes: If the current scene conditions meet the preset virtual tour opening conditions, and the virtual tour interactive device is connected or the connected personal terminal is bound to VR identification information, the preset tour mode 1 is allocated and executed; wherein the tour mode 1 includes calling / generating a human body model, receiving the interaction instructions of the virtual tour interactive device or the personal terminal and controlling the human body model to respond; It is understandable that the conditions for opening virtual tours include a preset flow analysis based on the number of people entering the venue entrance and the number of reservations. If the analysis result exceeds the carrying capacity threshold, the administrator is requested to open virtual tour access rights; for example, when the offline flow of people in the venue increases and exceeds the venue's carrying capacity, the virtual tour access rights are enabled; VR identification information refers to the VR function, and tourists can make function selections during the tour by operating the Bluetooth controller equipped with the VR device (provided by the venue or brought by individuals).

[0020] If the current scene conditions meet the preset virtual tour opening conditions, and the connected personal terminal is not bound to VR identification information, the preset tour mode 2 is assigned and executed; wherein the tour mode 2 includes generating viewing points and interactive points based on the preset point tour rules; It is understandable that if a tourist accesses but does not use VR equipment, he / she will be assigned to tour mode 2 for the tour. Specifically, viewing points are set according to the tour positions of each exhibition area in the venue, and interactive points for tourists to interact (for example: knowledge answers) are presented on the display screen. Tourists can touch the viewing points displayed on the display screen to switch the screen to display the display content exhibited at the corresponding viewing points.

[0021] S4, user application, which includes: generating real-time scene conditions based on the real-scene information obtained by the venue digital twin platform, the reservation records of the venue reservation platform, or the statistical data generated by the crowd counting system at the venue entrance, and the venue digital twin platform responds with the tour logic in S3.

[0022] Through the above settings, VR devices are connected to the venue's digital twin platform. Visitors can not only conduct online virtual tours through the VR devices provided by the venue, but also use their own VR devices for online tours in other locations, thereby alleviating offline traffic. At the same time, a tour mode is set for offline tourists who do not use VR devices. Tourists only need to click on the large display screen to conduct the tour.

[0023] In another embodiment of the present application, in order to better guide the order of tourists' tours in the venue, the following is set: the tour logic of the venue digital twin platform is established, which also includes: 1) Divide the virtual space into multiple exhibition areas according to the exhibition area layout or exhibition area division rules uploaded by the designated authority unit; 2) Calling up real-scene monitoring data; it can be understood that it can be monitoring data from the venue’s digital twin platform, or it can be directly obtained from monitoring cameras preset in the venue.

[0024] 3) Perform portrait / body recognition based on real-scene monitoring data and count the number of visitors to each exhibition area; it can be understood that by performing image processing, recognition and counting of the real-time number of visitors to each exhibition area on the monitoring data.

[0025] 4) Sort the exhibition areas according to the number of people from small to large, and generate guidance information according to the exhibition areas with fewer people; wherein the guidance information includes offline guidance voice and / or text.

[0026] Through the above settings, tourists are guided to give priority to exhibition areas with fewer people. The guidance information can be displayed on the large screen to show the names of exhibition areas with less traffic and guidance route maps for tourists' reference. At the same time, voice messages suggesting the names of exhibition areas to be given priority can also be played.

[0027] In another embodiment of the present application, since exhibition areas with a large number of people both online and offline will have an impact on the platform computing power and data reception, for example, if there are a large number of visitors at the same location offline, the data reception at this location will become stuck, resulting in data delays in some areas. Therefore, the following configuration is set: Establishing the tour logic of the venue digital twin platform also includes: The operating parameters or number of people in each exhibition area of ​​the platform are called, and it is determined whether the preset high-load conditions are reached. If so, the diversion process is executed; the diversion process includes: generating a virtual tour path according to the order of the exhibition areas, viewing points and interactive points.

[0028] It can be understood that the operating parameters of each exhibition area refer to the frame parameters, and the high-load condition can be the maximum number of people set for each exhibition area. If the maximum number of people is reached, it means that the exhibition area is overloaded and needs to be diverted. According to the real-time number of people in each exhibition area, the exhibition areas are sorted from the least crowded to the most crowded. The virtual tour path starts with the exhibition area with the least number of people, followed by the second ranked exhibition area, and so on. A virtual tour path is generated, allowing online tourists to tour along the virtual tour path, alleviating the situation of large flow of people at the same location online.

[0029] In another embodiment of the present application, since the exhibition areas are sorted according to the number of people in each exhibition area, the original display ideas between the exhibition areas may be disrupted. In order to provide visitors with a better tour experience, it also includes: performing a preset exhibition area commonality analysis based on the number of visitors to each exhibition area, and updating the virtual tour path according to the analysis results and high commonality priority rules.

[0030] Specifically, the commonality analysis of the exhibition areas includes: based on the number of visitors to each exhibition area, sorting each exhibition area according to the rule of arranging the number of visitors from small to large, extracting the display data of each exhibition area after sorting, and analyzing and evaluating the correlation between each exhibition area to obtain the analysis results.

[0031] It is understandable that keywords are extracted from the display content of each exhibition area. For example, if the venue type is to display the traditional culture of each province and city, then exhibition area A is the traditional culture of Beijing, exhibition area B is the traditional culture of Ningbo, exhibition area C is the traditional culture of Shenzhen, and exhibition area D is the traditional culture of Hangzhou. If the tour path is sorted from small to large according to the number of visitors, it is ABCD. The correlation between the four exhibition areas can be judged by province. The correlation between exhibition areas B and D is Zhejiang Province. In this case, the two exhibition areas are arranged together first, so the updated tour path is: ABDC.

[0032] Through the above settings, not only are the exhibition areas sorted according to the number of visitors to generate a virtual tour path, but in order to enhance the visitors' tour experience, the virtual tour path is also updated by analyzing the correlation between the exhibition areas.

[0033] In another embodiment of the present application, the tour logic of the venue digital twin platform is established, which also includes: The average number of people in each exhibition area in the preset sampling time T1 before and after the guide information is generated, before and after the virtual tour path is generated, and before and after the virtual tour path is updated, and the large flow of people is analyzed and evaluated to see whether it is caused by the location of the exhibits; Based on the evaluation results, suggestions for venue layout adjustments will be sent to the designated management party.

[0034] It is understandable that by analyzing and comparing the changes in the average number of people in each exhibition area before and after the generation of the guide information, before and after the generation of the virtual tour path, and before and after the update of the virtual tour path, for example, within 1 hour, if the average number of people in a certain exhibition area is still at a large flow rate (80% of the maximum capacity of the exhibition area), it means that the generation of the guide information and the generation of the virtual tour path have not solved the flow of people in the exhibition area, which may be caused by the location of the exhibits, and a suggestion for adjusting the venue layout will be sent to the designated venue management party.

[0035] In another embodiment of the present application, when a family visits a venue, if they all wear VR, in order to better share the content of the exhibition area they see and facilitate communication, the tour logic of the venue digital twin platform is established, which also includes: If a temporary pairing request is received from a virtual tour interactive device or a personal terminal, the view sharing process is executed; The vision sharing process includes: Temporarily binding the virtual tour interactive devices and / or personal terminals corresponding to the same temporary pairing requirements; Define the unit that first initiates the temporary pairing request as the party whose vision is shared, and the other paired units as the party that receives the vision; The real-time image of the party whose vision is shared is sent to the party receiving the vision, and the party receiving the vision stops controlling the matching human body model.

[0036] It is understandable that if during the tour, one person in the group wants to share what he or she sees with others, then that person and the others can each input a temporary pairing request. The temporary pairing request can be achieved by each pressing the shortcut button on the Bluetooth controller equipped with the VR, for example: pressing the volume + button twice in a row is considered to be initiating a temporary pairing request, or it can be achieved by continuously pressing other buttons. As long as the buttons pressed continuously for the VR devices to be paired are the same and completed within 20 seconds, the VR device that initiated the pairing request will be paired and bound, and the screen of the VR device of the party whose field of view is shared will be shared to the screen of the VR devices of other parties with a binding relationship, thereby realizing field of view sharing.

[0037] Through the above settings, it is not only possible to share images among fellow travelers (friends, family members), but also applicable to the identity relationship between tour guides and tourists. By sharing the perspective seen by the tour guide on the VR devices of the fellow tourists, it is more conducive to the tour guide's explanation.

[0038] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.

Claims

1. A virtual venue tour method based on digital twin technology, characterized in that: include: S1. Virtual tour platform firmware preparation, which includes: Optional multiple virtual tour interactive devices for installation in designated areas of the venue, wherein the virtual tour interactive devices include a large display screen and a VR unit; S2. Platform network configuration, which includes: Define the access entrance, access path and access conditions of the pre-established venue digital twin platform, and assign access / access rights to the virtual tour interactive devices; If a personal terminal accesses / accesses the venue digital twin platform and meets the access conditions, the corresponding access / access rights will be allocated to the personal terminal; S3. Establish the tour logic of the venue digital twin platform, which includes: If the current scene conditions meet the preset virtual tour opening conditions, and the virtual tour interactive device is connected or the connected personal terminal is bound to VR identification information, the preset tour mode 1 is allocated and executed; wherein the tour mode 1 includes calling / generating a human body model, receiving the interaction instructions of the virtual tour interactive device or the personal terminal and controlling the human body model to respond; If the current scene conditions meet the preset virtual tour opening conditions, and the connected personal terminal is not bound to VR identification information, the preset tour mode 2 is assigned and executed; wherein the tour mode 2 includes generating viewing points and interactive points based on the preset point tour rules; S4, user application, which includes: generating real-time scene conditions based on the real-scene information obtained by the venue digital twin platform, the reservation records of the venue reservation platform, or the statistical data generated by the crowd counting system at the venue entrance, and the venue digital twin platform responds with the tour logic in S3.

2. The virtual venue tour method based on digital twin technology according to claim 1 is characterized in that: The tour logic of establishing the venue digital twin platform also includes: Divide the virtual space into multiple exhibition areas according to the exhibition area layout or exhibition area division rules uploaded by the designated authority unit; Call real-time monitoring data; Perform portrait / body recognition based on real-scene monitoring data and count the number of visitors to each exhibition area; The exhibition areas are sorted from small to large according to the number of people, and guidance information is generated based on the exhibition areas with fewer people; wherein the guidance information includes offline guidance voice and / or text.

3. The virtual venue tour method based on digital twin technology according to claim 2 is characterized in that: The tour logic of establishing the venue digital twin platform also includes: Call the operating parameters or number of people in each exhibition area of ​​the platform and determine whether the preset high load condition is reached. If so, execute the diversion process; The diversion process includes: generating a virtual tour path according to the arrangement of exhibition areas, viewing points and interactive points.

4. The virtual venue tour method based on digital twin technology according to claim 3 is characterized in that: The tour logic of establishing the venue digital twin platform also includes: Perform preset exhibition area commonality analysis based on the number of visitors to each exhibition area, and update the virtual tour path according to the analysis results and high commonality priority rules.

5. The virtual venue tour method based on digital twin technology according to claim 4 is characterized in that: The commonality analysis of the exhibition areas includes: Based on the number of visitors to each exhibition area, the exhibition areas are sorted according to the rule of arranging the number of visitors from small to large, the display data of each exhibition area after sorting is extracted, and the correlation between each exhibition area is analyzed and evaluated to obtain the analysis results.

6. The virtual venue tour method based on digital twin technology according to claim 4 is characterized in that: The tour logic of establishing the venue digital twin platform also includes: The average number of people in each exhibition area in the preset sampling time T1 before and after the guide information is generated, before and after the virtual tour path is generated, and before and after the virtual tour path is updated, and the large flow of people is analyzed and evaluated to see whether it is caused by the location of the exhibits; Based on the evaluation results, suggestions for venue layout adjustments will be sent to the designated management party.

7. The virtual venue tour method based on digital twin technology according to claim 1 is characterized in that: The virtual tour opening conditions include: Perform preset crowd flow analysis based on the number of people entering the venue entrance and the number of reservations. If the analysis result exceeds the capacity threshold, request the administrator to open virtual tour access rights.

8. The virtual venue tour method based on digital twin technology according to claim 1 is characterized in that: The tour logic of establishing the venue digital twin platform also includes: If a temporary pairing request is received from a virtual tour interactive device or a personal terminal, the view sharing process is executed; The vision sharing process includes: Temporarily bind the virtual tour interactive devices and / or personal terminals corresponding to the same temporary pairing requirements; Define the unit that first initiates the temporary pairing request as the party whose vision is shared, and the other paired units as the party that receives the vision; The real-time image of the party whose vision is shared is sent to the party receiving the vision, and the party receiving the vision stops controlling the matching human body model.

Images