Guide performance system based on augmented reality and mixed reality

Abstract

The invention discloses a guide performance system based on augmented reality and mixed reality, and belongs to the technical field of scenic spot guide performance. The invention discloses a navigation performance system based on augmented reality and mixed reality. The system comprises a user side, an analysis module and a storage module, the user side is used for acquiring position information of a tourist in a real scene and playing information of the tourist, and transmitting the position information and the playing information to the analysis module and the storage module; the analysis module is used for collecting and analyzing the position information and the playing information of the tourist, planning and navigating a playing route for the tourist, calling the storage module, generating personalized virtual visual guide content and transmitting the personalized virtual visual guide content to a user side for display; the storage module is used for storing user data, map data and special effect data; interaction between tourists and scenic spots can be realized through augmented reality and mixed reality technologies, and the tourists can plan playing routes according to own preferences, so that the tourists can enjoy personalized guide and performance experience.

Description

Technical Field

[0001] The present invention belongs to the technical field of scenic spot tour guide performance, and more specifically, relates to a tour guide performance system based on augmented reality and mixed reality. Background Art

[0002] As one of the important industries in a city, the development of tourism has a great impact on the city. In the tourism industry, the experience of visiting scenic spots is the core. In the existing scenic spot tour process, the guide for tourists is usually a combination of tour guides and various guide machines to plan the viewing route and explain the specific details to tourists. However, this method can only be explained unilaterally by the tour guide and the guide machine language. At the same time, when visiting some large scenic spots, the tour guide points to the tourists by pointing. This method of indication has the problem of unclear indication. Tourists cannot see the actual scene of the scenic spot here and can only imagine it based on the tour guide's explanation; at the same time, the quality of the tour guide's explanation is affected by various factors such as weather, number of tourists and business capabilities. This method will lead to a large difference in the experience of tourists, and the experience of tourists remains at a relatively basic level, lacking realism and interactivity. Summary of the invention

[0003] The technical problem to be solved by the present invention is to provide a tour guide and performance system based on augmented reality and mixed reality, which can realize the interaction between tourists and scenic spots through augmented reality and mixed reality technologies, and tourists can plan their travel routes according to their own preferences, so that tourists can enjoy personalized tour guide and performance experience.

[0004] A guided performance system based on augmented reality and mixed reality of the present invention comprises a user terminal, an analysis module and a storage module.

[0005] The user end is used to obtain the location information of tourists in the real scene and the travel information of tourists, and transmit the location information and travel information to the analysis module and the storage module.

[0006] The analysis module is used to collect and analyze tourists' location information and travel information, plan and navigate tourists' travel routes, call the storage module, generate personalized virtual visual guide content and transmit it to the user end for display.

[0007] The storage module is used to store user data, map data and special effect data. The user data includes at least location information and travel information. The map data includes an electronic map of the real scene of the scenic spot. The special effect data includes text, audio, picture, video and three-dimensional model.

[0008] As a further improvement of the present invention, the user end includes a mobile phone of a tourist. The scenic spot is divided into several target scenic spots according to the real scene of the scenic spot, and each target scenic spot is correspondingly provided with special effect data. The mobile phone is connected to the analysis module, and when it is detected that the mobile phone is located within the target scenic spot according to the location information, the real scene image collected by the mobile phone is obtained, the special effect data in the storage module is called, the real scene image is matched with the special effect data corresponding to the target scenic spot, and the special effect data and the real scene image are fused based on the matching result, and the fused result is displayed on the mobile phone.

[0009] As a further improvement of the present invention, when a mobile phone enters the system program end, a tourist is required to register a personal account. If the tourist is registering and logging in for the first time, a target attraction is provided in the user interface. The tourist selects the target attraction according to his or her own preferences. The tourist's preferred target attractions are high-priority attractions. The analysis module plans the route and performs navigation according to the attraction priority and map data.

[0010] As a further improvement of the present invention, scenic spots with high frequency of being selected as preferred target scenic spots are collected, and such scenic spots are sorted by selection frequency, and selected as popular scenic spots in proportion. When the target scenic spots are provided in the user interface, the popular scenic spots are placed at the front of the selection queue. According to the user's location information, the number of people in each target scenic spot is calculated, and according to the preset maximum capacity in the target scenic spot, the estimated queuing time in the target scenic spot is estimated, and the estimated queuing time and the target scenic spot are displayed in the same user interface.

[0011] As a further improvement of the present invention, the user's preferred target attractions are collected and recorded to generate historical tour data. When the user logs in to the system program again, the user interface defaults to providing the route in the historical tour data, and the user can actively change the route. The historical browsing data includes the number of visits to each attraction and its corresponding browsing time.

[0012] As a further improvement of the present invention, the user terminal includes a head display device. The head display device is provided by the scenic spot for rent to tourists, and the head display device is operated through a controller. The display layer of the head display device includes a virtual layer and an actual layer, the actual layer displays a real scene picture, and the virtual layer displays special effect data. Tourists can interact with the virtual layer through the controller to generate a personalized tour experience.

[0013] As a further improvement of the present invention, the user terminal includes a message module. The message module is used to display the comments posted by tourists after visiting the target scenic spot. When tourists visit the target scenic spot for a certain period of time, they can post their experience of visiting the target scenic spot in the message module. Different tourists can interact with each other under the comments. The message module uses a word vector algorithm based on the comments in each target scenic spot to extract keywords in the comments and display them on the message module.

[0014] As a further improvement of the present invention, the user end includes a progress module. The progress module is used to give rewards to tourists after the tourists have visited the target attractions to a certain extent. The progress module includes a reward pool and a progress table. The reward pool includes several different reward items. The reward items have corresponding rarities. The acquisition probability represents the probability of obtaining the corresponding reward items. The rarity of the reward items matches the acquisition probability. The progress module stores several data pairs corresponding to the rarity and the acquisition probability, and stores several data pairs corresponding to the progress table and the reward pool. When the tourists visit the target attractions, the progress table advances accordingly, and it is determined whether the progress table reaches the preset conditions for obtaining the reward items in the reward pool. If so, a random number is generated, and the corresponding reward item is obtained according to the random number and the corresponding data pair.

[0015] As a further improvement of the present invention, the progress module adopts a weighted algorithm to obtain the thermal value of each target attraction according to the number of people at the current target attraction and the expected waiting time, sorts each target attraction according to the thermal value, and divides the target attractions into popular attractions and unpopular attractions in proportion; the rarity of reward items obtained by tourists visiting different target attractions is different; the rarity of reward items obtained by completing unpopular attractions is lower than the rarity of reward items obtained by completing popular attractions.

[0016] As a further improvement of the present invention, it includes N target attractions, namely N1, N2, ..., NN; it includes n high-priority attractions, namely n1, n2, ..., nn; where N≥n; the minimum travel time to complete the route is T; the route planning includes at least a high-priority route and a complete route; the high-priority route only includes the selected n high-priority attractions, the user's current location information is obtained as the initial point, the high-priority route is obtained by using the shortest path algorithm based on the high-priority attractions, and the travel time required to complete the high-priority route is T1; the complete route includes all N target attractions, the user's current location information is obtained as the initial point, after completing the high-priority route, after eliminating the high-priority attractions n1, n2, ..., nn, the remaining target attractions N' use the shortest path algorithm to obtain the route, and the travel time required to complete the complete route is T2.

[0017] Compared with the prior art, the present invention has the following beneficial effects: By setting up the user end, analysis module and storage module, tourists' travel information is collected and recorded. Augmented reality and mixed reality technologies can be used to realize the interaction between tourists and scenic spots, enhance the sense of interaction between virtual and reality, and allow tourists to plan their travel routes according to their own preferences, so that tourists can enjoy personalized guided tours and performance experiences. The authenticity and fun of tourists' travel are improved, and tourists have a strong intention to repeat the visit, thereby improving tourist stickiness. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1It is a schematic diagram of a module of the present invention; Figure 2 A schematic diagram of the overall working process of the present invention; Figure 3 It is a schematic diagram of the flow chart of the second specific embodiment of the present invention. DETAILED DESCRIPTION

[0019] Specific embodiment 1: Please refer to Figure 1-Figure 2 A guided performance system based on augmented reality and mixed reality includes a user terminal, an analysis module and a storage module.

[0020] The user end is used to obtain the location information of tourists in the real scene and the travel information of tourists, and transmit the location information and travel information to the analysis module and the storage module.

[0021] The analysis module is used to collect and analyze tourists' location information and travel information, plan and navigate tourists' travel routes, call the storage module, generate personalized virtual visual guide content and transmit it to the user end for display.

[0022] The storage module is used to store user data, map data and special effect data. The user data includes at least location information and travel information. The map data includes an electronic map of the real scene of the scenic spot. The special effect data includes text, audio, picture, video and three-dimensional model.

[0023] The user end includes the tourist's mobile phone and head-mounted display device. The scenic spot is divided into several target attractions according to the real scene of the scenic spot, and each target attraction is set with special effect data. The mobile phone is connected to the analysis module. When the mobile phone is detected to be within the target attraction according to the location information, the real scene image collected by the mobile phone is obtained, the special effect data in the storage module is called, the real scene image is matched with the special effect data corresponding to the target attraction, and the special effect data and the real scene image are fused based on the matching result, and the fused result is displayed on the mobile phone. Among them, the mobile phone program uses augmented reality technology, which adds virtual images to the real scene images instead of completely merging them, which can enhance the sensory experience of tourists.

[0024] The head-mounted display device is provided by the scenic spot for rent to tourists, and the head-mounted display device is operated by a controller. The display layer of the head-mounted display device includes a virtual layer and an actual layer. The actual layer displays real-life pictures, and the virtual layer displays special effect data. Tourists can interact with the virtual layer through the controller to generate a personalized guided tour experience. Among them, the head-mounted display device uses mixed reality technology, which completely integrates virtual scenes with real scenes, allowing tourists to immerse themselves in the play of scenic spots and enhance the interaction between tourists and scenic spots, rather than a single content output by tour guides or tour guide machines to tourists, which can increase the fun of tourists' play.

[0025] When entering the system program terminal, tourists are required to register a personal account. If the tourist is registering and logging in for the first time, the target attractions are provided in the user interface. Tourists choose the target attractions according to their preferences. Tourists' preferred target attractions are high-priority attractions. The analysis module plans the route and navigates according to the priority of the attractions and map data. By setting up independent personal accounts for each tourist, tourists can make different choices, create their own personalized travel experience, and improve tourists' repeated travel intentions and stickiness.

[0026] In this embodiment, it includes N target attractions, namely N1, N2, ..., NN; it includes n high-priority attractions, namely n1, n2, ..., nn; where N≥n; the minimum travel time to complete the route is T; the route planning includes at least a high-priority route and a complete route; the high-priority route only includes the selected n high-priority attractions, the user's current location information is obtained as the initial point, and the high-priority route is obtained based on the high-priority attractions using the shortest path algorithm. The travel time required to complete the high-priority route is T1; the complete route includes all N target attractions, the user's current location information is obtained as the initial point, after completing the high-priority route, after removing the high-priority attractions of n1, n2, ..., nn, the remaining target attractions N' use the shortest path algorithm to obtain the route, and the travel time required to complete the complete route is T2. Tourists can decide the target attractions to visit first according to their own interests and hobbies, and different preference choices determine different tour routes.

[0027] Scenic spots that are frequently selected as favorite target attractions are collected, and these attractions are sorted by selection frequency, and selected as popular attractions in proportion. When the target attractions are provided in the user interface, the popular attractions are placed at the front of the selection queue. According to the user's location information, the number of people in each target attraction is calculated, and the estimated queue time in the target attraction is estimated based on the preset maximum capacity of the target attraction. The estimated queue time and the target attraction are displayed on the same user interface. Tourists can directly plan their tour routes based on the queue time of the current target attraction, which helps tourists save queue time and improve the circulation efficiency in the scenic area.

[0028] Collect and record the user's favorite target attractions and generate historical tour data. When the user logs in to the system again, the user interface provides the route in the historical tour data by default, and the user can actively change the route. The historical browsing data includes the number of visits to each attraction and the corresponding browsing time.

[0029] The user end includes a message module. The message module is used to display the comments posted by tourists after visiting the target attractions. When tourists visit the target attractions for a certain period of time, they can post their experience of the target attractions in the message module. Different tourists can interact with each other under the comments. The message module uses a word vector algorithm based on the comments in each target attraction to extract keywords from the comments and display them on the message module.

[0030] The user end includes a progress module. The progress module is used to reward tourists after they have visited the target scenic spot to a certain extent. The progress module includes a reward pool and a progress table. The reward pool includes several different reward items. The reward items have corresponding rarity. The acquisition probability represents the probability of obtaining the corresponding reward items. The rarity of the reward items matches the acquisition probability. The progress module stores several data pairs corresponding to the rarity and the acquisition probability, and stores several data pairs corresponding to the progress table and the reward pool. When tourists visit the target scenic spot, the progress table advances accordingly. It is judged whether the progress table reaches the preset conditions for obtaining the reward items in the reward pool. If so, a random number is generated, and the corresponding reward items are obtained according to the random number and the corresponding data pair. By rewarding items, tourists are attracted to increase their playing time.

[0031] The progress module uses a weighted algorithm to obtain the heat value of each target attraction according to the number of people at the current target attraction and the expected waiting time, and sorts each target attraction by heat value, and divides the target attractions into popular attractions and unpopular attractions in proportion; the rarity of reward items obtained by tourists visiting different target attractions is different; the rarity of reward items obtained by completing unpopular attractions is lower than the rarity of reward items obtained by popular attractions. By setting high-rarity reward items at unpopular attractions, tourists can be attracted to visit unpopular attractions to ease the flow of people at popular attractions, while diverting traffic to unpopular attractions and averaging the number of tourists in the scenic area.

[0032] Specific embodiment 2: Please refer to Figure 3 A tour guide performance system based on augmented reality and mixed reality is described in detail in the following. The difference is that it also includes an evaluation feedback system. The evaluation feedback system is connected to the user terminal and the storage module to obtain keyword information of different scenic spots.

[0033] The message module of the user terminal includes the user's comments on the target scenic spot, and the evaluation feedback system collects all comments on the same target scenic spot. In this embodiment, weighted assignment is used to extract keywords in the comments, and the keywords are synchronously transmitted and displayed on the user interface, providing tourists with a simple introduction to the target scenic spot to help tourists quickly understand the characteristic elements of the target scenic spot and determine whether to include it in the planned route.

[0034] For each user, the user terminal records and saves the relevant elements (A, B, C...) such as the number of visits, duration, priority and time period of each user when visiting the target scenic spot; at the same time, corresponding weighting coefficients (a, b, c...) are set for the number of visits, duration, priority and time period; then the algorithm formula can be obtained as elo=A*a+B*b+C*c+..., and the weighted level points elo of different users visiting the target scenic spots can be obtained through the above algorithm formula. It should be noted that the relevant elements and their weighting coefficients are pre-set according to actual needs, and the specific setting method is a prior art means, which will not be repeated here.

[0035] Quantify tourists' comments and restrict the relevant conditions of the comments. While preventing malicious comments, it improves the effectiveness and authenticity of the comments and provides tourists with intuitive information when choosing target scenic spots.

[0036] For each target scenic spot, the method for obtaining its keywords includes steps S1-S4; Step S1: extract all the reviews of the target scenic spot, use the word vector algorithm to extract and sort the corresponding keywords according to the word frequency; Step S2: associate each keyword with the user it comments on, and obtain the accumulated weighted rating points elo of the user; Step S3: Perform secondary weighting on the sum of the word frequency of each keyword and its corresponding weighted level score ELO to obtain the total level score ELO of the keyword; Step S4: Sort the keywords according to their total ratings and display them on the user interface.

Claims

1. A tour guide performance system based on augmented reality and mixed reality, characterized by: It includes a user end, an analysis module and a storage module; The user end is used to obtain the location information of tourists in the real scene and the travel information of tourists, and transmit the location information and travel information to the analysis module and the storage module; The analysis module is used to collect and analyze the location information and travel information of tourists, plan and navigate the travel routes of tourists, call the storage module, generate personalized virtual visual guide content and transmit it to the user end for display; The storage module is used to store user data, map data and special effect data. The user data includes at least location information and travel information. The map data includes an electronic map of the real scene of the scenic spot. The special effect data includes text, audio, picture, video and three-dimensional model.

2. The guided performance system based on augmented reality and mixed reality according to claim 1, characterized in that: The user end includes the tourist's mobile phone; the scenic spot is divided into several target attractions according to the real scene of the scenic spot, and each target attraction is set with corresponding special effect data; the mobile phone is connected to the analysis module, and when the mobile phone is detected to be located within the target attraction according to the location information, the real scene image collected by the mobile phone is obtained, the special effect data in the storage module is called, the real scene image is matched with the special effect data corresponding to the target attraction, and the special effect data and the real scene image are fused based on the matching result, and the fused result is displayed on the mobile phone.

3. The guided performance system based on augmented reality and mixed reality according to claim 2, characterized in that: When the mobile phone enters the system program terminal, tourists are required to register a personal account. If the tourist is registering and logging in for the first time, the target attractions are provided in the user interface. Tourists choose the target attractions according to their own preferences. The target attractions preferred by tourists are high-priority attractions. The analysis module plans the route and navigates according to the priority of the attractions and the map data.

4. The guided performance system based on augmented reality and mixed reality according to claim 3, characterized in that: The attractions that are frequently selected as preferred target attractions are collected, and the attractions are sorted by selection frequency, and selected as recommended attractions in proportion; when the target attractions are provided in the user interface, the recommended attractions are placed at the front of the selection queue; the number of people in each target attraction is calculated based on the user's location information, and the estimated waiting time in the target attraction is estimated based on the preset maximum capacity of the target attraction, and the estimated waiting time and the target attraction are displayed on the same user interface.

5. The guided performance system based on augmented reality and mixed reality according to claim 3, characterized in that: Collect and record the user's preferred target attractions and generate historical tour data. When the user logs in to the system again, the user interface will provide the routes in the historical tour data by default, and the user can actively change the route. The historical browsing data includes the number of visits to each attraction and the corresponding browsing time.

6. The guided performance system based on augmented reality and mixed reality according to claim 2, characterized in that: The user end includes a head-mounted display device; the head-mounted display device is rented by the scenic spot to tourists and is operated through a controller; the display layer of the head-mounted display device includes a virtual layer and an actual layer, the actual layer displays real scene pictures, and the virtual layer displays special effect data; Visitors can interact with the virtual layer through the controller to generate a personalized tour experience.

7. The guided performance system based on augmented reality and mixed reality according to claim 3, characterized in that: The user end includes a message module; the message module is used to display the comments posted by tourists after visiting the target attractions. When tourists have visited the target attractions for a certain period of time, they can post their experience of visiting the target attractions in the message module; different tourists can interact with each other under the comments; the message module is based on the comments in each target attraction, uses a word vector algorithm, extracts keywords from the comments and displays them on the message module.

8. The guided performance system based on augmented reality and mixed reality according to claim 3, characterized in that: The user end includes a progress module; the progress module is used to give rewards to tourists after the tourists have visited the target attractions to a certain extent; the progress module includes a reward pool and a progress table, the reward pool includes several different reward items, the reward items have corresponding rarities, the acquisition probability represents the probability of obtaining the corresponding reward items, and the rarity of the reward items matches the acquisition probability; the progress module stores several data pairs corresponding to the rarity and the acquisition probability, and stores several data pairs corresponding to the progress table and the reward pool; when the tourists visit the target attractions, the progress table advances accordingly, and it is judged whether the progress table reaches the preset conditions for obtaining the reward items in the reward pool. If so, a random number is generated, and the corresponding reward item is obtained according to the random number and the corresponding data pair.

9. The guided performance system based on augmented reality and mixed reality according to claim 8, characterized in that: The progress module uses a weighted algorithm to obtain the heat value of each target attraction based on the number of people at the current target attraction and the estimated waiting time, sorts each target attraction by heat value, and divides the target attractions into popular attractions and unpopular attractions in proportion; the rarity of reward items obtained by tourists visiting different target attractions is different; the rarity of reward items obtained by completing unpopular attractions is lower than the rarity of reward items obtained by completing popular attractions.

10. The guided performance system based on augmented reality and mixed reality according to claim 3, characterized in that: It includes N target attractions, namely N1, N2, ..., NN; it includes n high-priority attractions, namely n1, n2, ..., nn; where N ≥ n; the minimum travel time to complete the route is T; the route planning includes at least a high-priority route and a complete route; the high-priority route only includes the selected n high-priority attractions, the user's current location information is obtained as the initial point, and the high-priority route is obtained by the shortest path algorithm based on the high-priority attractions. The travel time required to complete the high-priority route is T1; the complete route includes all N target attractions, the user's current location information is obtained as the initial point, after completing the high-priority route, after eliminating the high-priority attractions n1, n2, ..., nn, the remaining target attractions N' use the shortest path algorithm to obtain the route, and the travel time required to complete the complete route is T2.

Images