Intelligent navigation method and system based on MR head-mounted display device, medium and MR head-mounted display device

Abstract

The invention provides an intelligent navigation method and system based on MR head display equipment, a medium and the MR head display equipment, and relates to the technical field of communication. The method comprises the following steps: acquiring static touring data, and generating initial touring guide information based on the static touring data; obtaining dynamic touring data when the tourist touring the actual scenic area space; dynamically updating the initial tour guide information based on the dynamic tour data, and generating dynamically updated target tour guide information when the tourists tour the actual scenic spot space; and determining an interaction scene corresponding to the interaction scenic spot based on the target navigation information and the actual tour position of the tourist in tour of the actual scenic spot space, so that the tourist executes a corresponding interaction operation according to the interaction scene under the condition that the tourist reaches the interaction scenic spot position corresponding to the interaction scenic spot. According to the embodiment of the invention, by generating the interaction scene capable of enabling the tourists to perform the interaction operation, the tour guide information can be obviously provided for the tourists, and the experience feeling of tour interaction of the tourists can also be improved.

Description

Technical Field

[0001] The present invention relates to the field of communication technologies, and in particular, to an intelligent navigation method, system, medium, and MR headset device based on an MR headset device. Background Art

[0002] In the current field of navigation systems, the application of XR (Extended Reality) technology is gradually increasing. Especially in indoor navigation systems such as museums and exhibition halls, common virtual navigation systems based on VR (Virtual Reality) and AR (Augmented Reality) are available. These systems usually rely on the triggering and interaction of static points, and users experience them in a check-in manner. For example, a museum navigation system based on the metaverse VR technology, which includes server devices and VR headsets, can determine the user's position and perspective in the museum in real time through a position determination module and a perspective determination module, and display corresponding scenes and exhibit contents according to this information. Although this system improves the integration efficiency of exhibits and scenes, its disadvantage is that it lacks real-time response to the user's dynamic behavior and cannot provide a personalized navigation experience.

[0003] In outdoor XR navigation, although there are some systems such as an AR navigation system that enhances the tourism experience of Stone Forest, which realizes precise positioning and real-time environment tracking through a scenario-based knowledge graph and an AR intelligent interaction module, there is still a problem of failure to achieve dynamic follow-up. The user experience depends on preset content and lacks personalization and real-time nature.

[0004] MR technology combines the real environment with virtual elements, and shows great potential for wide application in outdoor visit navigation compared with the purely fictional space created by virtual reality (VR). The navigation system based on mixed reality (MR) technology is still in the primary stage of technical exploration, involving research in aspects such as map alignment and signal transmission.

[0005] However, in the related technologies, the traditional navigation idea is still followed, and the correlation between the environment and the tourist behavior cannot be effectively reflected. Only static data is used to provide guiding information to tourists, and it is impossible to flexibly recommend navigation information according to the tourist's own preferences, which greatly affects the user experience and is a technical problem that needs to be solved urgently. Summary of the Invention

[0006] The present invention provides an intelligent navigation method, system, medium, and MR headset device based on an MR headset device, which realizes dynamic update of target navigation information based on static and dynamic tour data, and generates an interactive scene that allows tourists to perform interactive operations, not only can significantly provide navigation information for tourists, but also can increase the interactive experience of tourists during the tour.

[0007] In a first aspect, the present invention provides a method applied to an MR headset device, the method comprising: Obtain static tour data and generate initial tour guide information based on the static tour data; Obtain dynamic tour data of tourists when visiting the actual scenic area space; Dynamically update the initial tour guide information based on the dynamic tour data to generate target tour guide information that is dynamically updated when tourists visit the actual scenic area space; Based on the target tour guide information and the actual tour location of tourists when visiting the actual scenic area space, determine an interaction scenario corresponding to an interaction scenic spot, so that when the tourists reach the interaction scenic spot location corresponding to the interaction scenic spot, perform corresponding interaction operations according to the interaction scenario; the actual scenic area space includes at least a plurality of interaction scenic spots, and the interaction scenic spots represent the scenic spots where tourists can enter the interaction scenario when visiting the actual scenic area space.

[0008] Preferably, according to the intelligent tour guide method based on the MR head-mounted device provided by the present invention, the static tour data at least includes: tourist personal data, initial scenic area data, and scenic area historical text data; The generating initial tour guide information based on the static tour data includes: Classify the tourist personal data to obtain tourist labels of different categories; Normalize the two-dimensional scenic area data, three-dimensional scenic area data, and scenic area description data of the initial scenic area data to obtain scenic area space data corresponding to the actual scenic area space; Perform word conversion processing on the scenic area historical text data to generate personalized tour guide words corresponding to the tourist labels; Process the tourist labels of different categories, the scenic area space data, and the personalized tour guide words based on a preset tour recommendation strategy to generate initial tour guide information corresponding to different categories of tourists, and the initial tour guide information at least includes an initial tour path and initial predicted tour scenic spots; The initial tour path is a tour route formed by sorting a plurality of initial predicted tour scenic spots according to the interest degree value of tourists; the interest degree value is determined according to the tourist labels and each scenic spot in the scenic area space data.

[0009] Preferably, according to the intelligent tour guide method based on the MR head-mounted device provided by the present invention, the dynamic tour data at least includes the actual tour location and tourist eye movement data; The obtaining dynamic tour data of tourists when visiting the actual scenic area space includes: At intervals of a preset time period and / or when tourists visit a new scenic spot, dynamically obtain the actual tour location and tourist eye movement data of tourists when visiting the actual scenic area space; Wherein, the actual tour location is location data obtained when the residence time of a tourist in the current scenic spot is greater than or equal to a preset residence time threshold; The tourist eye movement data is eye movement data obtained when the fixation time of a tourist on the current scenic spot is greater than or equal to a preset fixation time threshold.

[0010] Preferably, according to the intelligent tour guide method based on an MR head-mounted device provided by the present invention, dynamically updating the initial tour guide information based on the dynamic tour data to generate target tour guide information that is dynamically updated when a tourist tours the actual scenic area space includes: Obtaining the historical tour locations of the scenic spots that have been toured by a tourist in the actual scenic area space; Based on the historical tour locations of the visited scenic spots and the initial scenic spot locations corresponding to the initially predicted tour scenic spots, determining the tour deviation locations of the tourist; Obtaining the tour fixation time of the tourist on the tour deviation scenic spots corresponding to the tour deviation locations; When the tour fixation time is greater than or equal to the preset residence time threshold, updating the interest degree values of the tourist for each scenic spot in the actual scenic area space according to the scenic spot information corresponding to the tour deviation scenic spots; Sorting each scenic spot in the actual scenic area space based on the interest degree values of the tourist for each scenic spot; Updating the initially predicted tour scenic spots according to the unvisited scenic spots after sorting to generate target predicted tour scenic spots, and generating a target tour path according to the target predicted tour scenic spots, and forming the target tour guide information with the target predicted tour scenic spots and the target tour path.

[0011] Preferably, according to the intelligent tour guide method based on an MR head-mounted device provided by the present invention, the interaction scenarios at least include: a dynamic map scenario; Determining an interaction scenario corresponding to an interaction scenic spot based on the target tour guide information and the actual tour location of a tourist when touring the actual scenic area space includes: Performing a first process based on the target tour guide information, the map of the actual scenic area space, and the actual tour route to generate a dynamic map for touring the unvisited scenic spots; the dynamic map represents that when a tourist tours the unvisited scenic spots, the target predicted tour scenic spots and the target tour path are displayed; The interaction scenarios at least include: a personalized explanation scenario; Determining an interaction scenario corresponding to an interaction scenic spot based on the target tour guide information and the actual tour location of a tourist when touring the actual scenic area space further includes: Perform a second process based on the target tour guide information and the actual tour location of the tourist when visiting the actual scenic area space to generate a personalized explanation scenario; the personalized explanation scenario represents that when the tourist arrives at the tour explanation location corresponding to the personalized explanation scenario, play the personalized tour guide words of the scenic spot corresponding to the tour explanation location according to the tourist label.

[0012] Preferably, according to the intelligent tour guide method based on the MR headset device provided by the present invention, the interaction scenario at least includes: a game interaction scenario; Based on the target tour guide information and the actual tour location of the tourist when visiting the actual scenic area space, determining the interaction scenario corresponding to the interaction scenic spot further includes: When the actual tour location matches the game scenic spot location corresponding to a specific game scenic spot, generate a game interaction scenario corresponding to the specific game scenic spot according to the target tour guide information; the game interaction scenario represents that when the tourist arrives at the game scenic spot location, display a virtual game display interface so that the tourist can interact with the game on the virtual game display interface through actions and language; The interaction scenario at least includes: a rest scenario; Based on the target tour guide information and the actual tour location of the tourist when visiting the actual scenic area space, determining the interaction scenario corresponding to the interaction scenic spot further includes: When the actual tour location matches the rest scenic spot location corresponding to a specific rest scenic spot, generate a rest scenario corresponding to the rest scenic spot location according to the target tour guide information; the rest scenario represents that when the tourist arrives at the rest scenic spot location, generate a rest prompt, and when it is detected that the tourist performs a rest action according to the rest prompt, play rest audio.

[0013] In a second aspect, the present invention also provides an intelligent tour guide system based on an MR headset device, which is applied to the MR headset device. The system includes: An initial tour guide information generation module, configured to obtain static tour data and generate initial tour guide information based on the static tour data; A dynamic tour data acquisition module, configured to acquire dynamic tour data of the tourist when visiting the actual scenic area space; A target tour guide information generation module, configured to dynamically update the initial tour guide information based on the dynamic tour data to generate dynamically updated target tour guide information of the tourist when visiting the actual scenic area space; An interaction scenario determination module, configured to determine an interaction scenario corresponding to an interaction attraction based on the target navigation information and the actual tour position of a tourist when touring the actual scenic area space, so that when the tourist reaches the interaction attraction position corresponding to the interaction attraction, the tourist performs corresponding interaction operations according to the interaction scenario; the actual scenic area space includes at least a plurality of interaction attractions, and the interaction attractions represent attractions where the tourist can enter the interaction scenario when touring the actual scenic area space.

[0014] In a third aspect, the present invention further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, it implements the intelligent navigation method based on an MR head-mounted device as described in any one of the above.

[0015] In a fourth aspect, the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the intelligent navigation method based on an MR head-mounted device as described in any one of the above.

[0016] In a fifth aspect, the present invention further provides a computer program product, including a computer program. When the computer program is executed by a processor, it implements the intelligent navigation method based on an MR head-mounted device as described in any one of the above.

[0017] An intelligent navigation method, system, medium, and MR head-mounted device based on an MR head-mounted device provided by the present invention obtain static tour data, and generate initial navigation information based on the static tour data; obtain dynamic tour data of a tourist when touring the actual scenic area space; dynamically update the initial navigation information based on the dynamic tour data to generate target navigation information that is dynamically updated when the tourist tours the actual scenic area space; determine an interaction scenario corresponding to an interaction attraction based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space, so that when the tourist reaches the interaction attraction position corresponding to the interaction attraction, the tourist performs corresponding interaction operations according to the interaction scenario; the actual scenic area space includes at least a plurality of interaction attractions, and the interaction attractions represent attractions where the tourist can enter the interaction scenario when touring the actual scenic area space. It realizes dynamically updating the target navigation information based on static tour data and dynamic tour data, and generating an interaction scenario that enables tourists to perform interaction operations, which can not only significantly provide navigation information for tourists, but also increase the sense of experience of tourists' tour interaction. Description of the Drawings

[0018] To more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0019] Figure 1 It is one of the schematic flowcharts of the intelligent navigation method based on the MR headset device provided by the present invention.

[0020] Figure 2 It is the second schematic flowchart of the intelligent navigation method based on the MR headset device provided by the present invention.

[0021] Figure 3 It is the schematic diagram of the volume model for alignment provided by the present invention.

[0022] Figure 4 It is the schematic diagram of the garden plane positioning beacon provided by the present invention.

[0023] Figure 5 It is the product schematic diagram of the MR headset device provided by the present invention.

[0024] Figure 6 It is the schematic structural diagram of the intelligent navigation system based on the MR headset device provided by the present invention.

[0025] Figure 7 It is the schematic structural diagram of the electronic device provided by the present invention. Detailed implementation manners

[0026] To make the objectives, technical solutions and advantages of the present invention clearer, the following will clearly and completely describe the technical solutions in the present invention in conjunction with the drawings in the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art without creative efforts based on the embodiments in the present invention belong to the scope of protection of the present invention.

[0027] The following combines Figures 1-7 Describe an intelligent navigation method, system, medium and MR headset device based on the MR headset device of the present invention, which realizes dynamic update of target navigation information based on static and dynamic tour data, and generates an interactive scene that allows tourists to perform interactive operations, not only can significantly provide navigation information for tourists, but also can increase the sense of experience of tourists' tour interaction.

[0028] The embodiment provided by the present invention uses a head mounted display (HMD) as the core device of MR technology, integrates multiple sensors, can perform timing and tracking at a macro scale, and collect eye movement and head movement data at a micro scale. This enables tourists to obtain more accurate and personalized guided tour services during the tour, which improves the fun and educational nature of the tour.

[0029] Figure 1 This is one of the flow charts of an intelligent navigation method based on an MR head display device provided by the present invention, such as Figure 1 As shown, the method may include but is not limited to steps S100 to S400: S100, acquiring static tour data, and generating initial guide information based on the static tour data; S200, obtaining dynamic sightseeing data of tourists when they are sightseeing in the actual scenic area; S300, dynamically updating the initial guide information based on the dynamic tour data, generating target guide information dynamically updated when tourists visit the actual scenic spot space; S400, based on the target guide information and the actual tour position of the tourists when touring the actual scenic area space, determine the interactive scene corresponding to the interactive scenic spot, so that when the tourists arrive at the interactive scenic spot position corresponding to the interactive scenic spot, they can perform corresponding interactive operations according to the interactive scene; the actual scenic area space includes at least a plurality of interactive scenic spots, and the interactive scenic spots represent the scenic spots that tourists can enter into the interactive scene when touring the actual scenic area space.

[0030] In step S100 of some embodiments, static tour data is acquired, and initial guide information is generated based on the static tour data.

[0031] It should be noted that static tour data at least includes: tourist personal data, initial scenic spot data, and scenic spot historical text data.

[0032] Tourist personal data at least includes but is not limited to tourist demand and portrait data, which can be obtained through surveys or by checking tour tickets. Tourist personal data is stored in the tourist database.

[0033] It should be noted that the survey content may include but is not limited to questionnaire survey methods, which include but are not limited to tour methods, guided tour needs, and interactive method preferences, as well as behavioral experiments, which may include but are not limited to: tour routes, tour duration, and visual preferences.

[0034] The initial scenic area data includes at least the scenic area spatial asset data, which can be obtained by spatially scanning the actual scenic area space and stored in the scenic area database. The scenic area spatial asset data includes at least, but is not limited to, two-dimensional scenic area data, three-dimensional scenic area data, and scenic area description data.

[0035] The scenic area historical text data includes at least, but is not limited to, historical text knowledge, which is stored in the explanation knowledge base.

[0036] It should be noted that the tourist database, scenic area database, and explanation database are updated regularly to obtain new static tour data from the databases.

[0037] Furthermore, the step of generating the initial tour guide information based on the static tour data specifically includes: Classify the tourist personal data to obtain tourist labels of different categories; Normalize the two-dimensional scenic area data, three-dimensional scenic area data, and scenic area description data of the initial scenic area data to obtain scenic area spatial data corresponding to the actual scenic area space; Perform word transformation processing on the scenic area historical text data to generate personalized tour guide words corresponding to the tourist labels; Based on a preset tour recommendation strategy, process the tourist labels of different categories, the scenic area spatial data, and the personalized tour guide words to generate initial tour guide information corresponding to different categories of tourists. The initial tour guide information includes at least an initial tour path and initial predicted tour attractions; The initial tour path is a tour route formed by sorting multiple initial predicted tour attractions according to the interest degree value of the tourists; the interest degree value is determined according to each attraction in the tourist label and the scenic area spatial data.

[0038] It can be understood that tourist personal data, including tourist demand and portrait data such as tour mode, tour guide demand, interaction mode preference, tour path, tour duration, visual preference, etc., is collected through various research methods (such as questionnaire research, behavioral experiments, etc.), and the collected tourist personal data is stored in the tourist database.

[0039] Use data analysis and machine learning algorithms to analyze and process tourist personal data, and classify tourists into different categories according to the characteristics and patterns of the data. For example, according to tourists' tour preferences, they can be divided into categories such as natural scenery preference type, historical and cultural preference type, and leisure vacation preference type.

[0040] Assign corresponding labels to tourists of each category for subsequent data processing and analysis. These labels can concisely describe the main characteristics and needs of tourists.

[0041] Through classification and tag generation, a deeper understanding of tourists' needs and behavioral characteristics can be achieved. For example, for tourists with a preference for history and culture, scenic spots and explanatory content related to history and culture can be highlighted.

[0042] Furthermore, through spatial scanning technology, data collection is carried out on the actual scenic area space to obtain two-dimensional scenic area data (such as scenic area maps, floor plans, etc.), three-dimensional scenic area data (such as three-dimensional models of the scenic area, virtual reality scenes, etc.), and scenic area description data (such as scenic spot introductions, scenic area features, etc.). The initial scenic area data collected is stored in the scenic area database.

[0043] Mathematical methods and data processing techniques are used to normalize the two-dimensional scenic area data, three-dimensional scenic area data, and scenic area description data. For example, data of different scales and coordinate systems are unified to a standard scale, and the data is normalized to eliminate the dimensional and unit differences of the data. After normalization, standardized scenic area space data corresponding to the actual scenic area space is obtained.

[0044] Normalization can make scenic area data of different types and sources have a unified format and standard, facilitating data integration, analysis, and comparison. At the same time, the standardized scenic area space data can provide accurate basic data support for subsequent tour recommendations, path planning, etc.

[0045] Even further, relevant historical text knowledge is extracted from the scenic area historical text data, and this data is stored in the explanatory knowledge base.

[0046] Using natural language processing technology and word vector models, the vocabulary in historical text knowledge is transformed into a form that can be understood and processed by a computer. For example, the vocabulary "mountains and waters" is transformed into a corresponding word vector to represent its position and meaning in the semantic space. According to the tourist tags and the word transformation results, personalized guided tour words corresponding to different categories of tourists are generated. For example, for tourists with a preference for history and culture, the generated guided tour words may focus more on historical and cultural descriptions and explanations.

[0047] Through word transformation processing, text data can be transformed into a numerical form that can be processed by a computer, facilitating data analysis and matching. The generation of personalized guided tour words can provide more personalized and demand - tailored guided tour content according to the needs and interests of different tourists, improving the tourists' tour experience.

[0048] Integrate different categories of tourist tags, normalized scenic area space data, and personalized guided tour words as the basic data for generating initial guided tour information.

[0049] According to the characteristics of the scenic area, tourists' needs, and behavioral patterns, a set of tour recommendation strategies is preset. This strategy can include scenic spot recommendation rules, path planning algorithms, etc.

[0050] Based on a preset tour recommendation strategy, the integrated data is processed and analyzed to generate initial tour information corresponding to different categories of tourists. The initial tour information includes at least an initial tour path and initial predicted tour attractions. Among them, the initial tour path is a tour route formed by sorting multiple initial predicted tour attractions according to the degree of interest value of the tourists; the degree of interest value is determined according to the tourist tags and each attraction in the scenic area spatial data. For example, for tourists who like natural scenery and there are multiple natural landscape attractions in the scenic area, the tour order and predicted tour attractions are determined according to the preference degree of the tourists for this type of attractions and the characteristics of each attraction.

[0051] By generating the initial tour information, personalized tour suggestions and plans are provided for tourists, helping tourists better arrange their tour schedules, improve tour efficiency and satisfaction. At the same time, it can also contribute to the scenic area's optimization of resource allocation and service management, and enhance the overall operation level of the scenic area.

[0052] In step S200 of some embodiments, dynamic tour data of tourists when visiting the actual scenic area space is obtained.

[0053] The dynamic tour data includes at least the actual tour location and the tourist eye movement data.

[0054] The actual tour location represents the location of the tourist when visiting the actual scenic area space.

[0055] The tourist eye movement data represents the eye movement data of the tourist when gazing at different attractions when visiting the actual scenic area space.

[0056] It can be understood that after the steps of step S100 are executed, the specific execution steps can be: at intervals of a preset duration and / or when the tourist visits a new attraction, dynamically obtain the actual tour location and the tourist eye movement data of the tourist when visiting the actual scenic area space; Among them, the actual tour location is the location data obtained when the residence duration of the tourist in the current attraction is greater than or equal to the preset residence duration threshold; The tourist eye movement data is the eye movement data obtained when the gazing duration of the tourist at the current attraction is greater than or equal to the preset gazing duration threshold.

[0057] Furthermore, for the steps triggered by the preset duration: set a time interval as the preset duration, for example, every 5 minutes. When the time for the tourist to visit in the scenic area reaches this preset duration, the system automatically triggers the data acquisition mechanism, and obtains the actual tour location and the tourist eye movement data through the MR headset device. This way of regularly acquiring data can comprehensively record the tour behaviors of tourists at different time periods, and contribute to analyzing the trend of behavioral changes of tourists during the entire tour process.

[0058] For example, at time nodes such as the 5th minute, 10th minute, 15th minute, etc. after tourists enter the scenic area, the system will start the data collection program and obtain the actual tour location and eye movement data of tourists through the MR headset device.

[0059] Steps for triggering new attractions: When tourists arrive in a new attraction area, the system detects that the tourists have entered the new attraction range through positioning technology (such as GPS) or sensors in the scenic area (such as RFID readers), and then the system triggers data acquisition. This method can focus on the behaviors and reactions of tourists at specific attractions and understand the attractiveness of different attractions to tourists and the behavior patterns of tourists.

[0060] For example, when tourists enter a historical and cultural attraction area from a natural scenery attraction area, the system detects the location change and starts to obtain the corresponding dynamic tour data through the MR headset device.

[0061] Judgment of the stay duration: The system monitors the stay time of tourists in the current attraction in real time. When the stay duration of tourists in the current attraction is greater than or equal to the preset stay duration threshold, the location data of the tourists is obtained. This can exclude the situation of tourists' short stays (such as passing by) and ensure that the obtained data can better reflect the actual tour behaviors of tourists towards the attractions.

[0062] For example, the preset stay duration threshold is 10 minutes, and tourists stay at a certain attraction for 12 minutes. The system continuously or at a certain frequency obtains the location information of tourists within these 12 minutes to accurately record the tour path and stay location of tourists within the attraction.

[0063] Using positioning technology, the actual tour location of tourists is obtained through the MR headset device. However, to improve the accuracy of the actual location of tourists, the actual location of tourists in the scenic area can also be determined through methods such as the Global Positioning System (GPS), Bluetooth positioning, and Wi-Fi positioning. These technologies can provide relatively accurate location information in different environments.

[0064] For example, in outdoor open areas, GPS can provide relatively accurate location coordinates; in indoor areas or areas with many obstacles, Bluetooth positioning or Wi-Fi positioning can determine the actual location of tourists by interacting with base stations pre-deployed in the scenic area.

[0065] The steps for judging the fixation duration include: The system monitors the fixation direction and fixation duration of tourists through the MR headset device (such as glasses-type eye trackers, helmet-type eye trackers, etc.). When the fixation duration of tourists on the current attraction is greater than or equal to the preset fixation duration threshold, the eye movement data of tourists is obtained. This can obtain information on the degree of attention of tourists to different attractions and visual interest points.

[0066] For example, the preset gaze duration threshold is 8 seconds. When a tourist gazes at a characteristic building or landscape of a scenic spot for more than 8 seconds, the eye movement tracking device starts to record data such as the tourist's eye movement trajectory and fixation points.

[0067] Eye movement data includes multiple parameters, such as the position of the fixation point (which can be accurate to the coordinates on the screen or in the actual scene), the gaze duration, saccades (rapid switching of the line of sight between different fixation points), etc. By analyzing this data, the distribution of the tourist's visual focus can be understood, as well as which scenic elements attract the tourist's attention the most.

[0068] In some embodiments, based on the real-time orientation of the head-mounted display device of the MR head-mounted display, an eye movement ray is simulated and emitted for collision detection with the scene model. The gaze is determined through the eye movement speed (less than 30° / s) to obtain the tourist's gaze duration, and the degree of interest of the tourist in a specific scene is determined through the gaze duration.

[0069] For example, in a museum exhibition, through eye movement data, it can be found whether tourists will gaze at a certain precious cultural relic for a long time, and whether their line of sight is concentrated on a specific part of the cultural relic or they browse the whole.

[0070] By analyzing the actual tour location data and tourist eye movement data of tourists during the tour, it can effectively determine which scenic spots tourists are interested in and the degree of interest values in different scenic spots, so that the initial tour guide information of tourists can be updated, and target tour guide information more suitable for their interests and hobbies can be recommended to tourists to improve the tourist experience.

[0071] According to the actual tour location and eye movement data of tourists, the system can provide personalized tour path planning for tourists. For example, for tourists who like natural scenery and stay at natural scenic spots for a long time and have many fixation points, the system can recommend more similar natural scenic spots and plan a tour route more in line with their interests.

[0072] At the same time, by combining historical data and real-time data, the system can also avoid crowded areas for tourists according to the current flow of people at each scenic spot in the scenic area, improving the comfort of the tour.

[0073] Tourist eye movement data can reflect the degree of interest of tourists in different scenic spot contents. Based on this data, the scenic area can provide customized scenic spot introductions and explanations for tourists. For example, for tourists who are interested in the culture of a specific period in historical and cultural scenic spots, the system can push more detailed relevant historical stories and cultural background information through a mobile application or on-site interactive devices.

[0074] In step S300 of some embodiments, the initial tour guide information is dynamically updated based on the dynamic tour data to generate the target tour guide information that is dynamically updated when a tourist tours the actual scenic area space.

[0075] It can be understood that after the steps of step S200 are executed, the specific execution steps may be: obtaining the historical tour positions of the scenic spots that the tourist has toured in the actual scenic area space; Based on the historical tour positions of the visited scenic spots and the initial scenic spot positions corresponding to the initially predicted tour scenic spots, determining the tourist's tour deviation position; Obtaining the tour gaze duration of the tourist on the tour deviation scenic spot corresponding to the tour deviation position; In the case where the tour gaze duration is greater than or equal to the preset stay duration threshold, updating the interest degree values of the tourist for each scenic spot in the actual scenic area space according to the scenic spot information corresponding to the tour deviation scenic spot; Sorting each scenic spot in the actual scenic area space based on the interest degree values of the tourist for each scenic spot; Updating the initially predicted tour scenic spots according to the unvisited scenic spots after sorting to generate target predicted tour scenic spots, generating a target tour path according to the target predicted tour scenic spots, and forming the target tour guide information with the target predicted tour scenic spots and the target tour path.

[0076] Further, the system first collects the historical tour position data of the scenic spots that the tourist has visited. The historical tour position data includes detailed information such as the specific walking path and stay position of the tourist in each visited scenic spot. At the same time, obtaining the initial scenic spot position information corresponding to the initially predicted tour scenic spots, which can be, but is not limited to, based on the official recommended route of the scenic area, the ranking of popular scenic spots, or a preliminary prediction based on the tourist's historical preferences.

[0077] By comparing the actual tour position of the tourist and the initially predicted scenic spot position, calculating the difference between the two, so as to determine the tour deviation position. For example, if it is initially predicted that the tourist will first tour area X of scenic spot A, but the actual tourist stays in area Y of scenic spot A for a long time, then the position difference between area Y and area X is the tour deviation position. This deviation can be quantified as a difference in distance, direction, or area.

[0078] Using geographic information system (GIS) technology and data analysis algorithms to accurately calculate the tour deviation. GIS technology can digitize the scenic area map, accurately locate the scenic spot positions, and perform spatial analysis. The algorithm will compare the coordinate points of the tourist's actual tour path with the coordinate points of the initially predicted path, and the considerations may include route length, direction angle, stay time, etc., and comprehensively obtain the degree and direction of the tour deviation.

[0079] After determining the location of the tour deviation, continuously monitor the eye movements of tourists at the scenic spots with tour deviations through the MR headset device. The MR headset device can accurately record information such as the fixation points, fixation durations, and saccades of tourists.

[0080] Pay special attention to the fixation duration of tourists at the scenic spots with tour deviations, because the fixation duration at the scenic spots with tour deviations can reflect the degree of interest of tourists in these scenic spots. For example, if a tourist fixates for a long time in a specific display area of a scenic spot with a tour deviation, it indicates that this display area may have high attractiveness.

[0081] Furthermore, screen and statistically analyze the collected eye movement data. It will exclude some interfering data, such as data points of random glances or short stays of tourists, and focus on statistically analyzing the cumulative fixation durations of tourists in each meaningful area (such as important exhibits, characteristic landscapes, etc.) of the scenic spots with tour deviations. Thus, the accuracy of the eye movement data is improved.

[0082] Compare the fixation duration of tourists at the scenic spots with tour deviations with the preset stay duration threshold. If the fixation duration is greater than or equal to this threshold, it means that tourists show sufficient interest in this scenic spot with a tour deviation, and the system will activate relevant data for subsequent updates of the interest degree values.

[0083] For example, the preset stay duration threshold is 10 seconds, and a tourist fixates for 12 seconds in front of a certain sculpture at a scenic spot with a tour deviation. At this time, the system determines that the tourist has a high interest in the scenic spot where the sculpture is located and is ready to update the data in the interest degree system of the scenic spots in the scenic area.

[0084] According to the scenic spot information corresponding to the scenic spots with tour deviations, update the interest degree values of tourists for each scenic spot in the actual scenic area space. The interest degree values can be calculated through various algorithms, such as classification algorithms based on machine learning, weighted scoring algorithms, etc.

[0085] Taking a simple weighted scoring algorithm as an example, the system may assign a higher weight to the scenic spots with tour deviations. Factors such as the type, characteristics, and historical evaluations of tourists of these scenic spots will affect the size of the weight. If the fixation duration of tourists at the scenic spots with tour deviations is long and the weight of the scenic spot itself is high, then when updating the interest degree values, the interest degree values of this scenic spot and the surrounding related scenic spots will be significantly increased.

[0086] Use a sorting algorithm to sort each scenic spot in the actual scenic area space according to the updated interest degree values. Common sorting algorithms include bubble sort, quick sort, analytic hierarchy process (AHP), etc.

[0087] For example, the analytic hierarchy process can be used to decompose complex problems into multiple levels. In this case, scenic spots can be divided into different levels according to different types (such as natural landscapes, cultural landscapes, entertainment facilities, etc.), and then compared and ranked according to the interest level value in each level. After comprehensively considering the factors at each level, the final ranking of each scenic spot is obtained.

[0088] This ranking is not a one-time static process, but is constantly updated based on tourists’ new tour data and eye movement data. For example, as tourists continue to tour the scenic area, newly acquired data may cause attractions that were originally ranked low to move to the front due to further attention from tourists, so that the ranking can more accurately reflect tourists’ real-time changes in interest.

[0089] After analyzing and ranking the visited attractions, the system will turn its attention to the unvisited attractions. Based on the updated ranking of the attractions and the characteristics of the unvisited attractions (such as their relevance to the visited attractions, their complementary types, etc.), the system will update the initial predicted attractions and generate the target predicted attractions.

[0090] For example, if a tourist has visited several historical and cultural attractions and expressed strong interest in them, the system may predict the next cultural theme park that is related to them and ranks high among the unvisited attractions as the target tourist attraction.

[0091] Based on the target predicted tourist attractions, the system uses path planning algorithms (such as Dijkstra algorithm, A* algorithm, etc.) to plan the optimal path from the tourist's current location to the target predicted tourist attractions. This path comprehensively considers factors such as distance, road conditions, and crowd density.

[0092] Finally, the target predicted tourist attractions and target tour routes are combined into target guide information. These target guide information can be pushed to tourists in a timely manner through electronic guide devices and / or MR head display devices (such as mobile phone applications, smart tour guide devices, etc.) in the scenic area, providing tourists with more accurate and personalized tour guidance.

[0093] The embodiment provided by the present invention can update the guide information in real time, so that tourists can obtain recommendations of attractions that better suit their current interests and preferences. For example, if tourists show strong interest in a certain type of attraction (such as ancient buildings) during the tour, the updated guide information of the system will recommend other high-quality attractions of the same type to tourists, allowing tourists to explore the areas of their interest more deeply and avoid wasting time on attractions that they are not interested in, thereby improving the satisfaction of the entire tour experience.

[0094] The embodiment provided by the present invention can help tourists to travel more efficiently in scenic spots and reduce unnecessary travel through personalized target tour route planning. Especially in large and complex scenic spots, reasonable route planning can save tourists' physical strength and time, so that tourists can better enjoy the tour process.

[0095] The embodiments provided by the present invention may bring unexpected surprises to tourists by updating the guide information based on dynamic tour data. Tourists may discover attractions or a special area in the attractions that they had not noticed before because of the recommendation of the system. For example, through the analysis of the gaze duration data, the system discovers the potential interest of tourists in a niche attraction and recommends it to tourists. Tourists may have a unique experience in the attraction, enriching the content of the tour.

[0096] The embodiments provided by the present invention help the system to more accurately grasp the needs of tourists by updating the guide information in real time. The traditional guide method may only provide relatively fixed routes and recommendations, while the dynamic update mechanism can be adjusted according to the actual behavior and feedback of tourists. For example, if most tourists show similar interest deviations when visiting a certain attraction, the system can adjust the recommendation strategy in time to make the guide information more in line with the expectations of most tourists, thereby improving the quality and effect of the guide service.

[0097] In step S400 of some embodiments, an interactive scene corresponding to an interactive scenic spot is determined based on the target guide information and the actual tour position of the tourists when touring the actual scenic spot space, so that when the tourists arrive at the interactive scenic spot position corresponding to the interactive scenic spot, they can perform corresponding interactive operations according to the interactive scene; the actual scenic spot space includes at least a plurality of interactive scenic spots, and the interactive scenic spots represent the scenic spots that tourists can enter into the interactive scene when touring the actual scenic spot space.

[0098] In some embodiments of the present invention, the interaction scene at least includes: a dynamic map scene.

[0099] The determining of the interactive scene corresponding to the interactive scenic spot based on the target navigation information and the actual tour location of the tourists when touring the actual scenic spot space includes: A first processing is performed based on the target guide information, the map of the actual scenic area space and the actual tour route to generate a dynamic map for touring the unvisited attractions; the dynamic map represents the display of the target predicted tour attractions and the target tour path when tourists visit the unvisited attractions.

[0100] It should be noted that the system performs a first processing based on the target tour information, the scenic area map, and the actual tour route of the tourists. Through the integration of these data, a dynamic map is generated, which not only shows the areas that the tourists have visited, but also highlights the target predicted tour attractions and the best paths to these attractions.

[0101] When the tourists arrive at an interactive attraction, the system identifies the actual location of the tourists and activates the dynamic map scenario. At this time, the tourists can view the dynamically updated map through the MR headset device and / or the electronic tour guide device (such as a mobile phone application or a smart tour guide device) to understand the relationship between the current location and the target attractions, as well as how to get there. This real-time updated map can help the tourists navigate better, avoid getting lost, and at the same time provide a preview of the upcoming attractions.

[0102] In some embodiments of the present invention, the interactive scenario at least includes: a personalized explanation scenario; The determining of the interactive scenario corresponding to the interactive attraction based on the target tour information and the actual tour location of the tourists when touring the actual scenic area space further includes: Performing a second processing based on the target tour information and the actual tour location of the tourists when touring the actual scenic area space to generate a personalized explanation scenario; the personalized explanation scenario represents that when the tourists arrive at the tour explanation location corresponding to the personalized explanation scenario, a personalized tour guide word corresponding to the scenic spot at the tour explanation location is played according to the tourist label.

[0103] It can be understood that the system uses the target tour information and the actual tour location of the tourists in the scenic area to perform a second processing. Combining the tourist's interest label and historical behavior data, the system can generate personalized explanation content.

[0104] When the tourists approach an interactive attraction with personalized explanation, the system plays the corresponding tour guide word according to the tourist label. For example, if the tourists are interested in historical stories, the system may provide a detailed account of the historical background of the scenic spot; if the tourists like art, it may introduce the art works in the scenic spot and their significance. This personalized service enables each tourist to obtain an exclusive experience that meets their own interests.

[0105] In some embodiments of the present invention, the interactive scenario at least includes: a game interaction scenario; The determining of the interactive scenario corresponding to the interactive attraction based on the target tour information and the actual tour location of the tourists when touring the actual scenic area space further includes: When the actual tour location matches the game attraction location corresponding to a specific game attraction, a game interaction scene corresponding to the specific game attraction is generated according to the target tour guide information; the game interaction scene represents that when a tourist arrives at the game attraction location, a virtual game display interface is displayed, so that the tourist can interact with the game in the virtual game display interface through actions and language.

[0106] It can be understood that the system detects the actual tour location of the tourist and matches it with the location of a specific game attraction. Once the match is successful, a corresponding game interaction scene is generated according to the target tour guide information.

[0107] When the tourist arrives at the game attraction, the system displays a virtual game display interface and invites the tourist to participate in an interactive game. These games may include various forms such as treasure hunting, puzzle solving, or augmented reality (AR) experiences. The tourist can interact with the game interface through actions or language and can obtain points or rewards after completing the challenges. This type of interaction not only increases the fun of the tour but also encourages the tourist to explore different corners of the scenic area.

[0108] In some embodiments of the present invention, the interaction scene at least includes: a rest scene; Determining an interaction scene corresponding to an interaction attraction based on the target tour guide information and the actual tour location of the tourist when touring the actual scenic area space further includes: When the actual tour location matches the rest attraction location corresponding to a specific rest attraction, a rest scene corresponding to the rest attraction location is generated according to the target tour guide information; the rest scene represents that when a tourist arrives at the rest attraction location, a rest prompt is generated, and when it is detected that the tourist performs a rest action according to the rest prompt, rest audio is played.

[0109] It can be understood that the system monitors the actual tour location of the tourist, especially paying attention to whether it coincides with a preset rest attraction. When it is detected that the tourist is in the rest area, an appropriate rest prompt is generated according to the target tour guide information.

[0110] When the tourist enters the rest scene, the receiving device will prompt them that it is a good time to rest and provide some relaxation suggestions, such as deep breathing exercises or short meditation guidance. If the tourist takes action according to the prompt, the system can also play soft music or natural sounds to help the tourist relax. Such a design aims to promote the health and well-being of the tourist and ensure that they can maintain a good physical state while enjoying the trip.

[0111] In the embodiments provided by the present invention, by providing a dynamic map, personalized explanations, and gamification elements, tourists can participate more actively in the tour activities instead of passively receiving information. The personalized service ensures that each tourist can obtain an experience that meets their personal preferences, thereby increasing their overall satisfaction with the trip. The game interaction scenarios stimulate the tourists' curiosity and desire to explore, prompting them to visit more attractions and try new activities. The rest scenarios remind and guide tourists to take breaks at appropriate times, which helps prevent the accumulation of fatigue and maintain a pleasant mood to continue the journey.

[0112] Figure 2 It is the second flowchart of the intelligent guided tour method based on the MR headset device provided by the present invention. An embodiment of an intelligent guided tour method based on the MR headset device may further include, but is not limited to, the following steps: 1. Establishment of a static database: (1) Tourist database: Determine the tourist needs and portraits through a broad-spectrum user survey. The survey content includes questionnaire surveys (touring methods, guided tour needs, interaction method preferences) and behavioral experiments (touring paths, touring durations, visual preferences). Cluster the above characteristic values to form several types of tourist groups, corresponding to different subsequent interaction method settings.

[0113] (2) Scenic area database: Include the digital assets of the scenic area formed by spatial scanning (two-dimensional planes, three-dimensional models, etc.), generally provided by the scenic area.

[0114] (3) Explanation knowledge base: Based on the historical text materials of the scenic area, use a large language model to assist in generating personalized guided tour words for different tourist needs, and integrate them into the explanation knowledge base.

[0115] 2. Set initial guided tour information (initial touring path and initial predicted touring attractions): Based on the tourist database and the scenic area database, different types of initial guided tour information are set for different types of tourist groups, including the attractions that tourists need to pass through and their paths. This initial guided tour information will be adjusted and updated according to the real-time dynamic data of tourists during subsequent tours.

[0116] 3. Monitoring of dynamic behavior data: The data includes eye movement data and position data, which are sourced from the MR headset device. During the tourist's tour, the MR headset device can identify the duration of their gaze at the scenery to judge their level of interest.

[0117] 4. Multimodal interaction: During the guided tour, users can experience multimodal interaction methods such as vision and hearing. Specifically, it includes the following four types: 1) Dynamic map scenario: Display the initial touring path and the initial predicted touring attractions, and update them in real time during the tour.

[0118] 2) Personalized Explanation Scenario: Based on the explanation knowledge base, at each scenic spot, the user's location is automatically detected and the corresponding explanation words are played.

[0119] 3) Game Interaction Scenario: For specific garden scenic spots, interactive mini-games are set up in combination with their historical allusions, cultural connotations, etc., such as the reproduction of ancient style scenes, gesture interactions, etc.

[0120] 4) Rest Scenario: In the pavilions and towers suitable for rest, the rest module is triggered to play light music, interesting videos, etc. for the user.

[0121] The specific content of the interaction varies according to different types of tourist groups to meet their tour needs.

[0122] As the number of users increases, the system will continuously expand the tourist database, collect more tourist behavior information, and correspond it with their basic information (age, gender, tour preferences, etc.), so as to optimize the settings of the initial package (more accurate tour duration, more convenient tour route, etc.).

[0123] In some embodiments of the present invention, the scenic areas of the present invention may include but are not limited to garden scenic areas, museum scenic areas, amusement park scenic areas, etc.

[0124] Figure 3 It is a schematic diagram of the block model for alignment provided by the present invention. Figure 4 It is a schematic diagram of the garden plane positioning beacon provided by the present invention. Combining Figure 3 and Figure 4 , through spatial scanning means, a digital model of the garden space is obtained, and the digital model of the garden space is simplified to form a block model. Relying on the spatial calibration scheme of the MR head-mounted device (SuiGuang RhinoX2.0) based on physical beacons, the simplified block model is aligned with the real physical space. Set the origin point in the simplified block model, and manually place the main positioning beacon at this origin point in the real space to achieve the alignment and superposition of the real space and the model.

[0125] The steps for obtaining the digital model of the garden space include: Spatial Scanning Means: Common spatial scanning technologies include LiDAR (Light Detection and Ranging) scanning, 3D laser scanning, etc. These technologies can quickly and accurately obtain the three-dimensional coordinate information of various objects and terrains in the garden space by emitting laser beams and measuring the time and angle of the reflected light.

[0126] For example, in a large garden project, using a 3D laser scanner to scan the entire park can capture the detailed geometric shapes and position information of buildings, trees, terrains, etc., and generate point cloud data containing a large number of data points.

[0127] After obtaining the digital model, it is necessary to simplify it and convert it into a volumetric model. This helps to reduce the complexity of the data and improve the efficiency of subsequent processing and analysis.

[0128] The simplification methods can include mesh simplification, polygon merging, etc. For example, for some complex tree models, adjacent triangular meshes can be merged to form an approximate volume to represent the overall shape of the tree.

[0129] The steps of alignment and overlay based on the spatial calibration scheme of the Flingo RhinoX 2.0 relying on physical beacons include: Principle of the spatial calibration scheme: Flingo RhinoX 2.0 is a professional MR headset device. Its spatial calibration scheme based on physical beacons determines the accurate position and orientation of the model in the real space by setting beacons (marking points) with known positions and postures in the real space.

[0130] Physical beacons are usually objects with obvious characteristic identifiers, such as colored marker balls, QR code labels, etc. The positions of these beacons in the real space can be accurately measured by high-precision measurement devices (such as total stations).

[0131] Setting the origin and placing the main positioning beacon: Setting the origin in the simplified volumetric model is an important step in spatial calibration. The origin is usually selected at a specific position of the model, such as the center point of the garden or the base point of an important building. This origin will serve as a reference point between the model coordinate system and the real space coordinate system.

[0132] Then, manually place the main positioning beacon at this origin position in the real space. The main positioning beacon is a key reference point, and its position and posture will be accurately measured and recorded. By aligning the main positioning beacon with the origin in the model, the initial alignment between the real space and the model can be achieved.

[0133] The positioning beacons include the main alignment beacon and the secondary positioning beacon. The main positioning beacon is aligned with the model origin, and the real space and the model are aligned by combining the secondary positioning beacon.

[0134] Achieving alignment and overlay: After placing the main positioning beacon, the software will calculate the translation, rotation, and scaling parameters of the model in the real space based on the actual position of the beacon and the origin position set in the model. Then, by performing corresponding transformation operations on the model, it can be completely aligned and overlaid with the real space.

[0135] For example, if there is a certain offset and rotation angle between the model and the real space in the initial state, the software will automatically adjust the position and orientation of the model according to the position information of the main positioning beacon, so that it perfectly matches the object in the real space. In this way, in the actual garden planning, design and analysis work, operations can be directly carried out on the accurate 3D model, improving work efficiency and accuracy.

[0136] Figure 5 It is a product schematic diagram of the MR headset device provided by the present invention. The MR headset device is used to execute the above-mentioned intelligent guided tour method based on the MR headset device and at least includes the steps of the intelligent guided tour system based on the MR headset device. The intelligent guided tour system framework based on the MR headset device integrates traditional static data (such as basic tourist information, scenic area information, etc.) and dynamic data (such as tourist position data, eye movement data, etc.), and constructs a garden guided tour system in which a static database and dynamic real-time monitoring data complement each other and iterate and feedback. In the traditional guided tour mode, the system recommends scenic spots and initial paths based on the static database; while in the intelligent guided tour system based on the MR headset device provided by the present invention, the position and physiological information (such as eye movement, position data, etc.) of tourists during the tour are captured in real time through the headset, and multimodal interaction is realized. As the application scope of the system continues to expand and the number of users continues to increase, the mutual feedback between real-time behavior data and the static database will prompt the system to continuously update, iterate and optimize, so as to provide tourists with a more rich, convenient and personalized tour experience.

[0137] As a complex system integrating a variety of advanced technologies, the MR (Mixed Reality) headset device contains key components far more than just providing a basic visual experience, at least including: 1. Spatial interaction Camera, 2. Light intensity sensing Sensor, 3. RGB Camera, 4. Upward-looking IR Camera, 5. Forward-looking IR Camera, 6. Laser point cloud TOF.

[0138] Image capture by the spatial interaction Camera, which can capture images of the surrounding real environment, including various objects, people and scenes. These images are the basis for constructing the mixed reality experience. By fusing virtual elements with real environment images, users can feel the effect of the coexistence of virtual elements and the real world.

[0139] Hand tracking of the spatial interaction Camera: It can identify the actions and positions of the user's hands. For example, when the user extends a finger to point at a virtual object, the spatial interaction Camera can capture this action, thereby realizing operations on the virtual object, such as selection, movement or rotation, etc.

[0140] Ambient Light Sensing of Light Intensity Sensor: It is used to detect the light intensity of the surrounding environment. Under different lighting conditions, it can help the headset device adjust the brightness and contrast of the virtual image. For example, in a bright outdoor environment, it makes the virtual image clearer and more visible; in a darker environment, it reduces the brightness of the virtual image to avoid being too dazzling.

[0141] Energy-saving Optimization of Light Intensity Sensor: According to the ambient light intensity information, it reasonably controls the power consumption of the headset device. In sufficient light conditions, the brightness of the screen backlight can be appropriately reduced to extend the battery life.

[0142] Color Capture of RGB Camera: It is responsible for capturing the rich color information of the real environment. It can identify various colors and integrate these color information into the mixed reality image, making the colors of virtual elements more coordinated with the real environment.

[0143] Eye Tracking Assistance of Upward-looking IR Camera: It is mainly used to assist in realizing the eye tracking function. It can monitor the movement direction of the user's eyes, especially when looking upward, to help determine the user's line of sight focus, thus achieving more precise interaction operations.

[0144] Gesture Recognition of Forward-looking IR Camera: It can recognize the gesture actions of the user in the forward direction. It can detect the movement trajectory and posture of the hand through infrared signals to realize gesture-based interaction operations, such as waving to switch scenes, making a fist to select options, etc.

[0145] Obstacle Detection of Forward-looking IR Camera: It detects obstacles in the front to provide safety tips for the user. For example, when the user is walking in the mixed reality environment, the forward-looking IR Camera can timely detect real objects in the front to prevent the user from colliding.

[0146] Depth Measurement of Laser Point Cloud TOF: Using the Time of Flight principle, it emits laser and receives the reflected light, and determines the distance of the object by calculating the round-trip time of the laser. In this way, a three-dimensional point cloud model of the surrounding environment can be created to accurately obtain the depth information of the real scene.

[0147] Spatial Modeling of Laser Point Cloud TOF: Construct a detailed spatial model according to the depth information. In mixed reality applications, this spatial model can help virtual elements better integrate into the real environment, achieving more realistic occlusion relationships and interaction effects. For example, when a virtual object is placed behind a real object, the spatial model created by TOF technology can ensure that the virtual object is correctly occluded by the real object.

[0148] The intelligent navigation system based on the MR headset device provided by the present invention will be described below. The intelligent navigation system based on the MR headset device described below can be mutually referred to the intelligent navigation method based on the MR headset device described above.

[0149] As Figure 6 is a schematic structural diagram of the intelligent navigation system based on the MR headset device provided by the present invention. An intelligent navigation system based on the MR headset device includes the following modules: The initial navigation information generation module 610 is configured to obtain static tour data and generate initial navigation information based on the static tour data; The dynamic tour data acquisition module 620 is configured to acquire dynamic tour data of tourists when visiting the actual scenic area space; The target navigation information generation module 630 is configured to dynamically update the initial navigation information based on the dynamic tour data and generate target navigation information that is dynamically updated when tourists visit the actual scenic area space; The interaction scenario determination module 640 is configured to determine an interaction scenario corresponding to an interaction scenic spot based on the target navigation information and the actual tour position of tourists when visiting the actual scenic area space, so that when the tourists reach the interaction scenic spot position corresponding to the interaction scenic spot, they can perform corresponding interaction operations according to the interaction scenario; the actual scenic area space at least includes a plurality of interaction scenic spots, and the interaction scenic spots represent that tourists can enter the interaction scenario when visiting the actual scenic area space.

[0150] Preferably, the intelligent navigation system based on the MR headset device provided by the present invention is specifically further configured that the static tour data at least includes: tourist personal data, initial scenic area data, and scenic area historical text data; Classify the tourist personal data to obtain different categories of tourist labels; Normalize the two-dimensional scenic area data, three-dimensional scenic area data, and scenic area description data of the initial scenic area data to obtain scenic area space data corresponding to the actual scenic area space; Perform word conversion processing on the scenic area historical text data to generate personalized navigation words corresponding to the tourist labels; Process the different categories of tourist labels, the scenic area space data, and the personalized navigation words based on a preset tour recommendation strategy to generate initial navigation information corresponding to different categories of tourists. The initial navigation information at least includes an initial tour path and initial predicted tour scenic spots; The initial tour path is a tour route formed by sorting a plurality of initial predicted tour scenic spots according to the interest degree value of tourists; the interest degree value is determined according to each scenic spot in the tourist label and the scenic area space data.

[0151] Preferably, the intelligent navigation system based on the MR headset device provided by the present invention is specifically further configured such that the dynamic tour data at least includes the actual tour location and the tourist eye movement data; At every preset time interval and / or when the tourist tours to a new scenic spot, dynamically obtain the actual tour location and the tourist eye movement data of the tourist when touring the actual scenic area space; Wherein, the actual tour location is the location data obtained when the residence time of the tourist in the current scenic spot is greater than or equal to a preset residence time threshold; The tourist eye movement data is the eye movement data obtained when the fixation time of the tourist on the current scenic spot is greater than or equal to a preset fixation time threshold.

[0152] Preferably, the intelligent navigation system based on the MR headset device provided by the present invention is specifically further configured to obtain the historical tour locations of the visited scenic spots of the tourist when touring the actual scenic area space; Based on the historical tour locations of the visited scenic spots and the initial scenic spot locations corresponding to the initial predicted tour scenic spots, determine the tour deviation locations of the tourist; Obtain the tour fixation time of the tourist on the tour deviation scenic spots corresponding to the tour deviation locations; When the tour fixation time is greater than or equal to the preset residence time threshold, update the interest degree values of the tourist for each scenic spot in the actual scenic area space according to the scenic spot information corresponding to the tour deviation scenic spots; Sort each scenic spot in the actual scenic area space based on the interest degree values of the tourist for each scenic spot; Update the initial predicted tour scenic spots according to the unvisited scenic spots after sorting to generate target predicted tour scenic spots, and generate a target tour path according to the target predicted tour scenic spots, and form the target navigation information with the target predicted tour scenic spots and the target tour path.

[0153] Preferably, the intelligent navigation system based on the MR headset device provided by the present invention is specifically further configured such that the interaction scenarios at least include: a dynamic map scenario; Perform a first process based on the target navigation information, the map of the actual scenic area space, and the actual tour route to generate a dynamic map for touring the unvisited scenic spots; the dynamic map represents that when the tourist tours the unvisited scenic spots, the target predicted tour scenic spots and the target tour path are displayed; The interaction scenarios at least include: a personalized explanation scenario; The determining of the interaction scenario corresponding to the interaction scenic spot based on the target navigation information and the actual tour location of the tourist when touring the actual scenic area space further includes: Perform a second process based on the target tour guide information and the actual tour location of the tourist when visiting the actual scenic area space to generate a personalized explanation scenario; the personalized explanation scenario represents that when the tourist arrives at the tour explanation location corresponding to the personalized explanation scenario, play the personalized tour guide words of the scenic spot corresponding to the tour explanation location according to the tourist label.

[0154] Preferably, the intelligent tour guide system based on the MR head-mounted device provided by the present invention is specifically further used for the interaction scenario to at least include: a game interaction scenario; When the actual tour location matches the game scenic spot location corresponding to a specific game scenic spot, generate a game interaction scenario corresponding to the specific game scenic spot according to the target tour guide information; the game interaction scenario represents that when the tourist arrives at the game scenic spot location, display a virtual game display interface so that the tourist can interact with the game on the virtual game display interface through actions and language. The interaction scenario at least includes: a rest scenario; Preferably, the intelligent tour guide system based on the MR head-mounted device provided by the present invention is specifically further used for generating a rest scenario corresponding to the rest scenic spot location according to the target tour guide information when the actual tour location matches the rest scenic spot location corresponding to a specific rest scenic spot; the rest scenario represents that when the tourist arrives at the rest scenic spot location, generate a rest prompt, and play a rest audio when it is detected that the tourist performs a rest action according to the rest prompt.

[0155] An intelligent tour guide method, system, medium and MR head-mounted device provided by the present invention obtain static tour data, and generate initial tour guide information based on the static tour data; obtain the dynamic tour data of the tourist when visiting the actual scenic area space; dynamically update the initial tour guide information based on the dynamic tour data to generate the target tour guide information that is dynamically updated when the tourist visits the actual scenic area space; determine an interaction scenario corresponding to an interaction scenic spot based on the target tour guide information and the actual tour location of the tourist when visiting the actual scenic area space, so that when the tourist arrives at the interaction scenic spot location corresponding to the interaction scenic spot, perform corresponding interaction operations according to the interaction scenario; the actual scenic area space at least includes a plurality of interaction scenic spots, and the interaction scenic spot represents a scenic spot where the tourist can enter the interaction scenario when visiting the actual scenic area space. It realizes the dynamic update of the target tour guide information based on the static tour data and the dynamic tour data, and generates an interaction scenario that enables the tourist to perform interaction operations, which can not only significantly provide tour guide information for the tourist, but also increase the sense of experience of the tourist's tour interaction.

[0156] Figure 7 Illustrate a schematic physical structure diagram of an electronic device, such asFigure 7 As shown, the electronic device may include: a processor 710, a communications interface 720, a memory 730, and a communication bus 740. Among them, the processor 710, the communications interface 720, and the memory 730 complete communication with each other through the communication bus 740. The processor 710 may call logic instructions in the memory 730 to execute an intelligent navigation method based on an MR headset device. The method includes: obtaining static tour data and generating initial navigation information based on the static tour data; obtaining dynamic tour data of a tourist when touring an actual scenic area space; dynamically updating the initial navigation information based on the dynamic tour data to generate target navigation information that is dynamically updated when the tourist tours the actual scenic area space; determining an interaction scenario corresponding to an interaction scenic spot based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space, so that when the tourist reaches the interaction scenic spot position corresponding to the interaction scenic spot, the tourist performs corresponding interaction operations according to the interaction scenario; the actual scenic area space includes at least a plurality of interaction scenic spots, and the interaction scenic spots represent scenic spots where the tourist can enter the interaction scenario when touring the actual scenic area space.

[0157] In addition, when the logic instructions in the above-mentioned memory 730 are implemented in the form of a software functional unit and sold or used as an independent product, they may be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: various media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk, or an optical disc that can store program codes.

[0158] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the intelligent navigation method based on the MR head-mounted display device provided by the above-mentioned various methods. The method includes: obtaining static tour data, and generating initial navigation information based on the static tour data; obtaining dynamic tour data of a tourist when touring an actual scenic area space; dynamically updating the initial navigation information based on the dynamic tour data to generate target navigation information that is dynamically updated when the tourist tours the actual scenic area space; determining an interaction scenario corresponding to an interaction scenic spot based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space, so that when the tourist arrives at the interaction scenic spot position corresponding to the interaction scenic spot, the tourist performs corresponding interaction operations according to the interaction scenario; the actual scenic area space includes at least multiple interaction scenic spots, and the interaction scenic spots represent the scenic spots where the tourist can enter the interaction scenario when touring the actual scenic area space.

[0159] In another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is implemented to execute the intelligent navigation method based on the MR head-mounted display device provided by the above-mentioned various methods. The method includes: obtaining static tour data, and generating initial navigation information based on the static tour data; obtaining dynamic tour data of a tourist when touring an actual scenic area space; dynamically updating the initial navigation information based on the dynamic tour data to generate target navigation information that is dynamically updated when the tourist tours the actual scenic area space; determining an interaction scenario corresponding to an interaction scenic spot based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space, so that when the tourist arrives at the interaction scenic spot position corresponding to the interaction scenic spot, the tourist performs corresponding interaction operations according to the interaction scenario; the actual scenic area space includes at least multiple interaction scenic spots, and the interaction scenic spots represent the scenic spots where the tourist can enter the interaction scenario when touring the actual scenic area space.

[0160] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative labor.

[0161] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solutions, in essence, or the parts that contribute to the prior art can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0162] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An intelligent navigation method based on an MR headset device, characterized in that, Applied to an MR headset device, the method includes: Obtain static tour data and generate initial tour guidance information based on the static tour data; Obtain the dynamic tour data of the tourist when visiting the actual scenic area space; Dynamically update the initial tour guidance information based on the dynamic tour data to generate the target tour guidance information that is dynamically updated when the tourist visits the actual scenic area space; Based on the target tour guidance information and the actual tour location of the tourist when visiting the actual scenic area space, determine the interaction scenario corresponding to the interaction scenic spot, so that when the tourist arrives at the interaction scenic spot location corresponding to the interaction scenic spot, perform corresponding interaction operations according to the interaction scenario; the actual scenic area space includes at least multiple interaction scenic spots, and the interaction scenic spot represents a scenic spot where the tourist can enter the interaction scenario when visiting the actual scenic area space.

2. The intelligent tour guidance method based on an MR headset device according to claim 1, wherein The static tour data at least includes: tourist personal data, initial scenic area data, and scenic area historical text data; The generating of the initial tour guidance information based on the static tour data includes: Classify the tourist personal data to obtain tourist labels of different categories; Normalize the two-dimensional scenic area data, three-dimensional scenic area data, and scenic area description data of the initial scenic area data to obtain scenic area space data corresponding to the actual scenic area space; Perform word conversion processing on the scenic area historical text data to generate personalized tour guide words corresponding to the tourist labels; Process the tourist labels of different categories, the scenic area space data, and the personalized tour guide words based on a preset tour recommendation strategy to generate initial tour guidance information corresponding to tourists of different categories, and the initial tour guidance information at least includes an initial tour path and initial predicted tour scenic spots; The initial tour path is a tour route formed by sorting multiple initial predicted tour scenic spots according to the interest degree value of the tourist; the interest degree value is determined according to each scenic spot in the tourist label and the scenic area space data.

3. The intelligent tour guidance method based on an MR headset device according to claim 2, wherein The dynamic tour data at least includes the actual tour location and the tourist eye movement data; The obtaining of the dynamic tour data of the tourist when visiting the actual scenic area space includes: At intervals of a preset time period and / or when the tourist visits a new scenic spot, dynamically obtain the actual tour location and the tourist eye movement data of the tourist when visiting the actual scenic area space; Wherein, the actual tour location is the location data obtained when the residence time of the tourist in the current scenic spot is greater than or equal to a preset residence time threshold; The tourist eye movement data is the eye movement data obtained when the fixation time of the tourist on the current scenic spot is greater than or equal to a preset fixation time threshold.

4. The intelligent tour guidance method based on an MR headset device according to claim 3, wherein The dynamically updating the initial tour guidance information based on the dynamic tour data to generate the target tour guidance information that is dynamically updated when the tourist visits the actual scenic area space includes: Obtain the historical tour positions of the visited scenic spots where tourists have toured the actual scenic area space; Based on the historical tour positions of the visited scenic spots and the initial scenic spot positions corresponding to the initially predicted tour scenic spots, determine the tour deviation positions of the tourists; Obtain the tour gaze duration of the tourists on the tour deviation scenic spots corresponding to the tour deviation positions; When the tour gaze duration is greater than or equal to the preset stay duration threshold, update the interest degree values of the tourists for each scenic spot in the actual scenic area space according to the scenic spot information corresponding to the tour deviation scenic spots; Sort each scenic spot in the actual scenic area space based on the interest degree values of the tourists for each scenic spot; Update the initially predicted tour scenic spots according to the unvisited scenic spots after sorting, generate target predicted tour scenic spots, and generate a target tour path according to the target predicted tour scenic spots, and form the target navigation information with the target predicted tour scenic spots and the target tour path.

5. The intelligent navigation method based on an MR headset device according to claim 4, characterized in that The interaction scenarios at least include: a dynamic map scenario; Determining an interaction scenario corresponding to an interaction scenic spot based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space includes: Performing a first process based on the target navigation information, the map of the actual scenic area space, and the actual tour route to generate a dynamic map for touring the unvisited scenic spots; the dynamic map represents that when the tourist tours the unvisited scenic spots, the target predicted tour scenic spots and the target tour path are displayed; The interaction scenarios at least include: a personalized explanation scenario; Determining an interaction scenario corresponding to an interaction scenic spot based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space further includes: Performing a second process based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space to generate a personalized explanation scenario; the personalized explanation scenario represents that when the tourist arrives at the tour explanation position corresponding to the personalized explanation scenario, a personalized guided tour word corresponding to the scenic spot at the tour explanation position is played according to the tourist label.

6. The intelligent navigation method based on an MR headset device according to claim 5, characterized in that The interaction scenarios at least include: a game interaction scenario; Determining an interaction scenario corresponding to an interaction scenic spot based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space further includes: When the actual tour position matches the game scenic spot position corresponding to a specific game scenic spot, generating a game interaction scenario corresponding to the specific game scenic spot according to the target navigation information; the game interaction scenario represents that when the tourist arrives at the game scenic spot position, a virtual game display interface is presented, so that the tourist can interact with the game on the virtual game display interface through actions and language; The interaction scenarios at least include: a rest scenario; Determining an interaction scenario corresponding to an interaction attraction based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space further includes: When the actual tour position matches the rest attraction position corresponding to a specific rest attraction, generating a rest scenario corresponding to the rest attraction position according to the target navigation information; the rest scenario represents that when the tourist arrives at the rest attraction position, a rest prompt is generated, and when it is detected that the tourist performs a rest action according to the rest prompt, rest audio is played.

7. An intelligent navigation system based on an MR headset device, characterized in that, Applied to an MR headset device, the system includes: An initial navigation information generation module for obtaining static tour data and generating initial navigation information based on the static tour data; A dynamic tour data acquisition module for obtaining the dynamic tour data of the tourist when touring the actual scenic area space; A target navigation information generation module for dynamically updating the initial navigation information based on the dynamic tour data and generating the dynamically updated target navigation information of the tourist when touring the actual scenic area space; An interaction scenario determination module for determining an interaction scenario corresponding to an interaction attraction based on the target navigation information and the actual tour position of the tourist when touring the actual scenic area space, so that when the tourist arrives at the interaction attraction position corresponding to the interaction attraction, corresponding interaction operations are performed according to the interaction scenario; the actual scenic area space at least includes a plurality of interaction attractions, and the interaction attraction represents that the tourist can enter the interaction scenario when touring the actual scenic area space.

8. An MR headset device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, characterized in that, When the processor executes the program, the intelligent navigation method based on the MR headset device as described in any one of claims 1 to 6 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, the intelligent navigation method based on the MR headset device as described in any one of claims 1 to 6 is implemented.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, the intelligent navigation method based on the MR headset device as described in any one of claims 1 to 6 is implemented.

Images