Intelligent navigation method and system based on model and storage medium

Abstract

The invention discloses an intelligent navigation method and system based on a model and a storage medium, and the method comprises the steps: obtaining user registration information and / or a questionnaire survey result through a navigation terminal device carried by a user, so as to generate a user portrait, obtaining a recommended touring route according to the user portrait, the touring starting position of the user and the scenic spot touring recommendation route, and pushing the recommended touring route to the user through a touring guide terminal device; the method comprises the following steps: acquiring shooting data of a user through a navigation terminal device, performing scenic spot target object identification on the shooting data by using a CV model, and obtaining a specific tourist area where the user is located according to current position data of the user and scenic spot geographic data information; obtaining explanation content from a knowledge base constructed by the system according to a specific tourist area and a scenic spot target object where the user is located, and generating explanation words by adopting AIGC according to the explanation content; and language and image-text explanation is realized according to the explanation words, so that the sightseeing experience of the user is improved, and intelligent and richer guide explanation is provided.

Description

Technical Field

[0001] This invention relates to the field of intelligent cultural tourism, and in particular to a model-based intelligent tour guide method, system, and storage medium. Background Technology

[0002] Current scenic area tours mainly rely on audio guides set up at fixed points within the scenic area. When users need a guided tour, they need to go to the corresponding point where a guide operates the audio guide or provides an explanation based on the content provided by the audio guide. This method results in a limited range of explanations, with the content generally consisting of official text or audio descriptions. The explanations are not very intelligent and provide a poor user experience. Summary of the Invention

[0003] In order to overcome the shortcomings of the existing technology, one of the objectives of this invention is to provide a model-based intelligent tour guide method, which can solve the problems of existing tour guide explanations being monotonous and not intelligent enough.

[0004] The second objective of this invention is to provide a model-based intelligent tour guide system, which can solve the problems of existing tour guide explanations being monotonous and lacking in intelligence.

[0005] The third objective of this invention is to provide a computer-readable storage medium that can solve the problems of existing guided tours being monotonous and lacking in intelligence.

[0006] One of the objectives of this invention is achieved through the following technical solution:

[0007] A model-based intelligent navigation method, the intelligent navigation method including

[0008] Tour route recommendation steps: Obtain user registration information and / or questionnaire results through the user's guided tour terminal device to generate a user profile, and then derive a recommended tour route based on the user profile, the user's starting position and the recommended tour routes of attractions in the system, and push the recommended tour route to the user through the guided tour terminal device;

[0009] Explanation of matching steps: Acquire the shooting data taken by the user through the guide terminal device and use the CV model to identify the target objects of the scenic spot in the shooting data. Then, determine the specific tourist area where the user is located based on the user's current location data and scenic area geographical data information. Then, based on the specific tourist area where the user is located and the target objects of the scenic spot, obtain the explanation content from the knowledge base built by the system, and generate explanation words based on the explanation content using AIGC.

[0010] Interactive explanation steps: Based on the user-defined voice playback mode and explanation text, corresponding voice content is generated using voice synthesis technology and played to the user through the tour guide terminal device; and graphic explanation text is generated based on the explanation text and displayed in the scenic spot map in the form of a pop-up window and then displayed to the user through the tour guide terminal device.

[0011] Furthermore, the intelligent tour guide steps also include: a voice Q&A step: obtaining an AI Q&A command to activate the AI ​​Q&A mode, then obtaining the user's question and performing text recognition and semantic analysis based on the user's question, then combining the AI ​​big model and the knowledge base built by the system to answer the user's question to obtain the Q&A result, and displaying the Q&A result to the user through the AI ​​dialog box page of the tour guide APP on the tour guide terminal device, and then displaying it to the user in the form of voice or text; and exiting the AI ​​Q&A mode when no user question is obtained within a preset time period or when an exit AI Q&A command is obtained;

[0012] Voice control steps: Obtain AI voice commands and control the tour guide APP on the tour guide terminal device to perform corresponding operations based on the AI ​​voice commands, including hiding or showing the navigation map, turning AI voice commands on or off, switching the display page of the tour guide APP on the tour guide terminal device, and stopping or playing the narration.

[0013] Furthermore, the tour route recommendation step also includes: during the user's tour, obtaining the user's real-time location based on the positioning base stations set up in the tour area, and combining the real-time heat map of the visitor flow in the tour area, the user's tour duration, the user's consumption habits, and the tour route currently selected by the user to make real-time dynamic adjustments to the user's tour route, so as to push the adjusted tour route to the user.

[0014] Furthermore, the interactive explanation steps also include: obtaining language switching instructions through the tour guide terminal device or recording the user's voice information through the tour guide terminal device and recognizing and matching the user's voice information to determine the language type required by the current tourist, and switching the language according to the language type; and obtaining timbre switching instructions through the tour guide terminal device or recognizing the timbre type matched to the current user based on the user profile, and switching the timbre according to the timbre type.

[0015] Furthermore, the intelligent tour guide method also includes: a call step: obtaining a communication request sent by the tour guide terminal device of the second user and establishing a communication connection between the tour guide terminal device of the first user and the tour guide terminal device of the second user according to the communication request of the second user, and establishing a group between the tour guide terminal devices of the first user and the tour guide terminal devices of the second user, and then calling the instant messaging software on the corresponding tour guide terminal device to make a call; both the first user and the second user are registered users of the system.

[0016] Furthermore, the intelligent navigation method also includes an address sharing step: acquiring the real-time location information of each user and sharing the real-time location information of each user with the navigation terminal device of each user in the group to achieve location sharing among users in the group.

[0017] Furthermore, the intelligent tour guide method includes an animation display step: generating an AR virtual animation based on the narration, the target attractions being narrated, and the specific tourist area where the user is located, and displaying the AR virtual animation to tourists through the tour guide terminal device.

[0018] The second objective of this invention is achieved by the following technical solution:

[0019] Model-based intelligent navigation systems include:

[0020] A navigation terminal device, wherein a navigation APP is installed on the navigation terminal device, which is used to obtain user interaction data and display or play data to the user;

[0021] A local server, communicatively connected to the tour guide terminal device, is used to execute the steps of the model-based intelligent tour guide method as described in claim 1.

[0022] Furthermore, the tour guide terminal equipment includes a first tour guide terminal equipment and a second tour guide terminal equipment; wherein, the first tour guide terminal equipment is communicatively connected to a local service; when the second tour guide terminal equipment is located within the corresponding scenic area, the second tour guide terminal equipment is communicatively connected to a local server; when the first tour guide terminal equipment is located outside the scenic area, the second tour guide terminal equipment is communicatively connected to a remote server.

[0023] The third objective of this invention is achieved by the following technical solution:

[0024] A computer-readable storage medium storing an intelligent navigation program thereon, the intelligent navigation program being a computer program, which, when executed by a processor, implements the steps of a model-based intelligent navigation method as one of the objectives of this invention.

[0025] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0026] This invention utilizes advanced technologies such as image recognition, speech recognition, large-scale modeling, and speech synthesis to create a truly intelligent and highly interactive tour guide system. It provides users with more personalized tour guide explanations and enriches the content of the tour guide explanations, thereby solving the problems of traditional tour guides, such as monotonous content, monotonous explanation methods, and poor user experience. Attached Figure Description

[0027] Figure 1A flowchart of the model-based intelligent navigation method provided by this invention;

[0028] Figure 2 The flowchart of the model-based intelligent tour guide system provided by the present invention. Detailed Implementation

[0029] The present invention will now be further described in conjunction with the accompanying drawings and specific embodiments. It should be noted that, without conflict, the various embodiments or technical features described below can be arbitrarily combined to form new embodiments.

[0030] Example 1

[0031] This invention combines technologies such as speech recognition, large-scale modeling, semantic understanding, and speech synthesis to construct an intelligent and highly interactive voice-guided tour system, providing users with more personalized guided tour explanations. This invention is applicable to various museums, zoos, historical and cultural scenic spots, and is also suitable for tour explanations for people from different countries.

[0032] Specifically, such as Figure 1 As shown, the present invention provides a preferred embodiment of a model-based intelligent navigation method, comprising:

[0033] Step S1: Obtain user registration information and / or questionnaire results through the user's guided tour terminal device to generate a user profile. Then, based on the user profile, the user's starting location and the recommended tour routes in the system, derive a recommended tour route and push the recommended tour route to the user through the guided tour terminal device.

[0034] Specifically, this invention provides guided tours and explanations to users through a user-carried tour terminal device. This terminal device can be a local device provided within the scenic area, or a mobile device carried by the user, such as a smartphone or tablet. A corresponding tour guide app is installed on the terminal device, enabling data interaction with the user and providing guided tour explanations.

[0035] When using the app, users register through its registration page to build an initial user profile for subsequent data recommendations. More specifically, users can also complete a questionnaire through the app's survey page to generate survey results. These results, along with user registration information, are used to construct a user profile. The questionnaire may include basic information related to the tour, such as the number of visitors, visitor details, estimated tour duration, tour start time, and tour difficulty level (easy, medium, or high). These survey results, combined with user registration information, form the user profile and are stored on a local server. This local server is located within each scenic area; user profiles of those who have visited that area are stored there. Furthermore, sensitive information, such as contact information and ID numbers, is removed during user profile storage to ensure user privacy.

[0036] When a user wants to visit a scenic spot, the system generates a recommended tour route based on the user's starting location, existing recommended routes, and user profile. This recommended route is then displayed to the user through the navigation terminal. The recommended routes can be categorized based on their features, such as family-friendly routes, routes for seniors, routes focusing on popular tourist attractions, and routes catering to varying levels of difficulty. By analyzing user profiles, the system identifies suitable routes for each user and pushes them to the user, allowing them to choose a route that suits their needs and improve their overall experience. Furthermore, the system's recommended routes include official recommendations from scenic spots and routes derived from data collected from user experiences on various travel platforms or other third-party platforms. This data is then mined and stored in the system for future route recommendations.

[0037] Furthermore, during the user's tour, if the user fails to find the selected recommended route due to their own reasons or other external factors, the currently selected recommended tour route needs to be dynamically updated based on the user's current location information. Simultaneously, during the dynamic update of the route, real-time heatmaps of visitor flow at attractions, user tour duration, user spending habits, and the system's dynamic route recommendation model are also acquired to achieve dynamic updates to the user's tour route. The dynamic route recommendation model is constructed using data mining and AI models based on historical user tour routes, attraction heatmaps, user tour duration, and spending habits. For example, it combines neural network models to build a dataset and then trains and validates the model to derive the dynamic route recommendation model.

[0038] By dynamically updating users' tour routes, better tour routes can be pushed to users in real time to avoid a decline in the tour experience due to large crowds. At the same time, based on users' consumption habits and tour duration, food and beverage areas can be pushed to users so that they can eat in time, or their preferred food and beverages can be pushed, or their preferred games or attractions can be recommended.

[0039] More preferably, the present invention can also realize a question-and-answer function, that is, by putting the tour guide terminal device into question-and-answer mode, it can realize real-time question and answer for users. Specifically, the present invention also includes: obtaining an AI question-and-answer command to activate the AI ​​question-and-answer mode, obtaining the user's question and performing text recognition and semantic analysis based on the user's question, then combining the AI ​​large model and the knowledge base built by the system to answer the user's question to obtain the question-and-answer result, and displaying the question-and-answer result to the user through the AI ​​dialog box page of the tour guide APP of the tour guide terminal device, and then displaying it to the user in the form of voice or text. That is, by setting the AI ​​question-and-answer command, the tour guide terminal device can be activated to enter the question-and-answer mode, so as to receive the user's question in a timely manner and provide the corresponding answer after further analysis of the user's question.

[0040] Specifically, this invention achieves voice interaction with users by combining an AI companion. Specifically, the AI ​​companion's image is displayed on the corresponding page of the guide app installed on the guide terminal device. Users can wake up the AI ​​companion by touching the corresponding button or speaking the corresponding keyword. Waking up the AI ​​companion allows for AI voice commands, enabling corresponding voice operations, such as activating or deactivating navigation functions, switching pages, etc. Users can also send voice questions and answers to the AI ​​companion, achieving AI voice interaction. For example, if a user wants to go to the restroom, they can wake up the AI ​​companion and ask, "I want to go to the restroom, where is the nearest restroom?" After receiving the voice question, the AI ​​companion first performs semantic analysis to determine the user's current location and the user's intention to go to the restroom. Based on the user's real-time location and the location of the nearest restroom, it recommends the location of the corresponding restroom and clearly displays the corresponding navigation route to the user by calling up the guide map.

[0041] Specifically, when a user's voice content is received, the text content is derived by recognizing the user's voice content, and semantic analysis of the text content is performed by combining natural language processing technology, such as keywords, to determine the user's questions and answers. Then, the user's questions and answers are matched with the knowledge base to obtain the question and answer results and display them to the user.

[0042] Additionally, if no user questions are received or an instruction to exit AI Q&A is received within a preset time period, the AI ​​Q&A mode will exit.

[0043] Step S2: Obtain the shooting data taken by the user through the tour guide terminal device and use the CV model to identify the target objects of the scenic spot in the shooting data. Also, determine the specific tour area where the user is located based on the user's current location data and the geographical data of the scenic area. Then, based on the specific tour area where the user is located and the target objects of the scenic spot, obtain the explanation content from the knowledge base built by the system, and generate the explanation text using AIGC based on the explanation content.

[0044] Specifically, users can take real-time photos of the scenic area using guided tour terminals to obtain data. This data is then used to identify landmarks, such as stone lions or models in museums, using a computer vision (CV) model. By identifying these landmarks in the data, the system can retrieve corresponding descriptions from existing databases. By recognizing landmarks captured in real-time by tourists, the system can push relevant explanations to tourists, enabling them to understand the meaning and background of each landmark and achieving an immersive tour. The CV model refers to a model specifically designed for computer vision tasks, trained using deep learning algorithms. It typically employs convolutional neural networks (CNNs) or Transformers to extract and analyze features from image and video data. In other words, by pre-collecting a large amount of image data of various landmarks within the scenic area, pre-processing the image data, and constructing a dataset with the categories of landmarks, the system trains and validates the constructed model using this dataset, ultimately resulting in a model capable of recognizing the categories of landmarks.

[0045] Furthermore, when acquiring shooting data, keyframe images are first extracted from the shooting data using image processing technology. Then, the extracted keyframe images are matched with the constructed CV model to achieve the identification of scenic spot targets. This invention enables explanation by identifying scenic spot targets in the shooting data, allowing for explanation of exactly where the footage is captured.

[0046] While acquiring shooting data to identify scenic spot targets, the system also obtains the user's current location data and scenic area geographical data to determine the specific area the user is in. Based on the user's specific scenic area and the scenic spot targets, the system derives explanatory content from its knowledge base and generates narration using AIGC (Artificial Intelligence Generated Content). AIGC automatically generates various types of content, including text, images, audio, and video, using artificial intelligence technology. This invention uses AIGC to generate personalized narration for scenic spot targets. For example, the gate you see now was designed by Ming Dynasty craftsmen to suppress something; you can see the patterns on it resemble several eagles. By generating personalized narration, the user's tour experience is enhanced, avoiding the use of official, rigid narration.

[0047] In addition, when acquiring the shooting data, the audio data in the shooting data is also extracted to further identify the user's specific environment, such as the sound of flowing water, the sound of bells, etc., so as to further determine the user's current specific environment.

[0048] More specifically, this invention also constructs a knowledge base of explanatory terms for each scenic spot's target object. In addition to official information, this knowledge base includes data from tourist reviews, travelogues, video subtitles, and image tags collected from various platforms to extract data related to each target object. Sentiment analysis and big data mining are then performed on this data to derive relevant keywords. For example, if a travelogue mentions that a rock next to the Magnolia Hall resembles a dog, but this is not mentioned in the official description, then the rock resembling a dog can be added to the knowledge base of explanatory terms for that scenic spot's target object, for use in subsequent AIGC-generated explanatory terms. This invention, by collecting official knowledge, model reasoning, online searches, and extended explanations, and using machine learning and data mining, forms a rich knowledge base to provide corresponding explanatory terms for different users. Among them, "official knowledge" refers to officially authorized explanations within the park or science museum exhibition areas, ensuring the professionalism of the content; "model reasoning" refers to the analytical and inferential capabilities based on scientific models, capable of calculating complex scientific ethical logic and analyzing fundamental knowledge; "online search" mainly refers to combining top-tier authoritative interpretations from various websites, focusing on cutting-edge research results and top-level academic perspectives in the industry, while also incorporating information from visitor reviews, travelogues, video subtitles, and image tags; and "extended explanations" mainly involve creating a relaxed and engaging guided tour style that caters to the aesthetics and communication needs of today's young users.

[0049] Furthermore, when constructing the knowledge base of explanatory texts for each scenic spot in this invention, multiple different versions of explanatory texts are set according to the characteristics of the scenic spot to adapt to different user needs. Specifically, the explanatory content in this embodiment may include an operational explanatory version and an in-depth principle version to meet the needs of different user groups to receive different levels of knowledge. For example, for a science and technology museum, the operational explanatory version mainly includes a simple introduction to the basic operation of exhibits in a certain exhibition hall, helping users to quickly obtain the operation process for actual experience or understanding. This version is mainly aimed at teenagers, families with children, curious tourists, and people who are focused on experiencing the exhibits. Conversely, the in-depth principle version mainly includes explanations of the technical background of the exhibits and detailed analysis of the principles, mainly aimed at science popularization content creators, science enthusiasts, research scholars, and enterprise R&D personnel. By providing different versions of explanatory content, the diverse needs of users can be adapted. At the same time, the corresponding operation buttons for different explanatory content can also be displayed on the guide terminal device for users to select according to their own needs.

[0050] Step S3: Based on the user-defined voice playback mode and narration text, use voice synthesis technology to generate corresponding voice content and play it to the user through the tour guide terminal device.

[0051] Specifically, the voice modes in this application include at least one of the following modes: Scholar Mode, Storyteller Mode, and Children's Mode. By setting multiple different voice playback modes, it caters to different users and improves the user experience. For example, for families with children, using Children's Mode or Storyteller Mode is more in line with children's comprehension range. This invention uses speech synthesis and broadcasting technology to achieve voice guidance of narration, so that the narration is delivered exactly where the photo is taken.

[0052] In addition, this invention also supports language and voice selection. It allows for the customization of realistic cloned voices by constructing a human voice cloning model, such as distinctive character styles or humorous explanations from online celebrities; and it supports multiple languages ​​and various Chinese dialects, including Sichuanese and Cantonese, to meet the needs of users with different language backgrounds.

[0053] Step S4: Generate illustrated explanations based on the explanation text and display them in a pop-up window on the attraction map, and then show them to the user through the tour guide terminal device.

[0054] Specifically, this invention also provides illustrated explanations for users to view. For example, illustrated explanations can be used in noisy or quiet environments. By providing multiple explanation methods, this invention can adapt to different scenic spots and meet the diverse needs of users.

[0055] Specifically, this invention also utilizes an AI companion to provide audio narration of explanations. An AI companion avatar is generated and displayed on the tour guide app's explanation page for audio narration. This invention provides users with in-depth tour explanations by combining AI dialogue. Furthermore, this invention can integrate scientific reasoning models and multi-turn dialogue management technology to achieve multi-turn question-and-answer and natural dialogue through superimposed command scheduling, realizing near-human AI dialogue and providing various AI dialogue styles and modes.

[0056] More preferably, the present invention further includes: generating AR virtual animations based on the narration text, the target attractions being narrated, and the specific tourist area where the user is located, and displaying the AR virtual animations to tourists through a tour guide terminal device. Specifically, using AR virtual technology to generate AR virtual animations can provide narration through voice, text and images, and animation, thereby enhancing the user experience.

[0057] Preferably, the present invention also includes a language switching function to meet the needs of users in different regions and countries. Specifically, the language switching command is obtained through the tour guide terminal device, or the user's voice information is obtained through the tour guide terminal device and the user's voice information is identified and matched to determine the language type currently needed by the tourist, and the narration language of the tour guide terminal device is switched to the corresponding language type. The present invention can recognize multiple dialects such as Sichuanese and Cantonese, as well as 144 languages ​​from around the world. Furthermore, when the language type is switched to a foreign language, if the current person is identified as a foreigner, tour guide content with Chinese cultural elements is pushed to the user using big data mining and artificial intelligence technology.

[0058] Preferably, the present invention further includes a call step: obtaining a communication request sent by the second user's navigation terminal device, establishing a communication connection between the first user's navigation terminal device and the second user's navigation terminal device according to the communication request of the second user, and forming a group of the first user's navigation terminal device and the second user's navigation terminal device, and then calling the instant messaging software on the corresponding navigation terminal device for a call; both the first user and the second user are system-registered users. For example, when multiple people visit a scenic area, they may be separated due to certain reasons or external factors. To ensure that they can communicate and call each other, the present invention also uses a local server to establish communication connections between multiple navigation terminal devices to achieve instant communication. Specifically, a one-touch call request can be set on the navigation APP to establish a call connection, without excessive operations, which is convenient for users. For example, when multiple families or multiple households visit a scenic area simultaneously and are separated due to interest or getting lost, instant communication can be achieved through the present invention. At the same time, since the present invention realizes calls through navigation terminal devices, it can also avoid problems such as inability to make calls due to the lack of network on the user's personal smartphone. The present invention can also form a group of multiple associated navigation terminal devices, so that multiple users within a group can make calls simultaneously.

[0059] More specifically, the position sharing function can also be realized. Specifically, the real-time position information of each user is obtained in real time and shared with the navigation terminal devices of each user within the group to achieve position sharing among the users within the group. The present invention can also realize the linkage control of multiple devices. Specifically, the linkage control of multiple navigation terminal devices can be achieved by connecting to the scenic area WIFI, so as to realize the position sharing of multiple navigation terminal devices. For multiple people visiting, real-time dynamic connection between users can be achieved through position sharing.

[0060] Preferably, the present invention also provides a shared unmanned rental function. The user can scan the rental mini-program of the unmanned rental cabinet set in the scenic area through their own mobile phone or perform manual operations through the display screen on the unmanned rental cabinet to pick up the navigation terminal device, and then start the AI navigation journey; at the same time, when returning, the user only needs to put the device into any idle cabinet port, and the system will automatically identify and recycle the device, ending the AI navigation journey. At the same time, the system can also be connected to the payment system to settle the fees for the user's use of the device. The rental and recycling of the device do not require manual intervention throughout the process, improving the rental efficiency and being convenient for users.

[0061] Embodiment 2

[0062] Based on Embodiment 1, the present invention also provides a model-based intelligent navigation system, as Figure 2 shown, including a navigation terminal device and a local server.

[0063] The tour guide terminal equipment is equipped with a tour guide APP, which is used to obtain user interaction data and display or play data to users.

[0064] A local server, which is communicatively connected to the tour guide terminal device, is used to execute the steps of the model-based intelligent tour guide method provided in Embodiment 1 of the present invention.

[0065] More preferably, the present invention also includes a remote server, which is communicatively connected to the local server. The remote server is also connected to external third-party platforms or the Internet, and can capture evaluation content for the corresponding scenic spots from major tourism platforms or other platforms. Based on sentiment analysis and other methods, it can analyze the evaluation content and then integrate this data into the corresponding local server according to the different scenic spots. This allows the local server to dynamically update the model and knowledge base based on the above data, thereby enriching the explanation content of the scenic spots.

[0066] More preferably, the guide terminal equipment includes a first guide terminal equipment and a second guide terminal equipment; wherein, the first guide terminal equipment is connected to the local service communication connection, and the first guide terminal equipment is a guide terminal equipment set up in the scenic area, so that when users enter the scenic area, they can pick up the corresponding guide terminal equipment according to their needs.

[0067] When the second navigation terminal is located within the corresponding scenic area, it communicates with the local server; when the first navigation terminal is located outside the scenic area, it communicates with a remote server. The second navigation terminal is a device carried by the user, such as a smartphone. A corresponding navigation app is installed on the smartphone to enable communication between the smartphone and the local server, thus providing navigation functionality. This invention provides greater convenience to users by integrating their smartphones into a smart navigation system.

[0068] Furthermore, this invention integrates information from various scenic spots or guided destinations and stores it on a remote server. This allows users to query and preview these spots online through a guided tour app on their mobile devices, gaining information about each attraction. The app also includes online explanations, enabling users to access free information about some attractions without actually visiting them. Currently, most scenic spot platforms only upload ticket information, brief descriptions, and images. Users can only filter useful information from this disorganized data and lack online browsing and explanation capabilities, preventing them from gaining a deeper understanding of the attractions. Therefore, this invention uses a remote server to uniformly integrate data from various scenic spots. Users can download the corresponding guided tour app on their mobile devices to browse the data, including basic information such as ticket prices, opening hours, and attractions' features. It also provides dedicated guided tour functions, allowing users to learn about the attractions' characteristics in advance and choose to visit them beforehand.

[0069] Furthermore, the first tour guide terminal device also achieves precise user positioning through a built-in positioning module, utilizing enhanced GPS high-precision positioning technology and BLE beacon communication technology. The second tour guide terminal device also has a built-in positioning module, enabling real-time positioning. It combines real-time positioning data with the scenic area's 3D map to display the user's location in real time.

[0070] Example 3

[0071] Based on Embodiment 1, the present invention also provides another embodiment: a computer-readable storage medium storing an intelligent tour guide program thereon. The intelligent tour guide program is a computer program, and when executed by a processor, it performs the following steps:

[0072] Tour route recommendation steps: Obtain user registration information and / or questionnaire results through the user's guided tour terminal device to generate a user profile, and then derive a recommended tour route based on the user profile, the user's starting position and the recommended tour routes of attractions in the system, and push the recommended tour route to the user through the guided tour terminal device;

[0073] Explanation of matching steps: Acquire the shooting data taken by the user through the guide terminal device and use the CV model to identify the target objects of the scenic spot in the shooting data. Also, determine the specific tour area where the user is located based on the user's current location data and the geographical data of the scenic area. Then, based on the specific tour area where the user is located and the target objects of the scenic spot, obtain the explanation content from the knowledge base built by the system, and generate explanation words based on the explanation content using AIGC.

[0074] Interactive explanation steps: Based on the user-defined voice playback mode and explanation text, corresponding voice content is generated using voice synthesis technology and played to the user through the tour guide terminal device; and graphic explanation text is generated based on the explanation text and displayed in the scenic spot map in the form of a pop-up window and then displayed to the user through the tour guide terminal device.

[0075] Furthermore, the intelligent tour guide process also includes: a voice Q&A step: obtaining an AI Q&A command to activate the AI ​​Q&A mode, then obtaining the user's question and performing text recognition and semantic analysis based on the user's question, then combining the AI ​​big model and the knowledge base built by the system to answer the user's question to obtain the Q&A result, and displaying the Q&A result to the user through the AI ​​dialog box page of the tour guide terminal device's tour guide APP, and then displaying it to the user in the form of voice or text; and exiting the AI ​​Q&A mode when no user question is obtained within a preset time period or when an exit AI Q&A command is obtained;

[0076] Voice control steps: Obtain AI voice commands and control the tour guide APP on the tour guide terminal device to perform corresponding operations based on the AI ​​voice commands, including hiding or showing the navigation map, turning AI voice commands on or off, switching the display page of the tour guide APP on the tour guide terminal device, and stopping or playing the narration.

[0077] Furthermore, the tour route recommendation process also includes: during the user's tour, obtaining the user's real-time location based on the positioning base stations set up in the tour area, and combining the real-time heat map of the visitor flow in the tour area, the user's tour duration, the user's consumption habits, and the tour route currently selected by the user to make real-time dynamic adjustments to the user's tour route, so as to push the adjusted tour route to the user.

[0078] Furthermore, the interactive explanation steps also include: obtaining language switching instructions through the tour guide terminal device or recording the user's voice information through the tour guide terminal device and recognizing and matching the user's voice information to determine the language type currently needed by the tourist, and switching the language according to the language type; and obtaining voice timbre switching instructions through the tour guide terminal device or recognizing the voice timbre type matched to the current user based on the user profile, and switching the voice timbre according to the voice timbre type.

[0079] Furthermore, the intelligent tour guide method also includes: a call step: obtaining the communication request sent by the second user's tour guide terminal device and establishing a communication connection between the first user's tour guide terminal device and the second user's tour guide terminal device according to the second user's communication request, and creating a group between the first user's tour guide terminal device and the second user's tour guide terminal device, and then calling the instant messaging software on the corresponding tour guide terminal device to make a call; both the first user and the second user are registered users of the system.

[0080] Furthermore, the intelligent tour guide method also includes: an address sharing step: real-time acquisition of each user's real-time location information and sharing of each user's real-time location information with each user's tour guide terminal device within the group to achieve location sharing among users within the group.

[0081] Furthermore, the intelligent tour guide method includes: animation display steps: generating AR virtual animation based on the narration, the target attractions being narrated, and the specific tour area where the user is located, and displaying the AR virtual animation to tourists through the tour guide terminal equipment.

[0082] The above embodiments are merely preferred embodiments of the present invention and should not be construed as limiting the scope of protection of the present invention. Any non-substantial changes and substitutions made by those skilled in the art based on the present invention shall fall within the scope of protection claimed by the present invention.

Claims

1. A model-based intelligent navigation method, characterized in that, The intelligent tour guide method includes: Tour route recommendation steps: Obtain user registration information and / or questionnaire results through the user's guided tour terminal device to generate a user profile, and then derive a recommended tour route based on the user profile, the user's starting position and the recommended tour routes of attractions in the system, and push the recommended tour route to the user through the guided tour terminal device; Explanation of matching steps: Acquire the shooting data taken by the user through the guide terminal device and use the CV model to identify the target objects of the scenic spot in the shooting data. Then, determine the specific tourist area where the user is located based on the user's current location data and scenic area geographical data information. Then, based on the specific tourist area where the user is located and the target objects of the scenic spot, obtain the explanation content from the knowledge base built by the system, and generate explanation words based on the explanation content using AIGC. Interactive explanation steps: Based on the user-defined voice playback mode and explanation text, corresponding voice content is generated using voice synthesis technology and played to the user through the tour guide terminal device; and graphic explanation text is generated based on the explanation text and displayed in the scenic spot map in the form of a pop-up window and then displayed to the user through the tour guide terminal device.

2. The model-based intelligent navigation method according to claim 1, characterized in that, The intelligent tour guide steps also include: a voice Q&A step: obtaining an AI Q&A command to activate the AI ​​Q&A mode, then obtaining user questions and performing text recognition and semantic analysis based on the user questions, then combining the AI ​​big model and the knowledge base built by the system to answer the user questions to obtain the Q&A results, and displaying the Q&A results to the user through the AI ​​dialog box page of the tour guide APP on the tour guide terminal device, and then displaying them to the user in the form of voice or text; and exiting the AI ​​Q&A mode when no user questions are obtained within a preset time period or when an exit AI Q&A command is obtained; Voice control steps: Obtain AI voice commands and control the tour guide APP on the tour guide terminal device to perform corresponding operations based on the AI ​​voice commands, including hiding or showing the navigation map, turning AI voice commands on or off, switching the display page of the tour guide APP on the tour guide terminal device, and stopping or playing the narration.

3. The model-based intelligent navigation method according to claim 1, characterized in that, The tour route recommendation step also includes: during the user's tour, obtaining the user's real-time location based on the positioning base stations set up in the tour area, and combining the real-time heat map of the visitor flow in the tour area, the user's tour duration, the user's consumption habits, and the tour route currently selected by the user to make real-time dynamic adjustments to the user's tour route, and pushing the adjusted tour route to the user.

4. The model-based intelligent navigation method according to claim 1, characterized in that, The interactive explanation steps also include: obtaining language switching instructions through the tour guide terminal device or recording the user's voice information through the tour guide terminal device and recognizing and matching the user's voice information to determine the language type required by the current tourist, and switching the language according to the language type; and obtaining timbre switching instructions through the tour guide terminal device or recognizing the timbre type matched to the current user based on the user profile, and switching the timbre according to the timbre type.

5. The model-based intelligent navigation method according to claim 1, characterized in that, The intelligent tour guide method further includes: a call step: obtaining a communication request sent by the tour guide terminal device of the second user and establishing a communication connection between the tour guide terminal device of the first user and the tour guide terminal device of the second user according to the communication request of the second user, and creating a group between the tour guide terminal devices of the first user and the tour guide terminal devices of the second user, and then calling the instant messaging software on the corresponding tour guide terminal device to make a call; both the first user and the second user are registered users of the system.

6. The model-based intelligent navigation method according to claim 5, characterized in that, The intelligent tour guide method further includes: an address sharing step: real-time acquisition of each user's real-time location information and sharing of each user's real-time location information with each user's tour guide terminal device in the group to achieve location sharing among users in the group.

7. The model-based intelligent navigation method according to claim 1, characterized in that, The intelligent tour guide method includes: animation display step: generating AR virtual animation based on the narration, the target attractions being narrated, and the specific tourist area where the user is located, and displaying the AR virtual animation to tourists through the tour guide terminal device.

8. A model-based intelligent tour guide system, characterized in that, include: A navigation terminal device, wherein a navigation APP is installed on the navigation terminal device, which is used to obtain user interaction data and display or play data to the user; A local server, communicatively connected to the tour guide terminal device, is used to execute the steps of the model-based intelligent tour guide method as described in claim 1.

9. The model-based intelligent tour guide system according to claim 1, characterized in that, The tour guide terminal equipment includes a first tour guide terminal equipment and a second tour guide terminal equipment; wherein, the first tour guide terminal equipment is connected to a local service for communication; when the second tour guide terminal equipment is located within the corresponding scenic area, the second tour guide terminal equipment is connected to a local server for communication; when the first tour guide terminal equipment is located outside the scenic area, the second tour guide terminal equipment is connected to a remote server for communication.

10. A computer-readable storage medium storing an intelligent navigation program thereon, characterized in that, The intelligent tour guide program is a computer program, and when the intelligent tour guide program is executed by the processor, it implements the steps of the model-based intelligent tour guide method as described in any one of claims 1-8.

Images