AR (Augmented Reality) and digital narrative-based text travel interactive navigation system and method

Abstract

The invention discloses an interactive tour guide system and method based on AR and digital narration, and the system and method achieve the immersive presentation of related information in a tour scene through AR live-action labeling and multi-modal dynamic content display, and improve the interaction depth. A manual annotation and real-time updating mechanism is adopted, and a multi-dimensional knowledge graph is combined, so that the accuracy of science popularization information is ensured; constructing a narrative system by using a digital human, matching with a copy interaction task containing more than three interaction mechanisms, and guiding a user to deeply participate in a plot; through background intelligent management and WeChat applet lightweight deployment, content efficient iteration and cross-scene landing are realized, and the navigation experience and operation efficiency are comprehensively improved; and the problems of single content and insufficient interactivity of the traditional guide are solved.

Description

Technical Field

[0001] This invention belongs to the field of AR and digital narrative technology, specifically relating to an interactive cultural tourism guide system and method based on AR and digital narrative. Background Technology

[0002] As experiential tourism gradually replaces sightseeing tourism as the mainstream trend in the cultural and tourism industry, tourists are placing higher demands on the participatory, culturally in-depth, and interactive aspects of tourism products. According to the latest industry report, over three-quarters of core tourists prefer tourism products with interactive features, and this proportion is increasing year by year, leading to a growing market size for experiential tourism. This consumption upgrade is not only reflected in the demand for hardware facilities but also focuses on the immersive experience of culture and the initiative in acquiring knowledge. Tourists are no longer satisfied with passively receiving information but crave to build emotional connections with scenic spots through interactive participation.

[0003] Currently, most tourist attractions rely on static displays, audio guides, or QR code-based webpages for guided tours. Traditional audio guides cannot dynamically adjust their content based on visitor movement, often resulting in a disconnect between audio and visual information in crowded or signal-congested areas. Furthermore, their operation is cumbersome, with many visitors ending their tour before fully mastering their use. Webpage guides via QR codes are significantly affected by network conditions, frequently experiencing slow loading speeds and poor page compatibility. In botanical gardens, city parks, and other settings requiring science education, visitors generally rely on photo recognition apps to identify plant species. However, accuracy is affected by seasonal changes, lighting, and angles, posing a high risk of misleading information. Moreover, existing guided tour systems generally lack task-oriented guidance mechanisms and cultural narratives, leading to superficial visits, limited cultural engagement, and insufficient educational value and emotional connection.

[0004] Therefore, there is an urgent need for a new type of tour guide system that integrates real-world guidance, cultural narrative, interactive tasks, immersive experience, and knowledge learning. This system can achieve a "soft transformation" digital upgrade without altering the original landscape structure of the scenic area, thereby enhancing the user's cultural experience and the vitality of the scenic area's content. Summary of the Invention

[0005] To address the aforementioned problems in the prior art, the present invention is achieved through the following technical solution: In a first aspect, this invention provides an interactive cultural tourism guide system based on AR and digital narrative, comprising: The guided tour interaction module includes an AR real-scene annotation module, a digital narrative control module, a user interaction task module, and a user interaction task module. AR Real-Scene Annotation Module: This module is used to bind the user's current location and manually identified location in the offline tourism scene with the real-scene location annotated by the backend to generate online locations in the tourism scene, and at the same time trigger information about the online locations in the tourism scene. Multimodal content display module: used to dynamically present online location information of tourism scenarios based on real-world locations identified manually and labeled by the backend, and the current time point; Digital Narrative Control Module: Used to activate digital human characters based on online locations in the tourism scene. The digital human characters start the story based on the main plot and time nodes corresponding to the current online location in the tourism scene, guiding users to advance the main plot and complete interactive tasks in the dungeons. User interaction task module: Used to generate copy interaction tasks and report the completion status of copy interaction tasks to the points growth system module; Points-based growth system module: Connected to the navigation interaction module, it is used to provide visual incentives to users based on the completion of dungeon interaction tasks, and to record the completion of dungeon interaction tasks and visual incentives; Backend content update and statistics module: Connected to the tour guide interaction module, it is used for updating and uploading information content of online tourist attractions, configuring the logic of interactive tasks, statistics on the completion of interactive tasks, and platform operation and maintenance.

[0006] The user's current location in offline tourism scenarios is obtained through QR code recognition or LBS positioning function.

[0007] The information of online tourist attractions consists of information on real-world attractions identified manually and labeled by the backend. This information is presented in at least one of the following formats: text, images, videos, and audio.

[0008] The digital human characters are based on original stories, folk tales, or historical stories. They have voice interaction capabilities and user interaction behavior recognition functions, and guide users to advance the main storyline and complete dungeon interactive tasks according to time nodes and user interaction behaviors.

[0009] Each instance of the interactive task includes three or more interactive mechanisms, including on-site experience, cultural knowledge quizzes, situational multiple-choice questions, virtual puzzles, AR location check-in, and real-world interaction.

[0010] The points-based growth system module also includes: This is used to provide visual incentives to users based on the completion of dungeon interaction tasks. When a user completes a dungeon interaction task, the next chapter of the main storyline is unlocked, and the user is given visual incentives. The completion of dungeon interaction tasks and visual incentives are recorded. The completion status of dungeon interaction tasks includes completed dungeon interaction tasks and their completion progress. Visual incentives include digital collectibles, story fragments, NPC-specific voice lines, and music clips.

[0011] The system runs via WeChat mini-program or HTML5 web platform.

[0012] An interactive cultural tourism guide method based on AR and digital narrative, applied to an interactive cultural tourism guide system based on AR and digital narrative, includes the following steps: Step 1: Launch the AR-based and digital narrative-driven interactive cultural tourism guide system by scanning the QR code in the offline tourism scene or using LBS positioning. Step 2: Bind the user's current location and manually identified location in the offline tourism scenario with the real-world location marked by the backend to generate online locations in the tourism scenario, and trigger the information of the online locations in the tourism scenario at the same time; Step 3: Activate the digital human character based on the online location of the tourism scene. The digital human character starts the story based on the main plot and time node corresponding to the current online location of the tourism scene, and guides users to advance the main plot and interactive tasks in the dungeon. Step 4: Provide feedback on the completion status of the dungeon interaction task, provide visual incentives to users based on the completion status of the dungeon interaction task, and record the completion status of the dungeon interaction task and the visual incentives; Step 5: Proceed to the next manually identified and backend-annotated real-world location, repeating steps one through four until the tour of the tourist scene is complete.

[0013] Compared with the prior art, the present invention has the following beneficial effects: The AR real-scene annotation module enables precise binding of offline locations with online information, while the multimodal content display module dynamically and multidimensionally presents relevant information in tourism scenarios, breaking the static limitations of traditional guided tours and improving information retention and immersion. The digital narrative control module sets up digital human characters based on original stories or historical legends, connecting the stories of each location with the main plot, guiding users to deeply participate in cultural exploration. Combined with the multi-mechanism dungeon tasks and points growth system in the user interaction task module, a closed loop of "trigger-interaction-feedback-achievement" is formed, significantly extending user interaction time and enhancing the attractiveness of repeat visits. The system is deployed in a lightweight manner based on WeChat mini-programs, without the need to modify the scenic area's hardware facilities. Through "soft transformation" upgrades, it is adapted to diverse scenarios such as city parks and museums, ultimately achieving a deeper cultural experience, improved accuracy of popular science, and optimized operational efficiency.

[0014] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0015] Figure 1This is a schematic diagram of an interactive cultural tourism guide system based on AR and digital narrative provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of an interactive cultural tourism guide method based on AR and digital narrative provided by an embodiment of the present invention. Detailed Implementation

[0016] To further illustrate the technical means and effects adopted by the present invention to achieve the intended purpose, the following detailed description of the solution according to the present invention is provided in conjunction with the accompanying drawings and specific embodiments.

[0017] The foregoing and other technical contents, features, and effects of the present invention will be clearly presented in the following detailed description of specific embodiments in conjunction with the accompanying drawings. Through the description of the specific embodiments, a more in-depth and concrete understanding can be gained of the technical means and effects adopted by the present invention to achieve its intended purpose. However, the accompanying drawings are for reference and illustration only and are not intended to limit the technical solutions of the present invention.

[0018] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations are intended to cover non-exclusive inclusion, such that an article or apparatus comprising a list of elements includes not only those elements but also other elements not expressly listed. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the article or apparatus that includes said element.

[0019] like Figure 1 The diagram shown is a schematic of an interactive cultural tourism guide system based on AR and digital narrative provided by an embodiment of the present invention, including: The guided tour interaction module includes an AR real-scene annotation module, a digital narrative control module, a user interaction task module, and a user interaction task module.

[0020] AR Real-Scene Annotation Module: This module is used to bind the user's current location in an offline tourism scenario with manually identified and backend-annotated real-world locations to generate online locations within the tourism scenario. It also triggers information about these online locations. Offline tourism scenarios include, but are not limited to, city parks, botanical gardens, museums, and historical districts. The user's current location within the offline tourism scenario is obtained through QR code recognition or LBS (Location Based Services) positioning. LBS positioning requires no additional hardware deployment, is cross-platform compatible with mobile devices, can match user coordinates in real time to trigger location interactions, and adapts to the positioning needs of open outdoor scenarios.

[0021] The manual location identification is based on expert manual identification and backend annotation. The expert team conducts on-site surveys and marks the geographical coordinates and morphological features of the locations. The backend system integrates the location information with the 3D map to generate unique online tourist scene locations. The above method of determining locations can avoid misjudgment and ensure the accuracy of the identified content.

[0022] Multimodal content display module: This module is used to dynamically present information about online tourist attractions based on manually identified and backend-annotated real-world locations and the current time point. The information about online tourist attractions consists of information about manually identified and backend-annotated real-world locations, which is presented in at least one of the following formats: text, images, video, and audio.

[0023] Specifically, when the offline tourism scenario is a city park, the relevant information for the actual scenic spot identified by manual verification and labeled by the backend includes the architectural information and climate information of the scenic spot, which are presented through at least one of text, images, videos, and audio. When the offline tourism scenario is a botanical garden, the relevant information for the actual scenic spot identified by manual verification and labeled by the backend includes the plant attribute information and the seasonal changes of the plants, which are presented through at least one of text, images, videos, and audio. When the offline tourism scenario is a museum, the relevant information for the actual scenic spot identified by manual verification and labeled by the backend includes the exhibit information of the actual scenic spot from different eras, which are presented through at least one of text, images, videos, and audio. When the offline tourism scenario is a historical district, the relevant information for the actual scenic spot identified by manual verification and labeled by the backend includes the historical figure information of the actual scenic spot, which is presented through at least one of text, images, videos, and audio. By dynamically switching the actual time nodes of the offline tourism scenario and combining at least one of text, images, videos, and audio, the user's sense of immersion is enhanced.

[0024] The digital narrative control module is used to activate digital human characters based on online locations within a tourism scenario. These digital human characters initiate stories based on the main plot and time nodes corresponding to the current online location, guiding users through the main plot and interactive tasks. Interactive tasks are set within plot nodes of the main plot, triggered as the main plot for the current online location reaches a specific node. The main plot includes the story itself and information about the online locations within it, automatically triggering information about these locations for users to browse and access as time progresses. The digital human characters are based on original stories, folk tales, or historical narratives, possessing voice interaction capabilities and user interaction behavior recognition functions. They guide users through the main plot and interactive tasks based on time nodes and user interaction behavior, with user interaction behavior representing the results of various interaction mechanisms within the interactive tasks.

[0025] Preferably, urban parks and botanical gardens create digital human characters through original stories, museums create digital human characters through historical stories, and historical districts create digital human characters through folk tales.

[0026] User Interaction Task Module: This module generates user-created interactive tasks and feeds back the completion status of these tasks to the points-based growth system module. Each interactive task includes three or more interaction mechanisms, such as on-site experience, cultural knowledge quizzes, situational multiple-choice questions, virtual puzzles, AR location check-ins, and real-world interaction.

[0027] Specifically, in the on-site experience, users can interact by taking photos of designated plants or exhibits and matching them with digital human roles; in the cultural knowledge quiz, users can interact by answering questions about plants or exhibits via voice or text and interact with digital human roles; in the scenario-based multiple-choice questions, users can interact by answering multiple-choice questions derived from the main storyline corresponding to the current online tourist scene and interact with digital human roles; in the virtual jigsaw puzzle, users can interact by assembling fragments of designated plants / exhibits and interact with digital human roles; in the AR location check-in, users can check in by moving to the corresponding online tourist scene location and checking in with the real-world location marked on the backend and interact with digital human roles; and in the real-world interaction, users can interact with designated scenic area NPCs, which can be scenic area actors, animals in the scenic area, or other users in the current offline tourist scene, and interact with digital human roles.

[0028] The points-based growth system module connects to the navigation and interaction module and provides visual incentives to users based on their completion of dungeon interaction tasks. Specifically, it automatically unlocks the next chapter of the main storyline when a user completes a dungeon interaction task, while simultaneously providing visual incentives. The module also records the user's dungeon interaction task completion status and the visual incentives. The user's dungeon interaction task completion status includes the main storyline progress, completed dungeon interaction tasks, and the progress of completed dungeon interaction tasks. Visual incentives include digital collectibles, story fragments, NPC-specific voice lines, and music clips.

[0029] Backend content update and statistics module: Connected to the tour guide interaction module, it is used for updating and uploading information content of online tourist attractions, configuring the logic of interactive tasks, statistics on the completion of interactive tasks, and platform operation and maintenance. By setting differentiated main storylines and interactive tasks at different time points and / or online tourist attractions, it enhances the attractiveness of repeated browsing by users.

[0030] The system runs via WeChat mini-program or HTML5 web platform, adapting to multiple terminal devices without requiring download or installation.

[0031] like Figure 2 The diagram shown is a schematic representation of an interactive cultural tourism guide method based on AR and digital narrative provided by an embodiment of the present invention, including: Step 1: Launch the AR-based and digital narrative-driven interactive cultural tourism guide system by scanning the QR code in the offline tourism scene or using LBS positioning. Step 2: Bind the user's current location and manually identified location in the offline tourism scenario with the real-world location marked by the backend to generate online locations in the tourism scenario, and trigger the information of the online locations in the tourism scenario at the same time; Step 3: Activate the digital human character based on the online location of the tourism scene. The digital human character starts the story based on the main plot and time node corresponding to the current online location of the tourism scene, and guides users to advance the main plot and interactive tasks in the dungeon. Step 4: Provide feedback on the completion status of the dungeon interaction task, provide visual incentives to users based on the completion status of the dungeon interaction task, and record the completion status of the dungeon interaction task and the visual incentives; Step 5: Proceed to the next manually identified and backend-annotated real-world location, repeating steps one through four until the tour of the tourist scene is complete.

[0032] This invention achieves precise binding between offline locations and online information through an AR real-scene annotation module, combined with a multimodal content display module to dynamically and multidimensionally present relevant information in tourism scenarios, breaking the static limitations of traditional guided tours and improving information retention and immersion. The digital narrative control module sets up digital human characters based on original or historical stories, guiding users to deeply participate in cultural exploration. Combined with the multi-mechanism dungeon tasks and points growth system in the user interaction task module, it forms a closed loop of "trigger-interaction-feedback-achievement," significantly extending user interaction time and enhancing repeat visit appeal. The backend content update and statistics module supports real-time uploading of location information, dynamic configuration of task logic, and user behavior analysis, reducing operating costs while improving content iteration efficiency. The system is deployed in a lightweight manner based on WeChat mini-programs, requiring no modification to scenic area hardware facilities. Through "soft transformation" upgrades, it adapts to diverse scenarios such as city parks and museums, achieving a deeper cultural experience, improved accuracy of popular science, and optimized operational efficiency.

[0033] The above description, in conjunction with specific preferred embodiments, provides a further detailed explanation of the present invention. It should not be construed that the specific implementation of the present invention is limited to these descriptions. For those skilled in the art, various simple deductions or substitutions can be made without departing from the concept of the present invention, and all such modifications and substitutions should be considered within the scope of protection of the present invention.

Claims

1. A cultural tourism interactive guide system based on AR and digital narrative, characterized in that, include: The guided tour interaction module includes an AR real-scene annotation module, a multimodal content display module, a digital narrative control module, and a user interaction task module. AR Real-Scene Annotation Module: This module is used to bind the user's current location and manually identified location in the offline tourism scene with the real-scene location annotated by the backend to generate online locations in the tourism scene, and at the same time trigger information about the online locations in the tourism scene. Multimodal content display module: used to dynamically present online location information of tourism scenarios based on real-world locations identified manually and labeled by the backend, and the current time point; Digital Narrative Control Module: Used to activate digital human characters based on online locations in the tourism scene. The digital human characters start the story based on the main plot and time nodes corresponding to the current online location in the tourism scene, guiding users to advance the main plot and complete interactive tasks in the dungeons. User interaction task module: Used to generate copy interaction tasks and report the completion status of copy interaction tasks to the points growth system module; Points-based growth system module: Connected to the navigation interaction module, it is used to provide visual incentives to users based on the completion of dungeon interaction tasks, and to record the completion of dungeon interaction tasks and visual incentives; Backend content update and statistics module: Connected to the tour guide interaction module, it is used for updating and uploading information content of online tourist attractions, configuring the logic of interactive tasks, statistics on the completion of interactive tasks, and platform operation and maintenance.

2. The interactive cultural tourism guide system based on AR and digital narrative as described in claim 1, characterized in that, The user's current location within the offline tourism scenario is obtained through QR code recognition or LBS positioning function.

3. The interactive cultural tourism guide system based on AR and digital narrative as described in claim 1, characterized in that, The information of the online tourist attractions consists of information related to manually identified and back-end labeled real-world attractions. This information is presented in at least one of the following formats: text, images, video, and audio.

4. The interactive cultural tourism guide system based on AR and digital narrative as described in claim 1, characterized in that, The digital human character is based on original stories, folk tales, or historical stories. It has voice interaction capabilities and user interaction behavior recognition functions, and guides users to advance the main storyline and complete dungeon interactive tasks according to time nodes and user interaction behaviors.

5. The interactive cultural tourism guide system based on AR and digital narrative according to claim 1, characterized in that, Each of the aforementioned interactive tasks includes three or more interactive mechanisms, including on-site experience, cultural knowledge quizzes, situational multiple-choice questions, virtual puzzles, AR location check-in, and real-world interaction.

6. The interactive cultural tourism guide system based on AR and digital narrative as described in claim 1, characterized in that, The points-based growth system module also includes: This is used to provide visual incentives to users based on the completion of dungeon interaction tasks. When a user completes a dungeon interaction task, the next chapter of the main storyline is unlocked, and the user is given visual incentives. The completion of dungeon interaction tasks and visual incentives are recorded. The completion status of the copy interaction tasks includes completed copy interaction tasks and the progress of copy interaction task completion. The visual incentives include digital collections, story fragments, NPC-specific voice lines, and music fragments.

7. The interactive cultural tourism guide system based on AR and digital narrative according to claim 1, characterized in that, The system runs via WeChat mini-program or HTML5 web platform.

8. A method for interactive cultural tourism guided tours based on AR and digital narrative, applied to the interactive cultural tourism guided tour system based on AR and digital narrative as described in any one of claims 1-7, characterized in that, The following steps are involved: Step 1: Launch the AR-based and digital narrative-driven interactive cultural tourism guide system by scanning the QR code in the offline tourism scene or using LBS positioning. Step 2: Bind the user's current location and manually identified location in the offline tourism scenario with the real-world location marked by the backend to generate online locations in the tourism scenario, and trigger the information of the online locations in the tourism scenario at the same time; Step 3: Activate the digital human character based on the online location of the tourism scene. The digital human character starts the story based on the main plot and time node corresponding to the current online location of the tourism scene, and guides users to advance the main plot and interactive tasks in the dungeon. Step 4: Provide feedback on the completion status of the dungeon interaction task, provide visual incentives to users based on the completion status of the dungeon interaction task, and record the completion status of the dungeon interaction task and the visual incentives; Step 5: Proceed to the next manually identified and backend-annotated real-world location, repeating steps one through four until the tour of the tourist scene is complete.

Images