Multimedia tour guide and shopping guide device of map material integrated with live-action picture and navigation function

Abstract

The invention provides a multimedia tour guide and shopping guide device of a map material integrated with a live-action picture and a navigation function. The multimedia tour guide and shopping guide device comprises the map material integrated with the live-action picture and the navigation function, a tour guide and shopping guide interaction terminal and a cloud server subsystem. The map material is provided with a waterproof map, a scenery spot live-action picture and a compass on a waterproof substrate, so that tourists can conveniently and visually navigate and accurately position. The tour guide and shopping guide interaction terminal is provided with a positioning receiver and a multimedia tour guide and shopping guide interaction application program and supports navigation tour guide and shopping guide and tourist interaction. According to the device, precise navigation is realized through a large-size map and a compass, an interactive platform is constructed to enhance communication between tourists and between the tourists and operators, personalized services and intelligent recommendation are provided to meet diversified requirements, meanwhile, the cost is optimized, and a souvenir function is integrated. And multimedia and AR technologies are combined, so that the tour guide and shopping guide form is more vivid, and the travel experience of tourists is enriched. According to the invention, omnibearing and multi-level navigation tour guide and shopping guide services are provided for tourists, and the tourism experience of the tourists is improved.

Description

Technical Field

[0001] The invention belongs to the technical field of navigation, tourist guide and shopping guide, and in particular is a multimedia tourist guide and shopping guide device integrating a real scene map and map materials with navigation function. Background Art

[0002] Currently, most smart navigation and tour guide systems on the market rely on electronic maps and mobile phone screens. However, these screens have limited display area, making it difficult to fully and detailedly display the layout of scenic spots and the location of scenic spots, which brings inconvenience to tourists. For example, systems such as AutoNavi Smart Scenic Spot Open Platform use mobile phones for display, and their display area is usually around 113 square centimeters, which limits the comprehensive display of information. In addition, the functions and services of existing systems are relatively single, and cannot meet tourists' needs for all-round and multi-level experiences.

[0003] With the continuous prosperity of tourist attractions and the continuous improvement of tourists' requirements for travel experience, traditional navigation and tour guide tools can no longer meet the needs of modern tourists. In tourist attractions, tourists hope to have a more intuitive understanding of the layout of the entire scenic area, the locations of various attractions, recommended stores, and real-time traffic information. However, due to the limited display area of ​​existing electronic maps and mobile phone screens, it is difficult to present this information at the same time. Therefore, there is an urgent need for a new type of navigation and tour guide tool that can greatly increase the map display area and realize a comprehensive and detailed display of information, thereby enhancing tourists' travel experience.

[0004] The current intelligent navigation and tour guide systems on the market usually lack effective interaction functions between tourists and between tourists and tourism management parties. For example, the public authorization number CN107426701B discloses an intelligent voice tour guide system and its tour guide method, which provides a human-computer interaction function in tourism and answers tourists' inquiries through voice interaction. Tourists are often unable to directly share travel experiences, exchange experiences or evaluate attractions in the system, and tour guides also lack a centralized platform to promote activities and features and establish long-term connections with tourists. This lack of interactivity limits the richness of tourists' experience and hinders the establishment of relationships between tourists.

[0005] In summary, the existing navigation and tour guide system has obvious deficiencies in terms of map display area, intuitiveness, detail and comprehensiveness of information display, and interaction between tourists and tour guides, and between tourists. These limitations affect tourists' travel experience. Summary of the invention

[0006] The present invention provides a multimedia tourist guide and shopping guide device which integrates real scene pictures and map materials with navigation functions, provides tourists with more intuitive navigation tourist guide and shopping guide services, and improves the stickiness with the tourist guide and shopping guide device operators.

[0007] In order to achieve the above objectives, the present invention provides a multimedia tour guide and shopping guide device integrating a real scene map and a map material with a navigation function, which specifically includes a map material integrating a real scene map and a navigation function, and a tour guide and shopping guide interactive terminal. The tour guide and shopping guide interactive terminal is configured with a positioning receiver and a multimedia tour guide and shopping guide interactive application. The cloud server subsystem is a part of the device, which is used to support the multimedia tour guide and shopping guide interactive application.

[0008] Furthermore, the multimedia tourist guide and shopping guide device integrating the real scene map and the map material with navigation function specifically comprises: The map material integrating the real scene map and the navigation function comprises a waterproof substrate. The waterproof substrate is made of an umbrella cover, a plastic plate or other waterproof materials. One or more waterproof maps are arranged on the front and / or back of the waterproof substrate, and the waterproof maps are divided into replaceable and fixed types. The replaceable waterproof map is provided with adhesive and release materials on the back for easy replacement; while the fixed waterproof map is a map content directly printed on the waterproof substrate and cannot be replaced. When the front and back of the waterproof substrate are covered with fixed waterproof maps and the space is still insufficient, in the preset easy-to-change area, the replaceable waterproof map is covered after the original map is used, and the fixed waterproof map is used in all other cases. For example, when the umbrella cover is used as the waterproof substrate, it is inconvenient to replace the map on the inner surface of the umbrella due to the obstruction of the umbrella ribs, while the outer surface of the umbrella is more suitable for pasting the replaceable waterproof map, so it is preset as the easy-to-change area. When the front and back of the umbrella are covered with fixed waterproof maps and still cannot meet the needs, the original map on the outer surface of the umbrella is covered with the replaceable waterproof map after use. Each waterproof map is marked with a walking path.

[0009] According to different scenarios, the choice of map navigation method should be different. For situations with fewer destinations, the electronic navigation map displayed on the small screen of the mobile phone is sufficient to meet the use needs. However, in scenarios with dense walking navigation, scenic spots and recommended shops, map materials with integrated real-life pictures and navigation functions should be used. Since scenic spots are usually large in area, in order to show the locations of all scenic spots, walking paths and path intersections in detail, the map size needs to be increased accordingly. Due to its large area, this kind of map first gives tourists an intuitive global impression. On the map material with integrated real-life pictures and navigation functions, the intersection of the walking path is marked with an intersection number. Each waterproof map is assigned a unique map number. Each waterproof map is divided into several areas, and each area is assigned an area code. The front and / or back of the waterproof substrate are also provided with multiple real-life pictures of scenic spots, specifically one of the following three situations: the real-life pictures of scenic spots are placed on the front, back, or both sides of the waterproof substrate.

[0010] A compass position is provided on the side of the waterproof substrate on which the map is provided, and a physical compass or an electronic compass device is placed on the compass position. The physical compass is fixed on the waterproof substrate. The electronic compass device is adsorbed and connected to the waterproof substrate via a suction cup. A raised magnetic south line mark is provided on the surrounding map of the physical compass and the electronic compass device.

[0011] For example, after installing the compass application on a mobile phone, it can be used as an electronic compass device. If the waterproof substrate is an umbrella surface, it is slightly inconvenient to use because it is thin and uneven. If the waterproof substrate is a plastic tablet, the mobile phone contacts the tablet through the suction cup on the back, which is more convenient to use.

[0012] A magnifying glass is arranged on the front or back of the waterproof substrate to facilitate visitors with poor eyesight to identify the map from a distance.

[0013] Furthermore, the multimedia tourist guide and shopping guide device integrating the real scene map and the map material with navigation function specifically comprises: The tour guide and shopping guide interactive terminal is equipped with a positioning receiver and a multimedia tour guide and shopping guide interactive application program, mainly in the form of a mobile phone, but also includes portable smart devices other than mobile phones, for providing navigation, tour guide services, shopping guide information and tourist interactive services. Mobile phones are capable of using navigation software, so they are all equipped with positioning receivers.

[0014] Furthermore, the multimedia tourist guide and shopping guide device integrating the real scene map and the map material with navigation function specifically includes: The multimedia tour guide shopping guide interactive application mainly includes a multimedia module, an AR tour guide module, and an interactive platform module.

[0015] The multimedia module triggers and plays the corresponding tour guide shopping content according to the tourist location information captured by the positioning receiver, and the content includes audio, graphics, ordinary video and positioning information synchronized therewith. The multimedia module allows tourists to choose to listen to the audio introduction and view the synchronous positioning information in the form of black screen and white text at the same time, and / or watch the tour guide shopping content and synchronous positioning information in the form of graphics and text, and / or watch the tour guide shopping content and synchronous positioning information in the form of ordinary video. When tourists walk and listen to the audio introduction, the multimedia module displays the synchronous positioning information in the form of black screen and white text to reduce visual interference and prevent accidents due to distracted vision. Tourists can learn from the synchronous positioning information the currently introduced attractions, intersections of walking paths or recommended stores, including their names and the map numbers, area codes and intersection numbers to which they belong, and this information will help tourists locate the corresponding positions on the map. In addition, the multimedia module intelligently recommends similar or related tour guide shopping content based on the tourists' historical browsing records and preferences.

[0016] When tourists are at the intersection of their walking paths, the multimedia module displays the corresponding intersection number, and tourists can locate the corresponding location on the map. Tourists rotate the map material that integrates the real-life map and navigation function to align the compass with the raised mark of the magnetic south line. At this time, the map direction is completely consistent with the actual environment. This helps tourists identify the densely populated attractions and recommended store distribution locations in the surrounding area, and then choose a route to travel to the destination. After visiting the attractions or recommended stores, when tourists choose the next travel destination, they use the method of rotating the map material and aligning the compass to navigate again.

[0017] The map material integrating real scene pictures and navigation functions of the present invention is a technical iteration based on the original map material with compass, positioning light and walking path, removing the positioning light and its related electronic components, including the light control microprocessor, wireless communication module, power supply line, data line and power supply, so as to reduce costs and serve tourists more widely. In addition, the map material integrating real scene pictures and navigation functions is provided with real scene pictures of scenic spots and detailed maps, which increases its value as a souvenir.

[0018] One of the main features of the present invention is to use map materials without positioning lights, combined with a portable smart device with a built-in multimedia tour guide and shopping guide interactive application, the portable smart device is mainly in the form of a mobile phone, to jointly realize the tour guide and shopping guide interactive function. This combination form is the key protection content of the present invention patent.

[0019] Another main feature of the present invention is the map material itself, which includes a compass, a walking path map, a map number, a map area number, and an intersection number of the walking path. This feature is also the key protection content of the present invention patent. The importance of intersection numbers is reflected in the fact that walking is dominant in tourism, and there are many intersections on the walking path, so the intersection number can be used to locate the corresponding position on the map.

[0020] Given the large number of scenic spots across the country, the use of map numbers, map area numbers, and intersection numbers for walking paths will help achieve data-based management and ensure the smooth operation of the application.

[0021] The AR tour guide module is responsible for uploading facial photos of tourists to the cloud server subsystem for customizing AR tour guide videos. Before uploading, the module displays the privacy notice and ensures that tourists upload after confirming that they understand and agree to its content. At the same time, the module records the confirmation process of tourists, but does not display real-time video. Since the current situation of infringement of portrait rights on video platforms is particularly serious, this module strictly controls the facial photos used in customized AR tour guide videos. This module supports format inspection, processing and uploading of tourists' customized AR commentary content.

[0022] The privacy notice details the purpose, scope and protection measures of facial photos to ensure tourists' right to know. The format check function ensures that the customized AR commentary content uploaded by tourists meets the system requirements and guarantees the playback effect. The use of facial photos is strictly controlled to prevent abuse and infringement of portrait rights and enhance tourists' trust.

[0023] When tourists need to use the AR tour guide function, the module obtains the real-time location information of the tourists and sends a request to the cloud server subsystem to obtain the corresponding AR tour guide video. The module provides a tourist interface for displaying the AR tour guide video content downloaded from the cloud server subsystem, and for tourists to choose and watch according to their personal interests. In addition, the module also ensures that when displaying the AR tour guide video, tourists are provided with information about the current scenic spot, including its name and the map number and area code to which it belongs. This information helps tourists locate the corresponding location on the map.

[0024] The real-time positioning function ensures that tourists receive relevant AR tour guide videos at the correct location, improving the accuracy and practicality of the tour. The scenic spot information provided helps tourists better understand the geographical location of the scenic spot.

[0025] The interactive platform module builds an interactive platform for tourists and between tourists and the operators of the tour guide and shopping guide device. This module supports tourists to share their travel experiences, comment on scenic spots or recommended shops, and publish travel guides. In addition, this module supports tourists to use voice input and recognition functions to communicate and share at any time during the trip. This module supports the operators of the tour guide and shopping guide device to use this interactive platform to publish event information and local product introductions, and promote the e-commerce platform links of recommended shops at various scenic spots.

[0026] The interactive platform provides a variety of communication methods to meet the different needs of tourists and enhance the community atmosphere. Voice input and recognition functions simplify the communication process and improve tourists' interactive experience during travel. Operators of tour guide and shopping guide devices publish relevant information through the platform to promote the sales of local specialties and brand promotion.

[0027] Furthermore, the multimedia tourist guide and shopping guide device integrating the real scene map and the map material with navigation function specifically comprises: The cloud server subsystem mainly includes a data management and storage module, an AR content generation and push module, and a tourist interaction support module. The tourist interaction support module mainly includes a communication support submodule, an intelligent customer service submodule, and a data analysis submodule.

[0028] The data management and storage module adopts data compression and encryption technology. This module is responsible for safely storing all audio and general video information related to tour guides and shopping guides to ensure data security and transmission efficiency. This module provides data retrieval and update functions to maintain the timeliness and accuracy of information. In addition, this module supports multi-language content management to meet the needs of tourists from different countries and regions.

[0029] Data compression technology effectively reduces storage space usage and increases data transmission speed. Encryption technology ensures that data is not accessed without authorization during storage and transmission. Data retrieval function allows quick location and extraction of required information. Update function ensures that the stored information is the latest version to avoid misleading tourists with outdated information. Multilingual content management supports adding, editing and switching content in different languages ​​to improve international service level.

[0030] The AR content generation and push module is responsible for producing and updating various virtual content required for AR tours, including detailed explanations of scenic spots and re-enactments of historical figures. This module performs intelligent optimization and personalized recommendations for AR content. Based on tourists' historical browsing records and preferences, similar or related AR tour guide videos are intelligently recommended. This module generates customized AR tour guide videos based on tourists' own facial photos. Based on real-time positioning information, this module pushes personalized or privately customized AR tour guide videos to multimedia tour guide shopping interactive applications. This module processes customized AR commentary content uploaded by tourists through multimedia tour guide shopping interactive applications, and performs necessary review and management.

[0031] AR content production and updating ensure that the provided guide information is rich, accurate and attractive. Intelligent optimization adjusts the quality of AR content according to device performance and network conditions to ensure a smooth experience. Personalized recommendations are based on tourists' interests and behavior patterns to improve tourist satisfaction and engagement. Customized AR tour guide videos use tourists' facial photos to enhance the immersion and interactivity of the tour. Real-time positioning push ensures that tourists receive relevant guide information at the right location and improves navigation accuracy. Customized AR commentary content processing allows tourists to participate in content creation, increasing the interactivity and fun of the application.

[0032] The tourist interaction support module is provided with a communication support submodule, which is used to support the social interaction function of the multimedia tour guide and shopping guide interactive application, process various communication information between tourists and between tourists and the tour guide and shopping guide device operators, and ensure the operation of the interactive platform. In addition, the module is provided with an intelligent customer service submodule to automatically answer tourists' common questions and provide help. At the same time, the module is provided with a data analysis submodule to support data analysis of tourist behavior and provide operational decision support for the tour guide and shopping guide device operators.

[0033] The communication support submodule promotes information sharing and experience exchange among tourists, enhancing the community atmosphere. The intelligent customer service submodule quickly responds to tourists' needs and improves service efficiency through preset questions and answer libraries. The data analysis submodule collects and analyzes tourists' usage data, helping tour guides and shopping guide device operators understand tourists' behavior patterns and optimize product functions and marketing strategies.

[0034] The beneficial effects of the present invention are: 1. Intuitive navigation and precise positioning: dual protection of compass and detailed map By integrating real-life maps with navigation functions, especially with the addition of a compass design, tourists can easily identify directions and accurately locate themselves in scenic spots. The multimedia tour guide and shopping guide interactive application provides positioning information, and the large-size map not only provides the overall layout of the scenic area, but also the walking paths, intersection numbers and compass on the map, so that tourists can quickly find their way and determine the next walking route. This intuitive navigation method significantly reduces the risk of getting lost and improves the fluency and pleasure of the tour.

[0035] 2. Enhance interactivity and social experience The combination of the tour guide and shopping guide interactive terminal and the cloud server subsystem builds a comprehensive interactive platform. Tourists can share travel experiences, comment on attractions and shops, publish travel guides, and interact with other tourists and tour guide and shopping guide device operators in real time. This high degree of interactivity not only enriches tourists' travel experience, but also promotes social connections between tourists and enhances the stickiness between tourists and tour guide and shopping guide device operators.

[0036] 3. Personalized services and intelligent recommendations The multimedia module and AR tour guide module intelligently recommend similar or related tour guide content based on tourists' historical browsing records and preferences. From ordinary videos to customized AR tour guide videos, tourists can enjoy a personalized service experience. This intelligent recommendation mechanism not only meets the diverse needs of tourists, but also improves tourists' satisfaction and loyalty to the device.

[0037] 4. Dual advantages of cost optimization and souvenir function The tour guide and shopping guide device of the present invention achieves the dual advantages of cost optimization and souvenir function. On the one hand, by removing the positioning light and its related electronic components, the device effectively reduces the manufacturing cost while maintaining efficient functionality. This cost optimization strategy enables the device to widely serve tourists at a more affordable price, improving the practicality and market penetration of the device.

[0038] In addition, the device also has a souvenir function. By integrating the map material with real-life pictures and navigation functions, it not only provides tourists with practical navigation, tour guide and shopping guide services, but also allows tourists to fully experience the scenic area map and real-life pictures during the tour guide shopping process, thereby enhancing its appeal as a souvenir for tourists to commemorate their travels.

[0039] 5. The vividness of the tour guide shopping guide The multimedia tour guide and shopping guide device of the present invention, which integrates real-life pictures and map materials with navigation functions, has a significant vividness advantage compared to the traditional devices on the market that mainly rely on audio guides. Through the combination of multimedia modules and AR tour guide modules, the present invention not only provides audio introductions, but also displays graphics, ordinary videos and AR tour guide videos, enriching the presentation of tour guide and shopping guide content. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A schematic diagram of the inner surface appearance of an umbrella made of map material integrating a real-life image and navigation functions; Figure 2 It is a schematic diagram of the multimedia tour guide shopping guide interactive application module; Figure 3 This is a schematic diagram of the cloud server subsystem module.

[0041] Markings in the figure: 10-real-life map; 11-map number; 12-area code; 13-intersection number; 14-attraction sign; 15-recommended store sign; 161-compass position; 162-physical compass; 163-magnetic south line raised sign; 17-map partition line; 18-magnifying glass; 21-multimedia module; 22-AR tour guide module; 23-interactive platform module; 31-data management and storage module; 32-AR content generation and push module; 33-tourist interaction support module; 331-communication support submodule; 332-intelligent customer service submodule; 333-data analysis submodule. DETAILED DESCRIPTION

[0042] Figure 1 Schematic diagram of the inner surface of an umbrella made of map material that integrates real-life images and navigation functions. There are two waterproof maps on the inner surface of the umbrella: map number 111 represents the Wuhou Temple Scenic Area, and map number 112 represents the Songxian Bridge Scenic Area. The Wuhou Temple Scenic Area map is divided into three areas, A, B, and C, using the umbrella ribs as map partition lines 17. Since the Songxian Bridge Scenic Area is small in area, its map only includes one area A. The two maps are separated by a dotted line for clear distinction.

[0043] Figure 2 Schematic diagram of multimedia tour guide shopping guide interactive application module. The multimedia tour guide shopping guide interactive application mainly includes a multimedia module 21, an AR tour guide module 22, and an interactive platform module 23.

[0044] Figure 3 The cloud server subsystem module diagram is shown in FIG. The cloud server subsystem mainly includes a data management and storage module 31 , an AR content generation and push module 32 , and a visitor interaction support module 33 .

[0045] Embodiment: The present invention provides a multimedia tourist guide and shopping guide device integrating a real scene map and a map material with a navigation function, specifically comprising a tourist guide and shopping guide interactive terminal. In this embodiment, the tourist guide and shopping guide interactive terminal is in the form of a mobile phone equipped with a positioning receiver.

[0046] like Figure 1 As shown, in the embodiment, the map material integrating the real scene map and the navigation function is made into the umbrella cover. What is displayed in front of the reader is the inner surface of the umbrella. In this embodiment, only the inner surface has a waterproof map. But the inner surface is two waterproof maps: map number 11-1 is the Wuhou Temple Scenic Area map, and map number 11-2 is the Songxian Bridge Scenic Area map. The Wuhou Temple Scenic Area map is divided into three areas with the umbrella ribs as the map partition lines 17, and the area numbers 12 are A, B, and C respectively. The Songxian Bridge Scenic Area map is smaller in area and is divided into only one area, with area number 12 being A. Map numbers 11-1 and 11-2 are both fixed waterproof maps, marked with walking paths, scenic spot signs 14, recommended store signs 15, and walking path intersection numbers 13.

[0047] like Figure 1 As shown, four scenic spot real scene pictures 10 and a magnifying glass 18 are arranged on the inner surface of the umbrella, and the map number 11, the area code 12, and the name of the real scene picture 10 are marked under each real scene picture 10. Next to the magnifying glass 18, a compass position 161 is arranged, and a physical compass 162 is fixed in this embodiment, and a magnetic south line raised mark 163 is arranged below the physical compass 162.

[0048] like Figure 2 As shown, the tour guide and shopping guide interactive terminal is equipped with a multimedia tour guide and shopping guide interactive application. In this embodiment, the mobile phone is used as the tour guide and shopping guide interactive terminal, and the application is installed. The multimedia tour guide and shopping guide interactive application mainly includes a multimedia module 21, an AR tour guide module 22, and an interactive platform module 23.

[0049] The multimedia module 21 triggers and plays corresponding tour guide shopping content according to the tourist location information captured by the positioning receiver. The content includes audio, graphics, ordinary video and the positioning information synchronized therewith.

[0050] Multimedia module 21 allows tourists to choose to listen to audio introduction and check the synchronous positioning information of black screen and white text form at the same time, and / or watch the guide shopping content and synchronous positioning information of graphic form, and / or watch the guide shopping content and synchronous positioning information of common video form. In the present embodiment, the default is to listen to audio introduction and check the synchronous positioning information of black screen and white text form at the same time, and the graphic and video form content then need manual operation, and the purpose of doing so is to ensure the safety of tourists. Tourists can understand the current introduced scenic spots, the intersection of walking path or recommended shops from the synchronous positioning information, including their names and the map number 11, area code 12 and intersection number 13 to which they belong, and these information will help tourists locate the corresponding position on the map.

[0051] In addition, the multimedia module 21 intelligently recommends similar or related tour guide shopping content based on the historical browsing records and preferences of tourists. In this embodiment, the multimedia module 21 recommends the classic chapter content of "Longzhong Discussion" to tourists who love literature in Zhuge Liang Hall.

[0052] The AR tour guide module 22 is responsible for uploading facial photos of tourists to the cloud server subsystem to customize AR tour guide videos. Before uploading, the module displays the privacy notice and ensures that tourists upload after confirming that they understand and agree to its content. At the same time, the module records the confirmation process of tourists, but does not display real-time video. The privacy notice details the purpose, scope and protection measures of facial photos to ensure tourists' right to know. The AR tour guide module 22 supports format checking, processing and uploading of tourists' customized AR commentary content. In this embodiment, the AR tour guide module 22 is intended to increase the fun of the tour.

[0053] When tourists need to use the AR tour guide function, the AR tour guide module 22 obtains the real-time location information of the tourists and sends a request to the cloud server subsystem to obtain the corresponding AR tour guide video. The AR tour guide module 22 provides a tourist interface for displaying the AR tour guide video content downloaded from the cloud server subsystem, and for tourists to select and watch according to their personal interests.

[0054] In addition, the AR tour guide module 22 also ensures that when displaying the AR tour guide video, information about the currently introduced scenic spot is provided to tourists, including its name and the map number 11 and area code 12 to which it belongs, which helps tourists locate the corresponding location on the map. The same purpose as the positioning information synchronized with ordinary video, graphics and audio is to solve the positioning problem of scenic spots, recommended shops and intersections of walking paths on the waterproof map.

[0055] The interactive platform module 23 is used to build an interactive platform for tourists and for tourists and the operators of the guide shopping device. In this embodiment, the interactive platform module 23 supports tourists to share travel experiences, comment on scenic spots or recommended shops, and publish travel guides.

[0056] In addition, the interactive platform module 23 supports tourists to communicate and share at any time during the trip by using voice input and recognition functions. In this embodiment, the interactive platform module 23 supports the operator of the tour guide and shopping guide device to use this interactive platform to publish activity information and local product introductions, and promote the e-commerce platform link of the Songxianqiao scenic area Mapo Tofu.

[0057] The tour guide and shopping guide interactive terminal is equipped with a multimedia tour guide and shopping guide interactive application, and the cloud server subsystem supports the multimedia tour guide and shopping guide interactive application. Figure 3 As shown, the cloud server subsystem mainly includes a data management and storage module 31, an AR content generation and push module 32, and a tourist interaction support module 33. The tourist interaction support module 33 mainly includes a communication support submodule 331, an intelligent customer service submodule 332, and a data analysis submodule 333.

[0058] The data management and storage module 31 uses data compression and encryption technology. This module is responsible for safely storing all audio and general video information related to tour guide shopping, ensuring data security and transmission efficiency.

[0059] The data management and storage module 31 provides data retrieval and update functions to maintain the timeliness and accuracy of information. In addition, the data management and storage module 31 supports multi-language content management to meet the needs of tourists from different countries and regions.

[0060] The AR content generation and push module 32 is responsible for producing and updating various virtual contents required for AR tours, including detailed explanations of scenic spots and re-enactments of historical figures. This module performs intelligent optimization and personalized recommendations for AR content. Based on tourists' historical browsing records and preferences, similar or related AR tour guide videos are intelligently recommended. This module generates customized AR tour guide videos based on tourists' own facial photos.

[0061] In this embodiment, the AR content generation and push module 32 pushes personalized or customized AR tour guide videos to the multimedia tour guide shopping interactive application according to the real-time positioning information. This module processes the customized AR interpretation content uploaded by tourists through the multimedia tour guide shopping interactive application and performs necessary review and management.

[0062] The tourist interaction support module 33 is provided with a communication support submodule 331, which is used to support the social interaction function of the multimedia tour guide and shopping guide interactive application, process various communication information between tourists and between tourists and tour guide and shopping guide device operators, and ensure the operation of the interactive platform.

[0063] In this embodiment, the visitor interaction support module 33 is provided with an intelligent customer service submodule 332 to automatically answer the common questions of visitors and provide help.

[0064] At the same time, the module sets a data analysis submodule 333 to support data analysis of tourist behavior and provide operational decision support for the operator of the tour guide and shopping guide device. The data analysis submodule 333 collects and analyzes tourist usage data to help the operator of the tour guide and shopping guide device understand the tourist behavior pattern and optimize product functions and marketing strategies.

[0065] The workflow of the multimedia tourist guide shopping device integrating the real scene map and the map material with navigation function is as follows: S01. Tourist Xiao Zhang arrived at the Wuhou Temple Scenic Area in Chengdu and rented an umbrella made of map material with integrated real-life pictures and navigation functions at the gate.

[0066] S02. Tourist Xiao Zhang uses his mobile phone to download a multimedia tour guide and shopping guide interactive application, registers and logs in using his mobile phone number, and starts using a multimedia tour guide and shopping guide device that integrates real-life images and map materials with navigation functions.

[0067] S03. Tourist Xiao Zhang chooses to upload his own face photo for AR tour guide video customization on the multimedia tour guide shopping interactive application. Prior to this, the system requires tourist Xiao Zhang to confirm that he has read the contents of the privacy notice.

[0068] The confirmation process is as follows: The multimedia tour guide shopping interactive application displays the content of the privacy notice and turns on the video recording function to record the confirmation process of tourist Xiao Zhang, but the real-time video of tourist Xiao Zhang is not displayed on the screen. Tourist Xiao Zhang needs to read the privacy notice sentence by sentence to confirm that he understands and agrees to its content. After reading, the system prompts tourist Xiao Zhang to face the front camera of the mobile phone, and the camera captures the facial image of tourist Xiao Zhang. The system takes a photo and uploads the facial photo of tourist Xiao Zhang for subsequent AR tour guide customization.

[0069] S04. Tourist Xiao Zhang uses the multimedia tour guide and shopping guide interactive application on his mobile phone to download a customized tour guide and shopping guide AR video from the cloud server subsystem for use.

[0070] S05. When tourist Xiao Zhang arrives at the intersection numbered 13 (①) on the walking path beside Jinyuan, the mobile phone automatically broadcasts the name of the intersection and displays "Location" in white text on a black screen. Figure 1 C Zone Intersection①". Tourist Xiao Zhang turned the inner surface of the umbrella upwards and rotated the umbrella surface to align the compass with the raised mark 163 on the magnetic south line. At this time, the map direction is completely consistent with the actual environment. Tourist Xiao Zhang looked at the map. Figure 1 Area C, the surrounding scenic spots are marked 14 as Jinyuan, Jianxindian, and Dongpeitang, and the surrounding recommended shops are marked 15 as Jinqingkedansu and Xiangxunge, and their specific locations are clearly known. Tourist Xiao Zhang chooses the direction of travel according to his own wishes.

[0071] S06. When tourist Xiao Zhang arrived at Jinyuan Scenic Spot, the mobile phone automatically played the audio guide information, and the location information was displayed in black screen with white text: Figure 1 C Zone Jinyuan Scenic Spot". It also prompts that there are pictures, texts and ordinary video information for tourist Xiao Zhang to choose from.

[0072] Tourist Xiao Zhang stopped and chose to watch the ordinary video tour guide content of Jinyuan scenic spot. Compared with the audio tour guide, the ordinary video is more vivid and has more diverse content. The ordinary video also displays the location information: "Location Figure 1 "Jinyuan Scenic Spots in Area C".

[0073] S07, when tourist Xiao Zhang arrived at Figure 1 When you are in front of the Zhuge Liang Temple attraction shown in the picture, the phone automatically plays the audio guide about the attraction. The location information is displayed in white text on the black screen: "Location Figure 1 "Zhuge Liang Hall Scenic Spot in Area A".

[0074] S08. The mobile phone simultaneously displays the AR video corresponding to the scenic spot.

[0075] Regarding the operation of the AR tour guide, the specific steps are as follows: When tourist Xiao Zhang is near the Zhuge Liang Temple, the mobile phone will prompt that there is an available AR video based on the positioning information. Tourist Xiao Zhang needs to turn on the camera function of the mobile phone and click on the AR video prompt box on the screen. Afterwards, the mobile phone uses augmented reality technology to immediately display an AR tour guide screen on the screen that combines the real scenic spot scene Zhuge Liang Temple with a virtual tour guide character, providing tourist Xiao Zhang with a richer and more interactive tour experience. If tourist Xiao Zhang has downloaded a customized version of the AR tour guide video, the mobile phone will display an AR video of a virtual character with his face as the model introducing the story of the Thatched Cottage Three Visits. The AR tour guide video also displays positioning information: "Location Figure 1 "Zhuge Liang Hall Scenic Spot in Area A".

[0076] S09. When tourist Xiao Zhang arrived at the Mapo Tofu flagship store in Songxianqiao Scenic Area, his phone automatically played the audio guide information and displayed the location information in white text on a black screen: Figure 2 Area A Mapo Tofu Flagship Store". At the same time, it reminds tourist Xiao Zhang that he can choose to view pictures and text or ordinary video information.

[0077] Tourist Xiao Zhang stopped and chose to view the illustrated shopping guide, which was more vivid and different in content than the audio guide. The illustrated version also displayed location information: Figure 2 Area A Mapo Tofu Flagship Store".

[0078] S10. After watching Sichuan Opera at the Sichuan Opera Club, tourist Xiao Zhang plans to visit the Shiguang Exhibition Hall. He turns the inner surface of his umbrella upwards and rotates the umbrella to align the compass with the raised mark 163 on the magnetic south line. At this time, the map direction is completely consistent with the actual environment. Figure 2In Area A, follow the compass to walk south to the intersection numbered ③ on the path, then pass the intersection numbered ④ on the path, and then walk east to the end point.

[0079] S11. At the Songxian Bridge Scenic Area, tourist Xiao Zhang found that the inner and outer surfaces of the umbrella were printed with real scene pictures 10, and there were also pictures of the Wuhou Temple and the Songxian Bridge Scenic Area. He thought that the umbrella had commemorative value. Therefore, Xiao Zhang changed the original rental status to purchase on the multimedia tour guide shopping interactive application and successfully returned the excess deposit.

[0080] S12. During the tour, tourist Xiao Zhang shares his travel experience, comments on the scenic spots and recommended shops in the Wuhou Temple scenic area, and publishes travel tips through the interactive platform module 23. At the same time, tourist Xiao Zhang uses the voice input and recognition function to communicate and share with other tourists or tour guide and shopping guide device operators in real time.

[0081] S13, the operator of the tour guide and shopping guide device publishes the activity information of Wuhou Temple Scenic Area and the introduction of Pixian Douban, a local specialty, through the interactive platform module 23, and promotes the e-commerce platform link of the recommended store of Songxianqiao Scenic Area. After receiving this information, tourist Xiao Zhang chooses to participate in the activity or purchase Pixian Douban according to his own interests.

[0082] The specific embodiments described in the present invention are only for illustration and explanation, and are not intended to limit the protection scope of the present invention. For those skilled in the art, any obvious simple deformation, equivalent substitution or modification made to the present invention without departing from the principle and essential spirit of the present invention shall be deemed to fall within the protection scope of the present invention.

Claims

1. A multimedia tourist guide and shopping guide device integrating real scene pictures and map materials with navigation functions, characterized in that: The multimedia tour guide and shopping guide device that integrates real-life pictures and map materials with navigation functions includes map materials that integrate real-life pictures and navigation functions, and a tour guide and shopping guide interactive terminal; the tour guide and shopping guide interactive terminal is equipped with a positioning receiver and a multimedia tour guide and shopping guide interactive application; the cloud server subsystem is a part of the device, and is used to support the multimedia tour guide and shopping guide interactive application.

2. The multimedia tourist guide and shopping guide device integrating real scene images and map materials with navigation functions as claimed in claim 1, characterized in that: The map material integrating real-life map and navigation function comprises a waterproof substrate; one or more waterproof maps are arranged on the front and / or back of the waterproof substrate, and the waterproof maps are divided into replaceable and fixed types; when the space is still insufficient even if the front and back of the waterproof substrate are covered with fixed waterproof maps, the replaceable waterproof map is covered after the original map is used in the preset easy-to-change area, and the fixed waterproof map is used in all other cases; each waterproof map is marked with a walking path, and the intersection number (13) is marked at the intersection of the walking path; each waterproof map is assigned a unique map number (11); each waterproof map is divided into a plurality of areas, and each area is assigned a zone number (12); each waterproof map is divided into a plurality of areas, and each area is assigned a zone number (13); each waterproof map is divided into a plurality of areas, and each area is assigned a zone number (12 ... The waterproof substrate is provided with a plurality of scenic spot pictures (10) on the front and / or back side; a compass position (161) is provided on the side of the waterproof substrate provided with the map, and the compass position (161) is provided with one of a physical compass (162) and an electronic compass device; the physical compass (162) is fixed on the waterproof substrate; the electronic compass device is connected to the waterproof substrate by suction through a suction cup; a magnetic south line raised mark (163) is provided on the surrounding map of the physical compass (162) and the electronic compass device; a magnifying glass (18) is provided on the front or back side of the waterproof substrate to facilitate tourists with poor eyesight to identify the map from a distance.

3. The multimedia tourist guide and shopping guide device integrating real scene images and map materials with navigation functions as claimed in claim 1, characterized in that: The tour guide and shopping guide interactive terminal is equipped with a positioning receiver and a multimedia tour guide and shopping guide interactive application program, and is mainly in the form of a mobile phone, but also covers portable smart devices other than mobile phones, and is used to provide navigation, tour guide services, shopping guide information and tourist interaction services.

4. The multimedia tourist guide and shopping guide device integrating real scene images and map materials with navigation functions as claimed in claim 1, characterized in that: The multimedia tour guide shopping guide interactive application mainly comprises a multimedia module (21), an AR tour guide module (22), and an interactive platform module (23); The multimedia module (21) triggers and plays corresponding tour guide content according to the tourist location information captured by the positioning receiver, and the content includes audio, graphics, ordinary video and synchronous positioning information. The module allows tourists to choose to listen to the audio introduction and view the synchronous positioning information in the form of black screen and white text at the same time, and / or view the tour guide content and synchronous positioning information in the form of graphics, and / or view the tour guide content and synchronous positioning information in the form of ordinary video. Tourists can learn about the currently introduced scenic spots, intersections of walking paths or recommended stores from the synchronous positioning information, including their names and the map numbers (11), area codes (12) and intersection numbers (13) to which they belong. This information will help tourists locate the corresponding location on the map. In addition, the module intelligently recommends similar or related tour guide content according to the tourists' historical browsing records and preferences. The AR tour guide module (22) is responsible for uploading the facial photos of tourists to the cloud server subsystem for customizing AR tour guide videos. Before uploading, the module displays the privacy notice and ensures that tourists upload the content after confirming that they understand and agree to it. At the same time, the module records the confirmation process of tourists but does not display real-time video. The module supports format checking and uploading of tourists' customized AR explanation content. When a tourist needs to use the AR tour guide function, the module obtains the tourist's real-time location information and sends a request to the cloud server subsystem based on the information to obtain the corresponding AR tour guide video; the module provides a tourist interface for displaying the AR tour guide video content downloaded from the cloud server subsystem, and allows tourists to select and watch it according to their personal interests; in addition, the module also ensures that when displaying the AR tour guide video, information about the currently introduced scenic spot is provided to the tourist, including its name and the map number (11) and area code (12) to which it belongs, which helps the tourist locate the corresponding location on the map; The interactive platform module (23) builds an interactive platform for tourists and for tourists and the operators of the tour guide and shopping guide device; the module supports tourists to share their travel experiences, comment on scenic spots or recommended shops, and publish travel guides; in addition, the module supports tourists to use voice input and recognition functions to communicate and share at any time during the travel; the module supports the operators of the tour guide and shopping guide device to use this interactive platform to publish activity information and local product introductions, and promote the e-commerce platform links of the recommended shops at various scenic spots.

5. The multimedia tourist guide and shopping guide device integrating real scene images and map materials with navigation functions as claimed in claim 1, characterized in that: The cloud server subsystem mainly includes a data management and storage module (31), an AR content generation and push module (32), and a tourist interaction support module (33); the tourist interaction support module (33) mainly includes a communication support submodule (331), an intelligent customer service submodule (332), and a data analysis submodule (333); The data management and storage module (31) adopts data compression and encryption technology. The module is responsible for safely storing all audio and general video information related to the tour guide and shopping guide, ensuring data security and transmission efficiency; This module provides data retrieval and update functions to maintain the timeliness and accuracy of information; In addition, the module supports multilingual content management to meet the needs of tourists from different countries and regions; The AR content generation and push module (32) is responsible for producing and updating various virtual contents required for AR tours, including detailed explanations of scenic spots and re-enactments of historical figures. This module performs intelligent optimization and personalized recommendations on AR content. It intelligently recommends similar or related AR tour guide videos based on tourists' historical browsing records and preferences. This module generates customized AR tour guide videos based on tourists’ own facial photos; This module pushes personalized or privately customized AR tour guide videos to the multimedia tour guide and shopping guide interactive application based on real-time positioning information; This module processes the customized AR commentary content uploaded by tourists through the multimedia tour guide and shopping guide interactive application, and conducts necessary review and management; The tourist interaction support module (33) is provided with a communication support submodule (331), which is used to support the social interaction function of the multimedia tour guide and shopping guide interactive application program, process various communication information between tourists and between tourists and the tour guide and shopping guide device operators, and ensure the operation of the interactive platform; in addition, the module is provided with an intelligent customer service submodule (332) to automatically answer tourists' common questions and provide assistance; at the same time, the module is provided with a data analysis submodule (333) to support data analysis of tourist behavior and provide operational decision support for the tour guide and shopping guide device operators.

Images