Visual interaction method and device, equipment, storage medium and program product

Abstract

The embodiment of the invention relates to a sightseeing interaction method and device, equipment, a storage medium and a program product. The method comprises the steps of displaying a navigation interaction control in a navigation interface in response to the fact that a current advancing position of a user reaches a target location in a target navigation route; the guide interaction control comprises at least one of an auditory control, an olfactory control and a tactile control; in response to a trigger operation acting on the guide interaction control, determining a target guide audio based on the triggered guide interaction control and the target location; and playing the target guide audio so as to guide a user to visit the target location by utilizing the perception capability corresponding to the guide interaction control. Thus, the user can visit the landscape at the target location by mobilizing other perception capabilities, the efficiency of visually impaired people to obtain surrounding information is improved, and the sightseeing experience of the visually impaired people is greatly improved.

Description

Technical Field

[0001] The present disclosure relates to the field of human-computer interaction technologies, and particularly to a tour interaction method, apparatus, device, storage medium, and program product. Background Art

[0002] A tourist attraction is an area or place whose main function or one of the main functions is tourism and its related activities, and it can provide tourists with tourism needs such as sightseeing, leisure and vacation, and recreational fitness. Generally, a tourist attraction will provide introduction audio of relevant scenic spots in the scenic area so that tourists can better tour the scenic area by combining what they see and the audio content.

[0003] However, for visually impaired people, they cannot well utilize visual perception to obtain external information. Even when combined with the introduction audio of the scenic spots provided by the scenic area, they cannot be well understood by visually impaired people due to the lack of information about the visual scenery. This results in visually impaired people hardly being able to perceive the beauty and magic of the scenery, and thus visually impaired people cannot have a good tourism experience. Summary of the Invention

[0004] To solve the above technical problems, embodiments of the present disclosure provide a tour interaction method, apparatus, device, storage medium, and program product.

[0005] In a first aspect, embodiments of the present disclosure provide a tour interaction method, which includes:

[0006] In response to the current traveling position reaching a target location in a target tour guide route, a tour guide interaction control is displayed in a tour guide interface; wherein, the tour guide interaction control includes at least one of an auditory control, an olfactory control, and a tactile control;

[0007] In response to a trigger operation acting on the tour guide interaction control, based on the triggered tour guide interaction control and the target location, a target tour guide audio is determined;

[0008] The target tour guide audio is played; the target tour guide audio is used to guide a user to tour the target location by using the perception ability corresponding to the tour guide interaction control.

[0009] In a second aspect, embodiments of the present disclosure further provide a tour interaction apparatus, which includes:

[0010] A tour guide interaction control display module, configured to display a tour guide interaction control in a tour guide interface in response to the current traveling position reaching a target location in a target tour guide route; wherein, the tour guide interaction control includes at least one of an auditory control, an olfactory control, and a tactile control;

[0011] A target guided tour audio determination module, configured to respond to a trigger operation on the guided tour interaction control, and determine target guided tour audio based on the triggered guided tour interaction control and the target location;

[0012] A target guided tour audio playback module, configured to play the target guided tour audio; the target guided tour audio is used to guide a user to tour the target location by using the perception ability corresponding to the guided tour interaction control.

[0013] In a third aspect, an embodiment of the present disclosure further provides an electronic device, which includes:

[0014] A processor;

[0015] A memory, configured to store executable instructions;

[0016] Wherein, the processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the tour interaction method described in any embodiment of the present disclosure.

[0017] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor is caused to implement the tour interaction method described in any embodiment of the present disclosure.

[0018] In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, which is used to execute the tour interaction method described in any embodiment of the present disclosure.

[0019] The tour interaction method, device, equipment, storage medium and program product of the embodiments of the present disclosure can respond to the fact that the user's current travel position reaches the target location in the target guided tour route, and display a guided tour interaction control on the guided tour interface; the guided tour interaction control includes at least one of an auditory control, a olfactory control, and a tactile control; respond to a trigger operation on the guided tour interaction control, and determine target guided tour audio based on the triggered guided tour interaction control and the target location; play the target guided tour audio to guide the user to tour the target location by using the perception ability corresponding to the guided tour interaction control; implement an interaction function that provides other perception abilities for the user in addition to the visual perception ability, so that the user can mobilize other perception abilities (such as hearing, smell, touch, etc.) through these interaction functions to tour the scenery and landscapes at the target location, thereby improving the efficiency of visually impaired people in obtaining surrounding information, greatly enhancing their tour and sightseeing experience, and further improving the travel interest and physical and mental health of visually impaired people.

[0020] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the embodiments of the present disclosure are all information and data that have been authorized by the user or fully authorized by all parties. Moreover, the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions, and corresponding operation entrances are provided for users to choose to authorize or refuse. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In combination with the accompanying drawings and with reference to the following specific embodiments, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic, and the elements and elements are not necessarily drawn to scale.

[0022] Figure 1 It is a schematic flowchart of a tour interaction method provided by an embodiment of the present disclosure;

[0023] Figure 2 It is a schematic diagram showing a tour interaction control displayed in a navigation interface provided by an embodiment of the present disclosure;

[0024] Figure 3 It is a schematic diagram of the effect of triggering an auditory control provided by an embodiment of the present disclosure;

[0025] Figure 4 It is a schematic diagram of the effect of triggering a smell control provided by an embodiment of the present disclosure;

[0026] Figure 5 It is a schematic diagram of the effect of triggering a tactile control provided by an embodiment of the present disclosure;

[0027] Figure 6 It is a schematic diagram of the effect of triggering a shooting control provided by an embodiment of the present disclosure;

[0028] Figure 7 It is a schematic flowchart of another tour interaction method provided by an embodiment of the present disclosure;

[0029] Figure 8 It is a schematic diagram of an interaction process for selecting a tour route provided by an embodiment of the present disclosure;

[0030] Figure 9 It is a schematic diagram of an interaction process for familiarizing with a tour route through a route interface provided by an embodiment of the present disclosure;

[0031] Figure 10 It is a schematic diagram of an interaction process for starting voice navigation according to a target tour route provided by an embodiment of the present disclosure;

[0032] Figure 11 Structural schematic diagram of a tour interaction device provided by an embodiment of the present disclosure;

[0033] Figure 12 Structural schematic diagram of an electronic device provided by an embodiment of the present disclosure. Detailed implementation manners

[0034] Embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0035] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be executed in different orders and / or executed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard.

[0036] As used herein, the term "including" and its variations are open-ended, that is, "including but not limited to". The term "based on" is "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0037] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependent relationships.

[0038] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly stated in the context, it should be understood as "one or more".

[0039] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0040] In the related art, the scenic area tour guide services provided are mostly for non-visually impaired people, which mainly rely on the visual perception ability of tourists to obtain information about the scenic area, so that tourists can experience the scenery and landscapes of the scenic area. For example, when a tourist visits a certain palace, the scenic area tour guide service can provide a map around the palace and audio about the history of the palace, etc., to provide supplementary information on the basis that the tourist can observe the appearance and structure of the palace through visual perception ability. However, the visual perception ability of visually impaired people is weak or even absent, which makes it impossible for visually impaired people to obtain basic information about scenic spots (such as the appearance of the palace) when visiting the scenic area, so that they cannot appreciate the scenery of the scenic spots even in combination with the above-mentioned scenic spot audio, resulting in very low efficiency for such tourists to obtain surrounding information and poor sightseeing experience. However, visually impaired people also need to travel frequently to relax and perceive the scenery of the scenic area, and they also have a strong need to visit the scenic area.

[0041] Based on the above situation, the embodiments of the present disclosure provide a tour interaction solution to provide a tour interaction function of the scenic area by using various perception abilities of the human body, so as to guide visually impaired users to call other perception abilities other than their visual perception ability to obtain information about their surrounding environment, enhance the immersive tour experience during the process of visiting the scenic area, and thus improve the information acquisition efficiency and sightseeing experience of visually impaired people.

[0042] The tour interaction method provided by the embodiments of the present disclosure is applicable to the scenario of providing tour guide services for visiting scenic areas, especially applicable to the scenario of providing tour guide services for visually impaired people in scenic areas. This method can be executed by a tour interaction device, which can be implemented in software and / or hardware, and can be integrated in a portable electronic device with voice function and human-computer interaction function. The electronic device may include, but is not limited to, smartphones, personal digital assistants (PDAs), tablet personal computers (TabletPCs), wearable devices, etc.

[0043] Figure 1 The flowchart of a tour interaction method provided by the embodiments of the present disclosure is shown. As Figure 1 shown, the tour interaction method may include the following steps:

[0044] S110. In response to the current traveling position reaching a target location in the target tour route, display a tour interaction control on the tour guide interface; the tour interaction control includes at least one of an auditory control, an olfactory control, and a tactile control.

[0045] Among them, the current traveling position is the geographical location where the user is at the current moment, which may include geographical coordinates and / or geographical directions, etc. The target tour route is a tour guide route / path within the tourist attraction (taking a scenic area as an example) selected by the user, which includes multiple target locations. The tour guide route is pre-planned according to the road information in the scenic area (such as the road position, road types such as sidewalks, roadways, and blind paths), service settings (such as toilets, information desks, stores, etc.), and information of each scenic spot (such as distribution location, tour popularity, suitable population, etc.). The route planning here can be manual planning or can be planned using path planning algorithms in related technologies. The target location is a location that can be visited in the target tour route, and can also be called a scenic spot in the scenic area. The tour guide interface is an interactive interface for guiding the user to view the landscape of the target location. The tour guide interaction control is a control with interactive functions for guiding the user to view the landscape. Considering that the visual perception ability of visually impaired people is weak, the tour guide interaction control set in the embodiments of the present disclosure can be an interaction control for guiding the user to invoke other perception abilities besides the visual perception ability.

[0046] Exemplarily, the tour guide interaction control includes at least one of an auditory control, a olfactory control, and a tactile control. The auditory control is an interaction control for guiding the user to invoke their auditory perception ability in the form of audio and / or text. Correspondingly, the olfactory control is an interaction control for guiding the user to invoke their olfactory perception ability. The tactile control is an interaction control for guiding the user to invoke their tactile perception ability. For visually impaired people, the above interaction controls can guide the user to perform certain actions in the form of audio to invoke their corresponding other perception abilities. The interaction control here can be a radio button or an input-type interaction control such as voice or gesture.

[0047] Specifically, during the process of a user using the navigation function to tour a scenic area, the electronic device can utilize its built-in positioning sensor to obtain the user's current traveling position in real time. Then, compare the current traveling position with each target location in the target navigation route to determine whether the current traveling position has reached a certain target location. For example, the electronic device can compare the current traveling position with the covered geographical range of the target location to determine whether it falls within the covered geographical range of the target location. Another example is that the electronic device can calculate the distance between the current traveling position and the geographical location of the target location, and compare whether this distance is less than a pre-set distance threshold. If not, then the above process can be repeated. If so, then it can be determined that the current traveling position has reached a certain target location in the target navigation route. At this time, it can be considered that the user will tour at this target location. Then, the electronic device can display a navigation interface and display navigation interaction controls suitable for the above target location in the navigation interface. For example, if there is a sound suitable for listening in the target location, then display an auditory control; another example is that if there is an object suitable for touching in the target location, then display a tactile control; and another example is that if there is an object emitting some gas in the target location, then display a olfactory control, etc. In this way, the electronic device can provide interaction controls that can call more perceptual abilities such as hearing, smell, and touch for the user through the above navigation interaction controls, thereby largely making up for the information loss caused by visual impairment by fully utilizing the human body's abilities, enabling the user to perceive the landscape of the target location in all directions to obtain surrounding environment information, rather than mainly relying on visual perception ability, making the information of the target location / scenic spot more rich and three-dimensional, and thus providing a better way of touring for visually impaired users.

[0048] See Figure 2 , after the electronic device detects that the current traveling position has reached a certain target location, it can display the navigation interface 200, and after determining that there are landscapes corresponding to multiple human perceptual abilities at this target location, display the auditory control 210, olfactory control 220, and tactile control 230 in the navigation interface 200. At the same time, in order to provide a better experience for visually impaired users, the electronic device can use the voice assistant 240 to announce which target location has been reached (such as Figure 2 "has reached scenic spot 1" in Figure 2 ), which navigation interaction control is displayed at which position of the navigation interface (such as

[0049] S120. In response to a trigger operation on a navigation interaction control, determine a target navigation audio based on the triggered navigation interaction control and the target location.

[0050] Among them, the target navigation audio is a candidate navigation audio adapted to the target location and the triggered navigation interaction control. The candidate navigation audio is a navigation audio pre-produced according to the target locations / landscapes of the scenic area and the human perception capabilities corresponding to the navigation interaction controls; or, the candidate navigation audio is a navigation text pre-produced according to the above information, and then the navigation audio obtained by automatically reading the navigation text. For example, there is an ancient tree in a certain target location, which is suitable for tactile perception capabilities such as touching and embracing, so a candidate navigation audio can be pre-produced to guide users to touch and embrace it. Thus, the electronic device can pre-obtain the corresponding relationship between the target location, the perception capability identifier corresponding to the navigation interaction control, and the candidate navigation audio.

[0051] Specifically, if the user performs a trigger operation on a certain navigation interaction control displayed in the navigation interface, then the electronic device can respond to the trigger operation, use the target location and the perception capability identifier corresponding to the triggered navigation interaction control to query the above corresponding relationship, so as to screen out the target navigation audio from multiple candidate navigation audios.

[0052] S130. Play the target navigation audio; the target navigation audio is used to guide the user to tour the target location by using the perception capabilities corresponding to the navigation interaction control.

[0053] Specifically, the electronic device can play the target navigation audio to guide the user to call other perception capabilities corresponding to the triggered navigation interaction control to perceive a certain scenery of the target location. In this way, voice can be used as the main information input and acquisition channel, which highly adapts to the needs of visually impaired users.

[0054] In some embodiments, the electronic device can generate a new navigation audio based on the current traveling position and the target navigation audio, and play the new navigation audio to guide the user to first walk from the current traveling position to the scenery corresponding to the triggered navigation interaction control in the area where the target location is located, and then play the target navigation audio to guide the user to call the corresponding other perception capabilities to perceive the scenery, and complete the tour of the scenery.

[0055] It should be noted that if there are multiple navigation interaction controls, then the electronic device can repeatedly execute S120~S130 until the user completes the tour of the target location.

[0056] Continue to refer to Figure 2, an interactive control for guiding the user to the next adjacent target location (such as the "Continue Tour" control 250) can also be displayed on the tour guide interface. If the user does not want to tour the target location where they are currently located, or has at least toured a part of the landscape through the above tour guide interactive control, then the user can trigger the "Continue Tour" control 250 to guide the user along the target tour guide route to the next adjacent target location by voice.

[0057] It should also be noted that the tour guide interactive controls on the tour guide interface can all be implemented as interactive controls with a relatively large operation hot zone to reduce the operation difficulty of the electronic device for visually impaired users.

[0058] The tour interaction method provided by each of the above embodiments of the present disclosure can display a tour guide interactive control on the tour guide interface in response to the user's current travel position reaching a target location in the target tour guide route; the tour guide interactive control includes at least one of an auditory control, an olfactory control, and a tactile control; in response to a trigger operation acting on the tour guide interactive control, determine a target tour guide audio based on the triggered tour guide interactive control and the target location; play the target tour guide audio to guide the user to tour the target location by using the perception ability corresponding to the tour guide interactive control; it realizes an interactive function that provides other perception abilities for the user in addition to the visual perception ability, enabling the user to mobilize other perception abilities (such as hearing, smell, touch, etc.) through these interactive functions to tour the scenery and landscape at the target location, thereby improving the efficiency of visually impaired people in obtaining surrounding information, greatly enhancing their tour and sightseeing experience, and further improving the travel interest and physical and mental health of visually impaired people.

[0059] In some embodiments, S120 includes: if the tour guide interactive control includes an auditory control, in response to a trigger operation acting on the auditory control, screen a candidate tour guide audio that is adapted to the auditory control and the target location from multiple candidate tour guide audios as the target tour guide audio.

[0060] Specifically, continue to refer to Figure 2 , an auditory control 210 is displayed on the tour guide interface corresponding to scenic spot 1. After the user triggers the auditory control 210, the electronic device can respond to this trigger operation and screen the target tour guide audio from multiple candidate tour guide audios according to "scenic spot 1" and the auditory ability identifier.

[0061] For example, refer to Figure 3For the "XX Palace" at the target location, the electronic device determines and plays the target guided tour audio in response to the user's triggering operation on the auditory control. The user can learn through the audio that "the main body of the XXX Palace is composed of red walls and red columns. The upturned angle of the eaves is 30 degrees. You can stretch out your left hand and tilt your fingers upwards forcefully, and then use your right hand to touch the arc of the back of your left hand...", and then perform the behavior of bending the back of the left hand and perceiving it with the right hand according to the guidance of the audio, so that visually impaired users can perceive the appearance of the eaves of the palace. Another example is that for the large clock or the main hall of the temple at the target location, the electronic device can play the target guided tour audio, so that visually impaired users can hear the sound of the bell ringing or the sound of chanting scriptures, so that they can perceive the historical scenery here through hearing, etc.

[0062] In some other embodiments, S120 includes: if the guided tour interaction control includes a olfactory control, then in response to the triggering operation on the olfactory control, screen out the candidate guided tour audio that adapts to the olfactory control and the target location from multiple candidate guided tour audios as the target guided tour audio.

[0063] Specifically, continue to refer to Figure 2 In the guided tour interface corresponding to Scenic Spot 1, an olfactory control 220 is displayed. After the user triggers the olfactory control 220, the electronic device can respond to this triggering operation and screen out the target guided tour audio from multiple candidate guided tour audios according to "Scenic Spot 1" and the olfactory ability identifier.

[0064] For example, refer to Figure 4 For the corridor of the "XX Palace" at the target location, the corridor columns emit a certain smell. Then, the electronic device responds to the user's triggering operation on the olfactory control, determines the target guided tour audio, and generates and plays a new guided tour audio based on the current traveling position. The user can learn through the audio that "take two steps forward, and you can touch a red corridor column. Get closer and smell it with your nose. You can smell a faint tea fragrance. This is the most expensive wood - Phoebe zhennan...", and then walk according to the guidance of the traveling direction and distance in the audio, and get closer to smell the smell of the corridor column, and perceive the corridor column made of Phoebe zhennan through smell.

[0065] In still some other embodiments, S120 includes: if the guided tour interaction control includes a tactile control, then in response to the triggering operation on the tactile control, screen out the candidate guided tour audio that adapts to the tactile control and the target location from multiple candidate guided tour audios as the target guided tour audio.

[0066] Specifically, continue to refer to Figure 2, a tactile control 230 is displayed in the navigation interface corresponding to scenic spot 1. After the user triggers the tactile control 230, the electronic device can, in response to the trigger operation, screen out a target navigation audio from multiple candidate navigation audios according to "scenic spot 1" and the tactile ability identifier.

[0067] For example, referring to Figure 5 , for the "xx cypress tree" in the target location, which is a century-old tree and a scenic view in the target location, then the electronic device, in response to the user's trigger operation on the tactile control, determines the target navigation audio and generates a new navigation audio based on the current traveling position for playback. The user can learn through the audio "Turn left and go forward. Okay, now stop walking and stretch out your hand to touch. This is an ancient cypress tree that has survived for more than 500 years. You can touch it around to feel its thick trunk that is wider than two people...", and then walk according to the guidance of the traveling direction and distance in the audio, get closer to touch the bark of the ancient tree, walk around it or stretch out your arms to surround it, and perceive the epidermal texture and thickness of the century-old ancient tree through touch.

[0068] In some embodiments, continuing to refer to Figure 2 , the navigation interaction control further includes a dialogue control, so that a dialogue control 260 can be displayed in the navigation interface 200. The dialogue control 260 can be used to trigger the human-computer dialogue function and guide the user to mobilize other human perception abilities to visit the target location in a conversational manner. To enhance the tour experience, the dialogue control 260 can be used to call the conversation function based on a language model or a generative model of a certain scale, so as to utilize the powerful learning ability and generation ability of these models to provide a more flexible and fluent conversation guidance function.

[0069] Based on the above embodiments, after S110, the method further includes: in response to the trigger operation on the dialogue control, receiving an instant voice message; generating feedback conversation content based on the instant conversation content corresponding to the instant voice message and the target location, and voice-broadcasting the feedback conversation content; the feedback conversation content is used to guide the user to visit the target location by using the target perception ability.

[0070] Among them, the target perception ability includes at least one of an auditory perception ability, an olfactory perception ability, and a tactile perception ability.

[0071] Specifically, when the user triggers Figure 2After the dialogue control 260 shown, the conversation function can be started to receive the instant voice messages input by the user in real time. Then, the electronic device can convert the instant voice messages into corresponding texts (referred to as instant conversation content), and based on the instant conversation content and the target location, call relevant models to generate a feedback result for the instant conversation content (referred to as feedback conversation content). Then, the electronic device can voice broadcast the feedback conversation content to continue guiding the user to have a conversation in a conversational manner, and guide the user to visit the target location by using the target perception ability through the feedback conversation content, so as to realize an auditory, olfactory and / or tactile tour experience in a conversational manner.

[0072] For example, taking the pillar with the above-mentioned olfactory experience as an example, the voice conversation process after triggering the dialogue control can be exemplified as follows:

[0073] User: What landscapes are there here?

[0074] Answer: There are Landscape 1 suitable for auditory experience, Landscape 2 suitable for olfactory experience and Landscape 3 suitable for tactile experience here.

[0075] Which landscape do you want to visit?

[0076] User: Landscape 2.

[0077] Answer: Take two steps forward and you can touch a red pillar. Get closer and smell it with your nose. You can smell a faint tea fragrance. This is the most expensive wood - Phoebe zhennan...

[0078] In some embodiments, continue to refer to Figure 2 , the tour interaction control further includes a shooting control, so the shooting control 270 can be displayed in the tour interface 200.

[0079] Based on the above embodiments, after S110, the method further includes: responding to a trigger operation on the shooting control, collecting an image corresponding to the current traveling position by using a camera, and voice broadcasting an image recognition result obtained by recognizing the image.

[0080] Specifically, during the process of the user visiting the scenic area, if the user is interested in a landscape other than the preset landscapes in the preset target locations, then the user can trigger the shooting control 270 in the tour interface. The electronic device can call the image shooting function in response to the trigger operation to collect an image in the area in front of the electronic device by using the camera. Then, continue to call the image recognition function in the related technology to recognize the scenery in the collected image to obtain an image recognition result. After that, voice broadcast the image recognition result, so that the user can conveniently know what other landscapes there are around, improve the freedom degree of the visually impaired user visiting the scenic area, and thus further improve the efficiency and convenience of the user obtaining the surrounding environment information.

[0081] As Figure 6 shown, if the user hears others talking about the flowers by the roadside during the tour, or smells the fragrance of the flowers, the shooting control can be triggered. The electronic device can then use image recognition technology and voice broadcast technology to broadcast the scenery scanned by the camera to the user, enabling the user to quickly learn what kind of flowers are around.

[0082] Figure 7 is a flowchart showing another tour interaction method provided by an embodiment of the present disclosure. Based on the above embodiments, the tour interaction method can add relevant steps corresponding to the perception function of the target tour route. On this basis, relevant steps of the interaction process for guiding the user to the target location can be further added. Refer to Figure 7 and the tour interaction method specifically includes the following steps:

[0083] S710. In response to a route selection operation on the tour route identifier corresponding to the target venue, display the target tour route corresponding to the tour route identifier and multiple target locations passed by the target tour route in the route interface.

[0084] Among them, the target venue is the venue to be toured selected by the user, which is an area that can provide functions such as touring, viewing, relaxation, and entertainment for the user. The target venue can be a well-known tourist scenic area certified by relevant institutions, or an uncertified area with tour value. The tour route identifier is the identifying information of the tour route, which can be at least one of, for example, the route name, route abbreviation, and route number. The route selection operation is an interactive operation for selecting the tour route, which can be a triggering operation for an interactive button or operation hot zone, and can be a voice or gesture corresponding to the selected function. The route interface is an interactive interface for displaying the travel path of the tour route and each target location passed by it.

[0085] Specifically, the tour routes provided in the related art mainly include a vision-based map and a voice-based map description. For visually impaired users, even a voice-described map is difficult to understand and remember, making it difficult to form an overall perception of the tour route to be walked. In addition, there are three-dimensional maps of scenic areas specially made for visually impaired people so that they can perceive the entire tour route by touch. However, this method has problems of high cost and poor flexibility due to the difficulty of making three-dimensional maps. Based on this, the embodiments of the present disclosure can provide a tour route perception function that utilizes other perception abilities of the human body, enabling visually impaired users to holistically perceive (such as device vibration, voice prompts, etc.) the tour route through interaction with the electronic device (such as swiping, selecting, etc.), so that they can become familiar in advance with how to proceed overall in the target venue to be toured and have a clear idea.

[0086] During specific implementation, refer toFigure 8 When the user selects a target venue, the electronic device can display an introduction page 810 of the target venue, which shows introduction information in at least one form such as pictures, texts, and videos of the target venue, and displays an "Accessible Guided Tour" control 811 therein. The electronic device, through a screen reader client or a voice assistant, tells the user the position of the "Accessible Guided Tour" control 811 on the screen and guides the user to trigger it. In response to this trigger operation, the electronic device can display a route selection interface 820, in which the available guided tour routes are presented with larger operation hotspots, such as the "Route 1" selection control and the "Route 2" selection control in the route selection interface 820. Also, to enable the user to better understand the differences between different guided tour routes, the introduction information of the routes (such as the total length of the route, the number of scenic spots passed by, the approximate duration required for the tour, etc.) can be displayed in or around the operation hotspots corresponding to the routes. The user can select the guided tour route they want to take as needed. For example, when the user performs a trigger operation on the "Route 1" selection control marked with the guided tour route identifier "Route 1", the electronic device can, in response to this trigger operation, determine that the user has selected "Route 1". Then, the electronic device can display a route interface 900 as shown in Figure 9 Figure 3, and display the complete target guided tour route 910 (an example of a thick black line) corresponding to the selected guided tour route identifier "Route 1" and multiple target locations 920 (examples of gray-filled circles) passed by therein. Similarly, for the convenience of visually impaired users to operate, the target locations 920 also correspond to larger operation hotspots.

[0087] S720. Generate route perception audio based on the target guided tour route and the current touch position, and play the route perception audio; the route perception audio is used to guide the user to move the touch position in the route interface from the current touch position to the next adjacent target location, and guide the user to perform a location selection operation at the next target location.

[0088] Among them, the current touch position is the touch position of the user on the screen at the current moment. The route perception audio is a real-time generated voice audio used to guide the user to perceive the guided tour route and the target locations passed by it, and it can at least include the moving direction and moving distance for guiding the user's touch position, etc. The route perception audio can be generated by a generative model of a certain scale.

[0089] Specifically, the electronic device can guide the user to perform touch interactions on the route interface 900 through voice and determine the current touch position in real time. Then, the electronic device can generate and play route perception audio based on the current touch position, the target guided route, and the display positions of each target location on the screen. In this way, the user can move the touch position in the route interface 900 according to the instructions of the route perception audio (such as moving a small distance upward / specifically 2 cm, etc.) until moving to the next target location (which can be the starting point) adjacent to the current touch position in the target guided route, and perform corresponding location selection operations (such as double-clicking or long-pressing, etc.) according to the instructions of the route perception audio.

[0090] S730. In response to the location selection operation on the next target location, prompt the user that the current touch position has reached the next target location in the form of voice and / or vibration.

[0091] Specifically, after the electronic device detects that the user has performed a location selection operation on the next target location, it prompts the user in the form of voice and / or vibration that the current touch position of their finger has reached the next target location. For example Figure 9 As shown, repeat the execution of S720 - S730 until the user has triggered each target location 920 in the target guided route 910. In this way, the user can perceive the distribution positions of the target locations in the target guided route through touch movement, location selection operations, and other perception capabilities, and establish a comprehensive understanding of the target guided route and target locations more conveniently and quickly.

[0092] S740. If the next target location is the end point of the target guided route, play the route review audio corresponding to the target guided route; the route review audio is used to repeat the target guided route and each target location.

[0093] Among them, the route review audio is pre-generated audio for comprehensively reviewing the target guided route and the target locations it passes through.

[0094] Specifically, when the electronic device detects that the next target location selected by the user is the end point of the target guided route, it indicates that the touch of the target guided route has been completed. At this time, in order to strengthen the user's memory of the route, the route review audio can be screened and played according to the guided route identifier. The route review audio can repeat the target guided route, as well as each target location passed through along the target guided route in terms of the traveling direction and traveling distance.

[0095] S750. If the next target location is the end point of the target guided route, display the start tour control.

[0096] Among them, the start tour control is an interactive control used to trigger the tour function for actually starting a tour of the target venue. For example, it can be a start button, a voice command corresponding to the start tour function, a gesture, etc.

[0097] Specifically, when the electronic device detects that the next target location selected by the user is the end point of the target tour route, it indicates that the target tour route has been completely touched. It is very likely that the user will subsequently conduct an actual tour according to the target tour route. Therefore, as Figure 10 shown, the electronic device can display the tour interface 1000 after the route interface and display the start tour control 1010 therein. At this time, the electronic device can provide a voice prompt for the interactive function of the start tour control 1010 and a voice prompt for the display position of the start tour control 1010 in the interface to guide the user to perform a trigger operation on it.

[0098] S760. In response to the trigger operation on the start tour control, determine the current traveling position, and perform voice navigation based on the current traveling position and the target tour route to guide the user to travel along the target tour route to the target location adjacent to the current traveling position.

[0099] Specifically, continue to refer to Figure 10 . When the user performs a trigger operation on the start tour control 1010, the electronic device can determine the user's current traveling position in real time and perform real-time voice navigation based on the current traveling position and the target tour route. During this process, the electronic device can display relevant information about the voice navigation (such as the icon of the voice assistant and the voice navigation content, etc.) in the tour interface 1000. The user can then continue to travel according to the voice navigation until reaching the target location in the target tour route that is closest to the current traveling position.

[0100] It should be noted that continue to refer to Figure 10 . During the voice navigation process, the electronic device can also display the shooting control 1020 in the tour interface 1000. In this way, during the traveling process, the user can freely tour the surrounding scenery by triggering the shooting control 1020.

[0101] S770. In response to the current traveling position reaching the target location in the target tour route, display the tour interaction control in the tour interface.

[0102] S780. In response to the trigger operation on the tour interaction control, determine the target tour audio based on the triggered tour interaction control and the target location.

[0103] S790. Play the target tour audio; the target tour audio is used to guide the user to tour the target location by using the perception ability corresponding to the tour interaction control.

[0104] The tour interaction method provided by each of the above embodiments of the present disclosure can respond to a route selection operation on a navigation route identifier corresponding to a target venue, display a target navigation route corresponding to the navigation route identifier and a plurality of target locations passed by the target navigation route in a route interface; generate a route perception audio based on the target navigation route and the current touch position, and play the route perception audio to guide the user to move the touch position in the route interface from the current touch position to the next adjacent target location, and guide the user to perform a location selection operation at the next target location; respond to the location selection operation on the next target location, and prompt the user that the current touch position has reached the next target location in a voice form and / or a vibration form; thereby providing a navigation route perception function that utilizes other perception capabilities of the human body (such as tactile perception ability, auditory perception ability, vibration perception ability, etc.), so that visually impaired users can overall perceive the overall direction of the target navigation route and the distribution positions of the target locations in the target navigation route through interactions with the electronic device (such as touch movement, location selection operation, etc.), and further help visually impaired users to more conveniently and quickly familiarize themselves with the target navigation route and each target location to be toured, establish an overall understanding of the tour process, and further enhance the tour experience. In addition, when the next target location is the end point of the target navigation route, the route review audio corresponding to the target navigation route can be played to further strengthen the user's memory of the route.

[0105] The following are embodiments of a tour interaction device provided by embodiments of the present invention. This device and the tour interaction methods of the above embodiments belong to the same inventive concept. For details not described in detail in the embodiments of the tour interaction device, reference can be made to the embodiments of the above tour interaction methods.

[0106] Figure 11 FIG. shows a schematic structural diagram of a tour interaction device provided by an embodiment of the present disclosure. As Figure 11 shown, the tour interaction device 1100 may include:

[0107] A navigation interaction control display module 1110, configured to display a navigation interaction control in a navigation interface in response to the current traveling position reaching a target location in a target navigation route; wherein, the navigation interaction control includes at least one of an auditory control, an olfactory control, and a tactile control;

[0108] A target navigation audio determination module 1120, configured to determine a target navigation audio based on the triggered navigation interaction control and the target location in response to a trigger operation on the navigation interaction control;

[0109] A target navigation audio playback module 1130, configured to play the target navigation audio; the target navigation audio is used to guide the user to tour the target location by using the perception ability corresponding to the navigation interaction control.

[0110] The tour interaction device provided in each of the above embodiments of the present disclosure can display a tour interaction control in the tour guide interface in response to the user's current travel position reaching a target location in the target tour route; the tour interaction control includes at least one of an auditory control, an olfactory control, and a tactile control; in response to a trigger operation acting on the tour interaction control, based on the triggered tour interaction control and the target location, determine a target tour audio; play the target tour audio to guide the user to tour the target location by using the perception ability corresponding to the tour interaction control; realizing an interaction function that provides the user with other perception abilities in addition to the visual perception ability, enabling the user to mobilize other perception abilities (such as hearing, smell, touch, etc.) through these interaction functions to tour the scenery and landscapes at the target location, thereby improving the efficiency of visually impaired people in obtaining surrounding information, greatly enhancing their tour and sightseeing experience, and further improving the travel interest and physical and mental health of visually impaired people.

[0111] In some embodiments, the tour interaction control includes at least one of an auditory control, an olfactory control, and a tactile control.

[0112] In some embodiments, the target tour audio determination module 1120 is specifically configured to implement the function of determining the target tour audio based on the triggered tour interaction control and the target location in response to a trigger operation acting on the tour interaction control through at least one of the following:

[0113] If the tour interaction control includes an auditory control, in response to a trigger operation acting on the auditory control, screen a candidate tour audio that adapts to the auditory control and the target location from multiple candidate tour audios as the target tour audio;

[0114] If the tour interaction control includes an olfactory control, in response to a trigger operation acting on the olfactory control, screen a candidate tour audio that adapts to the olfactory control and the target location from multiple candidate tour audios as the target tour audio;

[0115] If the tour interaction control includes a tactile control, in response to a trigger operation acting on the tactile control, screen a candidate tour audio that adapts to the tactile control and the target location from multiple candidate tour audios as the target tour audio.

[0116] In some embodiments, the tour interaction control further includes a dialogue control;

[0117] Correspondingly, the tour interaction device 1100 further includes a session module for:

[0118] After displaying the tour interaction control in the tour guide interface in response to the current travel position reaching the target location in the target route, in response to a trigger operation acting on the dialogue control, receive an instant voice message;

[0119] Generate feedback session content based on the instant conversation content corresponding to the instant voice message and the target location, and voice broadcast the feedback session content; the feedback session content is used to guide the user to visit the target location by using the target perception ability, where the target perception ability includes at least one of the auditory perception ability, the olfactory perception ability, and the tactile perception ability.

[0120] In some embodiments, the tour interaction control also includes a shooting control;

[0121] Correspondingly, the tour interaction device 1100 further includes an identification result broadcast module for:

[0122] After responding to the current travel position reaching the target location in the target route and displaying the tour interaction control in the tour guide interface, in response to the trigger operation on the shooting control, collect the image corresponding to the current travel position by using the camera, and voice broadcast the image recognition result obtained by recognizing the image.

[0123] In some embodiments, the tour interaction device 1100 further includes:

[0124] A target tour route display module for responding to the route selection operation on the tour route identifier corresponding to the target venue and displaying the target tour route corresponding to the tour route identifier and the multiple target locations passed by the target tour route in the route interface;

[0125] A route perception audio playback module for generating route perception audio based on the target tour route and the current touch position, and playing the route perception audio; the route perception audio is used to guide the user to move the touch position in the route interface from the current touch position to the adjacent next target location, and guide the user to perform a location selection operation at the next target location;

[0126] A prompt module for responding to the location selection operation on the next target location and prompting the user in a voice form and / or a vibration form that the current touch position has reached the next target location.

[0127] In some embodiments, the tour interaction device 1100 further includes a route review module for:

[0128] After responding to the location selection operation on the next target location and prompting the user in a voice form and / or a vibration form that the current touch position has reached the next target location, if the next target location is the end point in the target tour route, play the route review audio corresponding to the target tour route; the route review audio is used to review the target tour route and each target location.

[0129] In some embodiments, the tour interaction device 1100 further includes a navigation module for:

[0130] In response to a location selection operation for the next target location, after prompting the user in voice form and / or vibration form that the current touch location has reached the next target location, if the next target location is the end point in the target navigation route, a start navigation control is displayed;

[0131] In response to a trigger operation on the start navigation control, determine the current traveling location, and perform voice navigation based on the current traveling location and the target navigation route to guide the user to travel to the target location adjacent to the current traveling location along the target navigation route.

[0132] The tour interaction device provided by the embodiments of the present invention can execute the tour interaction method provided by any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution of the method.

[0133] It should be noted that in the embodiments of the above tour interaction device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of the functional units are only for the convenience of mutual distinction and do not limit the protection scope of the present disclosure.

[0134] The embodiments of the present disclosure also provide an electronic device, which may include a processor and a memory, and the memory may be used to store executable instructions. Among them, the processor may be used to read the executable instructions from the memory and execute the executable instructions to implement the tour interaction method in the above embodiments.

[0135] Figure 12 A schematic structural diagram of an electronic device provided by the embodiments of the present disclosure is shown.

[0136] As Figure 12 shown, the electronic device 1200 may include a processing device 1201 (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1202 or a program loaded from a storage device 1208 into a random access memory (RAM) 1203. In the RAM 1203, various programs and data required for the operation of the electronic device 1200 are also stored. The processing device 1201, the ROM 1202, and the RAM 1203 are connected to each other through a bus 1204. An input / output interface (I / O interface) 1205 is also connected to the bus 1204.

[0137] Typically, the following devices can be connected to the I / O interface 1205: input devices 1206 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 1207 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1208 including, for example, magnetic tapes, hard disks, etc.; and a communication device 1209. The communication device 1209 can allow the electronic device 1200 to communicate with other devices wirelessly or wiredly to exchange data.

[0138] It should be noted that Figure 12 the illustrated electronic device 1200 is merely an example and should not impose any limitation on the functions and the scope of use of the embodiments of the present disclosure. That is, although Figure 12 the electronic device 1200 with various devices is illustrated, it should be understood that it is not required to implement or include all the illustrated devices. Instead, more or fewer devices can be implemented or included.

[0139] In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments of the present disclosure include a computer program product that includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes program codes for performing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from a network through the communication device 1209, or installed from the storage device 1208, or installed from the ROM 1202. When the computer program is executed by the processing device 1201, the above functions defined in the tour interaction method of any embodiment of the present disclosure are executed.

[0140] The embodiments of the present disclosure also provide a computer-readable storage medium that stores a computer program, and when the computer program is executed by a processor, the processor is caused to implement the tour interaction method in any embodiment of the present disclosure.

[0141] It should be noted that the computer-readable medium described above can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0142] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol such as HTTP, and can be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0143] The above computer-readable medium can be included in the above electronic device; or it can exist separately without being assembled into the electronic device.

[0144] The above computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is caused to perform the steps of the browsing interaction method described in any embodiment of the present disclosure.

[0145] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The foregoing programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0146] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of devices, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions noted in the blocks may occur in a different order than noted in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0147] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), system on a chip (SOC), complex programmable logic devices (CPLD), and the like.

[0148] In the context of the present disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0149] The above description is only a preferred embodiment of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure concept. For example, the technical solutions formed by mutually replacing the above features with the technical features (but not limited to) having similar functions disclosed in the present disclosure.

[0150] Moreover, although the operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments may also be implemented combinatorially in a single embodiment. Conversely, the various features described in the context of a single embodiment may also be implemented separately or in any suitable sub-combination in multiple embodiments.

[0151] Although the subject matter has been described in language specific to structural features and / or methodological acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A tour interaction method, characterized in that: include: In response to the current travel position reaching the target location in the target guided route, displaying a guided tour interactive control in the guided tour interface; wherein the guided tour interactive control includes at least one of an auditory control, an olfactory control, and a tactile control; In response to a triggering operation on the navigation interactive control, determining a target navigation audio based on the triggered navigation interactive control and the target location; The target tour audio is played; the target tour audio is used to guide the user to visit the target location using the perception ability corresponding to the tour interactive control.

2. The method according to claim 1, characterized in that In response to the triggering operation on the navigation interactive control, determining the target navigation audio based on the triggered navigation interactive control and the target location includes at least one of the following: If the tour guide interactive control includes the auditory control, in response to a trigger operation on the auditory control, the candidate tour guide audio that is adapted to the auditory control and the target location is selected from a plurality of candidate tour guide audios as the target tour guide audio; If the tour guide interactive control includes the olfactory control, in response to a trigger operation acting on the olfactory control, the candidate tour guide audio that is adapted to the olfactory control and the target location is selected from a plurality of candidate tour guide audios as the target tour guide audio; If the tour guide interactive control includes the tactile control, then in response to a trigger operation acting on the tactile control, the candidate tour guide audio that is adapted to the tactile control and the target location is screened from a plurality of candidate tour guide audios as the target tour guide audio.

3. The method according to claim 1, characterized in that The navigation interaction control also includes a dialogue control; After displaying the navigation interactive control in the navigation interface in response to the current travel position reaching the target location in the target route, the method further includes: Receiving an instant voice message in response to a triggering operation acting on the dialog control; Based on the instant conversation content corresponding to the instant voice message and the target location, feedback conversation content is generated and voice broadcasted; the feedback conversation content is used to guide the user to visit the target location using target perception ability, and the target perception ability includes at least one of auditory perception ability, olfactory perception ability and tactile perception ability.

4. The method according to claim 1, characterized in that: The navigation interactive control also includes a shooting control; After displaying the navigation interactive control in the navigation interface in response to the current travel position reaching the target location in the target route, the method further includes: In response to a trigger operation on the shooting control, an image corresponding to the current traveling position is collected by using a camera, and an image recognition result obtained by recognizing the image is voice broadcasted.

5. The method according to claim 1, characterized in that The method further comprises: In response to a route selection operation on a guide route identifier corresponding to a target location, displaying the target guide route corresponding to the guide route identifier and a plurality of target locations along the target guide route in a route interface; Generate route-aware audio based on the target navigation route and the current touch position, and play the route-aware audio; the route-aware audio is used to guide the user to move the touch position in the route interface from the current touch position to the next adjacent target location, and guide the user to perform a location selection operation at the next target location; In response to the location selection operation acting on the next target location, the user is prompted in a voice form and / or a vibration form that the current touch position has reached the next target location.

6. The method according to claim 5, characterized in that After the location selection operation acting on the next target location is responded to and the user is prompted in a voice form and / or a vibration form that the current touch position has reached the next target location, the method further includes: If the next target location is the end point of the target guided route, the route review audio corresponding to the target guided route is played; the route review audio is used to repeat the target guided route and each of the target locations.

7. The method according to claim 5, characterized in that After the location selection operation acting on the next target location is responded to and the user is prompted in a voice form and / or a vibration form that the current touch position has reached the next target location, the method further includes: If the next target location is the end point of the target navigation route, displaying a start navigation control; In response to a trigger operation acting on the start navigation control, the current travel position is determined, and voice navigation is performed based on the current travel position and the target navigation route to guide the user to travel to the target location adjacent to the current travel position along the target navigation route.

8. A tour interaction device, characterized in that: include: A navigation interactive control display module, used for displaying a navigation interactive control in a navigation interface in response to the current travel position reaching a target location in a target navigation route; wherein the navigation interactive control includes at least one of an auditory control, an olfactory control, and a tactile control; A target navigation audio determination module, configured to respond to a triggering operation on the navigation interactive control and determine a target navigation audio based on the triggered navigation interactive control and the target location; The target guide audio playback module is used to play the target guide audio; the target guide audio is used to guide the user to visit the target location using the perception ability corresponding to the guide interactive control.

9. An electronic device, characterized in that: include: processor; A memory for storing executable instructions; The processor is used to read the executable instructions from the memory and execute the executable instructions to implement the tour interaction method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the tour interaction method according to any one of claims 1 to 7.

11. A computer program product, characterized in that The computer program product is used to implement the tour interaction method described in any one of claims 1 to 7.

Images