Voice navigation method, electronic device and computer program product

Abstract

The disclosed embodiment discloses a voice navigation method, electronic device and computer program product, the method comprising: obtaining a navigation route and voice navigation content; the voice navigation content comprises voice content and voice broadcasting timing; during the driving process of the navigated object based on the navigation route, the voice content is broadcasted based on the voice broadcasting timing; after the voice content is broadcasted, the voice content of the next voice broadcasting timing is dynamically adjusted based on the behavioral feedback information of the navigated object. This technical solution can avoid the problem that the user may easily deviate when the user is not paying attention while driving by using the existing fixed voice broadcasting timing and fixed voice content, and can reduce the user's yaw rate and improve the user's navigation experience.

Description

Technical Field

[0001] The present disclosure relates to the field of navigation technology, and in particular to a voice navigation method, electronic equipment, and computer program product. Background Art

[0002] With the development of Internet technology, people's travel is increasingly dependent on location-based service systems. Location-based services include navigation, route planning, map rendering, etc. Navigation services are used to guide users during vehicle driving, such as voice broadcasting of navigation content to prompt users to perform corresponding navigation actions.

[0003] The inventors of the present disclosure have discovered that in the existing voice navigation technology, after the navigation route is planned, the voice content and the timing of the voice broadcast are relatively fixed, and whether the user has received the key information in the voice content is not taken into consideration, which makes it easy for the vehicle to deviate. Especially in scenarios such as highway entrances and exits, deviation can lead to more serious consequences, such as taking a long detour and taking a long time to return to the navigation route.

[0004] Therefore, in order to improve the navigation experience, it is necessary to propose a solution to the above technical problem, so as to reduce the yaw rate of the navigated object. Summary of the invention

[0005] Embodiments of the present disclosure provide a voice navigation method, an electronic device, and a computer program product.

[0006] In a first aspect, an embodiment of the present disclosure provides a voice navigation method, which includes:

[0007] Obtaining a navigation route and voice navigation content; the voice navigation content includes voice content and voice broadcast timing;

[0008] During the driving process of the guided object based on the navigation route, broadcasting the voice content based on the voice broadcasting timing;

[0009] After the voice content is broadcast, the voice content of the next voice broadcasting opportunity is dynamically adjusted based on the behavior feedback information of the navigated object.

[0010] Further, after the voice content is broadcasted, the voice content of the next voice broadcasting opportunity is dynamically adjusted based on the behavior feedback information of the navigated object, including:

[0011] After the voice content is broadcasted, detecting behavior feedback information of the navigated object;

[0012] Determining whether the navigated object has noticed key information in the speech content based on the behavior feedback information;

[0013] After determining that the navigated object has not noticed the voice content, the voice content including the key information is selected for broadcasting at the next voice broadcasting opportunity.

[0014] Further, judging whether the navigated object has noticed the key information in the voice content based on the behavior feedback information includes:

[0015] After the voice content is broadcasted, it is determined whether the navigated object has noticed the key information in the voice content based on the matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content.

[0016] Further, determining whether the navigated object has noticed key information in the voice content based on the matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content includes:

[0017] When the voice content involves a navigation action of guiding the navigated object to turn or travel at a complex intersection, it is determined whether the navigated object has noticed key information in the voice content based on the travel speed of the navigated object.

[0018] Further, when the voice content involves a navigation action of guiding the navigated object to turn or drive at a complex intersection, determining whether the navigated object has noticed key information in the voice content based on the driving speed of the navigated object includes:

[0019] When the voice content involves guiding the guided object to turn, and the driving speed of the guided object does not decrease, it is determined that the guided object does not notice the key information in the voice content.

[0020] Further, when the voice content involves a navigation action of guiding the navigated object to turn or drive at a complex intersection, determining whether the navigated object has noticed key information in the voice content based on the driving speed of the navigated object includes:

[0021] When the voice content involves a navigation action of guiding the guided object to travel at a complex intersection, if the speed reduction amplitude of the guided object is greater than or equal to a preset speed value, it is determined that the guided object has noticed the voice navigation content.

[0022] Further, determining whether the navigated object has noticed key information in the voice content based on the matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content includes:

[0023] When the voice content involves a navigation action of guiding the navigated object to travel in a target lane, it is determined whether the navigated object has switched to the target lane based on the positioning information of the navigated object, and it is determined whether the navigated object has noticed the key information in the voice content based on the judgment result.

[0024] Further, after the voice content is broadcasted, the voice content of the next voice broadcasting opportunity is dynamically adjusted based on the behavior feedback information of the navigated object, including:

[0025] After the voice content is broadcasted, a next voice broadcasting opportunity and a next voice content corresponding to the next voice broadcasting opportunity are added, and the added next voice content at least includes key information in the voice content.

[0026] In a second aspect, an embodiment of the present invention provides a voice navigation device, which includes:

[0027] An acquisition module is configured to acquire a navigation route and voice navigation content; the voice navigation content includes voice content and voice broadcast timing;

[0028] A broadcasting module, configured to broadcast the voice content based on the voice broadcasting timing when the guided object is traveling along the navigation route;

[0029] The adjustment module is configured to dynamically adjust the voice content of the next voice broadcasting opportunity based on the behavior feedback information of the navigated object after the voice content is broadcasted.

[0030] The functions can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the functions.

[0031] In one possible design, the structure of the above-mentioned device includes a memory and a processor, the memory is used to store one or more computer instructions that support the above-mentioned device to execute the above-mentioned corresponding method, and the processor is configured to execute the computer instructions stored in the memory. The above-mentioned device may also include a communication interface for the above-mentioned device to communicate with other devices or communication networks.

[0032] In a third aspect, an embodiment of the present disclosure provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the method described in any one of the above aspects.

[0033] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium for storing computer instructions used by any of the above-mentioned devices, and when the computer instructions are executed by a processor, they are used to implement the method described in any of the above-mentioned aspects.

[0034] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, which includes computer instructions, and when the computer instructions are executed by a processor, they are used to implement the method described in any of the above aspects.

[0035] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0036] In the voice navigation of the disclosed embodiment, after the voice content corresponding to a voice broadcasting time is broadcasted, the behavior feedback information of the navigated object is detected in real time, and the voice content corresponding to the next voice broadcasting time is dynamically adjusted based on the behavior feedback information. Through the disclosed embodiment, the problem that the user may easily deviate when the user is not paying attention during driving and the existing fixed voice broadcasting time and fixed voice content are used can be avoided, and the user's yaw rate can be reduced, thereby improving the user's navigation experience.

[0037] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Other features, objectives and advantages of the present disclosure will become more apparent through the following detailed description of non-limiting embodiments in conjunction with the accompanying drawings. In the accompanying drawings:

[0039] Figure 1 A flow chart showing a voice navigation method according to an embodiment of the present disclosure;

[0040] Figure 2 A schematic diagram of voice navigation in an application scenario where a user is driving near an intersection and needs to turn according to an embodiment of the present disclosure is shown;

[0041] Figure 3 A schematic diagram of voice navigation in an application scenario where a user is driving near a complex intersection according to an embodiment of the present disclosure is shown;

[0042] Figure 4 A schematic diagram of voice navigation in an application scenario where a user needs to change lanes while driving according to an embodiment of the present disclosure is shown;

[0043] Figure 5 A schematic diagram of an application scenario of voice navigation according to an embodiment of the present disclosure is shown;

[0044] Figure 6A structural block diagram of a voice navigation device according to an embodiment of the present disclosure is shown;

[0045] Figure 7 It is a structural schematic diagram of an electronic device suitable for implementing a voice navigation method according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0046] Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. In addition, for the sake of clarity, parts not related to the description of the exemplary embodiments are omitted in the accompanying drawings.

[0047] In the present disclosure, it should be understood that terms such as "include" or "have" are intended to indicate the presence of features, numbers, steps, behaviors, components, parts, or a combination thereof disclosed in the specification, and do not exclude the possibility that one or more other features, numbers, steps, behaviors, components, parts, or a combination thereof exist or are added.

[0048] It should also be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0049] The details of the embodiments of the present disclosure are described in detail below through specific examples.

[0050] Figure 1 FIG. 1 is a flow chart showing a voice navigation method according to an embodiment of the present disclosure. Figure 1 As shown, the voice navigation method includes the following steps:

[0051] In step S101, a navigation route and voice navigation content are obtained; the voice navigation content includes voice content and voice broadcast timing;

[0052] In step S102, while the guided object is traveling along the navigation route, the voice content is broadcast based on the voice broadcast timing;

[0053] In step S103, after the voice content is broadcast, the voice content of the next voice broadcasting opportunity is dynamically adjusted based on the behavior feedback information of the navigated object.

[0054] In this embodiment, the voice navigation method is executed in the navigation terminal. Voice navigation can be understood as voice-controlled voice navigation, which uses representative intelligent voice technologies such as voice recognition and voice encoding and decoding, and is usually used in vehicles, user terminals, etc. Voice content can be understood as, in the navigation process of the navigated object, reminding the navigated object of the direction and lane of travel and other information through voice interaction, that is, the voice content mainly involves guiding the user to perform navigation actions that need to be performed at the upcoming moment; the voice broadcasting time can be a fixed GPS location point. After the navigation route is planned, the voice content and the voice broadcasting time are basically fixed. The navigation terminal can match the voice broadcasting time based on the current positioning information of the navigated object, and broadcast the voice content corresponding to the voice broadcasting time by voice when matching. It can be understood that each voice broadcasting time can correspond to one or more candidate broadcasting contents, and the navigation terminal can select one or more voice contents for broadcasting randomly or according to preset rules.

[0055] The navigated object may include a person, and the navigation terminal may include but is not limited to a mobile phone, iPad, computer, smart watch, vehicle, robot, etc. The navigated object sends a navigation request from the starting point to the end point to the navigation server through the navigation terminal. The navigation server plans the navigation route based on the starting point and the end point and sends it to the navigated object together with the navigation content. In voice navigation, the navigation content may include but is not limited to the voice content and the voice broadcasting time; the voice content and the voice broadcasting time are set correspondingly.

[0056] When the navigated object is traveling along the navigation route, the navigation terminal detects the current location information of the navigated object in real time, matches the location information with the voice broadcast timing in the voice navigation content, and broadcasts the corresponding voice content after the match is successful.

[0057] In the embodiment of the present disclosure, each time after the voice content is reported, the navigation terminal also detects the behavior feedback information of the navigated object. The behavior feedback information can be understood as the information fed back by the driving behavior of the navigated object, including but not limited to the speed change information, driving direction change information, positioning information, etc. of the navigated object. The behavior feedback information of the navigated object can be detected by the vehicle driven by the navigation object or the handheld terminal carried by the navigation object. Through the behavior feedback information, it can be determined whether the navigated object has performed a corresponding behavior based on the currently broadcast voice content. If the corresponding behavior is performed, it can be considered that the navigated object has received the voice content, otherwise it can be considered that the navigated object has not received the voice content. In the embodiment of the present disclosure, whether the navigated object receives the voice content can be understood as whether the user has noticed the current voice content and performed a corresponding behavior based on the voice content.

[0058] In some embodiments, the user may not be able to concentrate enough while driving and cannot extract effective information from the voice content broadcast by the navigation object, which may easily lead to deviation.

[0059] Therefore, the disclosed embodiment can dynamically adjust the voice content of the next voice broadcast opportunity based on the behavioral feedback information of the navigated object. The adjusted voice content can emphasize key information ignored by the user, so as to reduce the user's yaw rate by repeatedly reminding the user of the key information.

[0060] The following example illustrates: if at the first voice broadcast timing, after the corresponding voice content is played, the navigated object does not exhibit corresponding driving behavior based on the voice content, such as slowing down, changing direction, etc.; at this time, the voice content of the next voice broadcast timing can be adjusted in the navigation, such as selecting candidate content containing key information from multiple voice contents corresponding to the next voice broadcast timing in the predetermined voice navigation content and repeatedly broadcasting it, without broadcasting other candidate content.

[0061] In the voice navigation of the disclosed embodiment, after the voice content corresponding to a voice broadcasting time is broadcasted, the behavior feedback information of the navigated object is detected in real time, and the voice content corresponding to the next voice broadcasting time is dynamically adjusted based on the behavior feedback information. Through the disclosed embodiment, the problem that the user may easily deviate when the user is not paying attention during driving and the existing fixed voice broadcasting time and fixed voice content are used can be avoided, and the user's yaw rate can be reduced, thereby improving the user's navigation experience.

[0062] In an optional implementation of this embodiment, step S103, i.e., after the voice content is broadcasted, the voice content of the next voice broadcasting opportunity is dynamically adjusted based on the behavior feedback information of the navigated object, further includes the following steps:

[0063] After the voice content is broadcasted, detecting behavior feedback information of the navigated object;

[0064] Determining whether the navigated object has noticed key information in the speech content based on the behavior feedback information;

[0065] After determining that the navigated object has not noticed the voice content, the voice content including the key information is selected for broadcasting at the next voice broadcasting opportunity.

[0066] In this optional implementation method, in a voice navigation scenario, after the navigation server plans the navigation route, it sends the planned navigation route and the corresponding voice navigation content to the navigation terminal of the navigated object. The navigation terminal provides voice navigation services to the navigated object based on the real-time positioning information of the navigated object, the navigation route and the voice navigation content. The navigation terminal matches the real-time positioning information of the navigated object with the location points in the navigation route, and when matching the location points where the voice content is set, voice broadcasts the corresponding voice content.

[0067] The disclosed embodiments take into account that after the voice content is broadcast, the navigated object may not actually receive the voice content due to reasons such as lack of concentration. Therefore, the behavior feedback information of the navigated object can be detected after the voice content is broadcast. The behavior feedback information may include but is not limited to information such as changes in speed and driving direction of the navigated object.

[0068] After determining the behavioral feedback information of the navigated object, it can be determined based on the behavioral feedback information whether the navigated object has noticed the key information in the voice content, such as the voice content prompting the user to exit the highway at the next highway intersection and prompting the user to change lanes in advance; however, the detected behavioral feedback information shows that the navigated object did not make any obvious behavioral changes after the voice content was broadcast, such as not slowing down or changing direction, etc., in this case it can be determined that the navigated object did not notice the key information in the voice content; on the contrary, if the detected behavioral feedback information shows that the navigated object made corresponding behavioral changes after the voice content was broadcast, such as slowing down or changing direction, in this case it can be determined that the navigated object noticed the key information in the voice content.

[0069] After determining that the navigated object has not noticed the voice content, the voice content that only includes the key information or can emphasize the key information can be selected for broadcast at the next voice broadcast time to remind the navigated object to pay attention to the key information. After determining that the navigated object has noticed the voice content, the voice content to be broadcast can be selected in a conventional manner at the next voice broadcast time, and it is not necessary to select the voice content that only includes the key information or can emphasize the key information. It can even select the voice content that does not include the key information. The specific method can be determined according to the set voice content selection method, which is not specifically limited here.

[0070] In an optional implementation of this embodiment, the step of judging whether the navigated object has noticed the key information in the voice content based on the behavior feedback information further includes the following steps:

[0071] After the voice content is broadcasted, it is determined whether the navigated object has noticed the key information in the voice content based on the matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content.

[0072] In this optional implementation, as described above, the navigation server pushes the navigation route and voice navigation content to the navigation terminal, and the voice navigation content includes the voice content and the voice broadcasting timing of playing the voice content.

[0073] After playing the voice content at the voice broadcast opportunity, the embodiment of the present disclosure determines whether to adjust the voice content at the next voice broadcast opportunity based on the behavior feedback information of the navigated object.

[0074] In this embodiment, the navigated object can determine whether the navigated object has noticed the key information in the voice content based on the matching relationship between the behavioral feedback information of the navigated object and the navigation action involved in the voice content. The behavioral feedback information can be measured from at least two aspects, such as the change in speed and the change in driving direction of the navigated object, and the navigation action is the action that the navigated object needs to perform according to the navigation route, which is usually related to the driving direction, and because the navigated object will coordinate with the corresponding driving speed when performing the navigation action, it is possible to establish a mapping relationship between the speed change, the driving direction change, etc. and the navigation action in advance. During the navigation process, it is determined whether the navigated object has noticed the key information in the voice content by matching the speed change, driving change, etc. in the behavioral feedback information with the navigation action.

[0075] In an optional implementation of this embodiment, the step of determining whether the navigated object has noticed the key information in the voice content based on the matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content further includes the following steps:

[0076] When the voice content involves a navigation action of guiding the navigated object to turn or travel at a complex intersection, it is determined whether the navigated object has noticed key information in the voice content based on the travel speed of the navigated object.

[0077] In this optional implementation, the voice content corresponding to different voice broadcasting times may be different, and the navigation actions involved in different voice contents may also be different. A mapping relationship between different navigation actions and behavioral feedback information of the navigated object can be set in advance, as well as a judgment conclusion on whether the navigated object has noticed the voice content involving the navigation action under this mapping relationship.

[0078] In one implementation mode, before a simple intersection and / or a complex intersection on the navigation route, the navigation server will set a corresponding voice broadcast timing and voice content in the voice navigation content. The voice content may involve other navigation actions to guide the navigated object to turn or drive at a complex intersection (such as a roundabout, a three-way intersection, etc.). When the navigated object notices the voice content, its driving speed will usually change, such as slowing down to prepare for a turn. Therefore, it can be determined whether the navigated object has noticed the key information in the voice content based on the speed change in the behavioral feedback information of the navigated object.

[0079] In an optional implementation of this embodiment, when the voice content involves a navigation action of guiding the navigated object to turn or drive at a complex intersection, the step of determining whether the navigated object has noticed the key information in the voice content based on the driving speed of the navigated object further includes the following steps:

[0080] When the voice content involves guiding the guided object to turn, and the driving speed of the guided object does not decrease, it is determined that the guided object does not notice the key information in the voice content.

[0081] In this optional implementation, as described above, before a simple intersection and / or a complex intersection of the navigation route, the navigation server will include a corresponding voice broadcast timing in the voice navigation content. Based on the voice content, the voice content may involve other navigation actions that guide the navigated object to turn or drive at a complex intersection (such as a roundabout, a three-way intersection, etc.), and when the navigated object notices the voice content, its driving speed will usually change, such as slowing down to prepare for a turn. That is to say, at a turn or a complex intersection, the normal driving feedback information of the navigated object at least includes speed reduction, and after the voice content is broadcast, if the navigated object does not slow down, it can be determined that the navigated object has not noticed the key information in the voice content, and it is necessary to emphasize this key information again at the next voice broadcast timing.

[0082] Figure 2 FIG. 1 shows a schematic diagram of voice navigation in an application scenario where a user is driving near an intersection and needs to turn according to an embodiment of the present disclosure. Figure 2 As shown, when the user needs to turn near an intersection, the navigation terminal broadcasts the voice content of the turn ahead, and the user's driving behavior obtained by the navigation terminal is: the user did not slow down (but accelerated), then the navigation terminal can determine that the user's attention may not be focused enough, and did not notice the voice content that guided the user to turn before. Therefore, at the next voice broadcast opportunity, when selecting voice content, choose to continue to emphasize the voice content of turning right, and abandon other candidate voice content, thereby strengthening the reminder effect on the user.

[0083] In an optional implementation of this embodiment, when the voice content involves a navigation action of guiding the navigated object to turn or drive at a complex intersection, the step of determining whether the navigated object has noticed the key information in the voice content based on the driving speed of the navigated object further includes the following steps:

[0084] When the voice content involves a navigation action of guiding the guided object to travel at a complex intersection, if the speed reduction amplitude of the guided object is greater than or equal to a preset speed value, it is determined that the guided object has noticed the voice navigation content.

[0085] In this optional implementation, when the navigated object is near a complex intersection such as a roundabout or a three-way intersection, if the road shape of the intersection is unfamiliar and the key content is not noticed after the voice content is broadcast, the more likely behavior is to slow down or stop the car to a large extent. At this time, it can be determined that the navigated object is hesitating because it is not clear which direction to go. Therefore, based on this situation, when the voice content involves a navigation action to guide the navigated object to travel at a complex intersection, the embodiment of the present disclosure can be based on whether the speed reduction of the navigated object is greater than or equal to the preset speed value to determine whether the navigated object has noticed the key information in the voice content. If the speed reduction is greater than or equal to the preset speed value, it can be considered that the navigated object has noticed the key information in the voice content. At this time, the voice content corresponding to the next voice broadcast opportunity can be dynamically adjusted so as to emphasize the key information in the next voice content and guide the navigated object to correctly follow the navigation route at the complex intersection.

[0086] Figure 3 FIG. 1 shows a schematic diagram of voice navigation in an application scenario where a user is driving near a complex intersection according to an embodiment of the present disclosure. Figure 3 As shown, when the user is driving near a complex intersection (such as a three-way intersection), the navigation terminal broadcasts the voice content of "There is a three-way intersection ahead, please take the middle lane". However, the user's driving behavior obtained by the navigation terminal is: the user slows down or stops. At this time, the navigation terminal can determine that the user is hesitating and is not sure which direction to go. Therefore, at the next voice broadcast opportunity, when selecting the voice content, the voice content emphasizing that the user takes the middle fork can be added.

[0087] In an optional implementation of this embodiment, the step of determining whether the navigated object has noticed the key information in the voice content based on the matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content further includes the following steps:

[0088] When the voice content involves a navigation action of guiding the navigated object to travel in a target lane, it is determined whether the navigated object has switched to the target lane based on the positioning information of the navigated object, and it is determined whether the navigated object has noticed the key information in the voice content based on the judgment result.

[0089] In this optional implementation, when the voice content involves a navigation action of guiding the navigated object to drive in the target lane, for example, when the navigated object is driving on a highway and is about to exit the highway exit, the voice content will prompt the navigated object to merge to the rightmost lane in advance so that it can exit smoothly when approaching the highway exit. If the positioning information of the navigated object indicates that it is still driving in the leftmost lane and has not slowed down or made any changes in direction (i.e., has not merged), it can be determined that the navigated object has not noticed the previous voice content, so the voice content corresponding to the next voice broadcast timing can be dynamically adjusted to re-emphasize the key information in the voice content that guides the navigated object to merge in advance.

[0090] Figure 4 FIG. 1 shows a schematic diagram of voice navigation in an application scenario where a user needs to change lanes while driving according to an embodiment of the present disclosure. Figure 4 As shown, the user is driving in the left lane. At time t1, the navigation terminal broadcasts the voice content of driving in the right lane based on the voice broadcast timing in the semantic navigation content. At time t2, based on the positioning information, the navigation terminal determines that the user is still in the left lane. At this time, since the intersection is approaching, at the next voice broadcast timing, when selecting the voice content, you can choose to continue to emphasize the voice content of switching to the right lane for broadcast.

[0091] In an optional implementation of this embodiment, after the voice content is broadcast, the step of dynamically adjusting the voice content of the next voice broadcasting opportunity based on the behavior feedback information of the navigated object further includes the following steps:

[0092] After the voice content is broadcasted, a next voice broadcasting opportunity and a next voice content corresponding to the next voice broadcasting opportunity are added, and the added next voice content includes at least one key information in the voice content.

[0093] In this optional implementation, after broadcasting a voice content, this embodiment also obtains behavioral feedback information of the navigated object, determines whether the navigated object has noticed the voice content based on the behavioral feedback information, and dynamically adjusts the next voice broadcast timing and the corresponding voice content if the navigated object has not noticed the voice content.

[0094] As described above, after planning the navigation route, the navigation server will push the navigation route and voice navigation content to the navigation terminal. The voice navigation content includes voice broadcasting opportunities corresponding to multiple location points on the navigation route and at least one voice content that can be broadcast at the voice broadcasting opportunity.

[0095] Based on the above voice navigation content, the disclosed embodiment can dynamically adjust the next voice broadcasting time and the corresponding voice content set by the navigation server based on the behavior feedback information of the navigated object on the voice content that has been played.

[0096] In some embodiments, the navigation terminal can adjust the voice content corresponding to the next voice broadcast opportunity set by the navigation server based on the behavior feedback information of the navigated object, for example, a voice content involving key information can be selected from multiple candidate contents corresponding to the next voice broadcast opportunity, or a voice content emphasizing the key information can be added. In this embodiment, the next voice broadcast opportunity can be pre-set by the navigation server.

[0097] In other embodiments, the navigation terminal may also adjust the next voice broadcast timing and its corresponding voice content based on the behavioral feedback information of the navigated object, that is, the navigation terminal may add another next voice broadcast timing and the voice content corresponding to the next voice broadcast timing based on the voice broadcast timing set by the navigation server. The voice broadcast timing may be set based on the urgency of the navigation action involved in the voice content missed by the navigated object. For example, if the navigated object needs to execute the navigation action immediately, the voice broadcast timing may be set to a time point closer to the current moment, such as immediate execution. The voice broadcast timing may usually be set before the voice broadcast timing closest to the current moment in the voice navigation content. The dynamically added next voice content may be obtained by extracting the key information of the voice content missed by the navigated object, and then obtaining the next voice content based on the key information. For example, the key information may be repeated at least once in the newly added next voice content.

[0098] Figure 5 FIG. 2 is a schematic diagram showing an application scenario of voice navigation according to an embodiment of the present disclosure. Figure 5As shown, the user sends a navigation request from the current position to the destination to the navigation server through the mobile terminal. The navigation server plans the navigation route from the current position to the destination based on the navigation request, and pushes the planned navigation route and voice navigation content to the mobile terminal. After the mobile terminal receives the navigation route and voice navigation content, it starts the navigation based on the user's choice, and obtains the vehicle's current position information in real time. When the vehicle's current position information matches the voice broadcast timing in the voice navigation content, it selects at least one voice content corresponding to the voice broadcast timing for broadcasting, and detects the vehicle's speed change, driving direction change, etc. in real time after the broadcast is completed. And based on whether the speed change, driving direction change and the key information in the voice content match, it is judged whether the user driving the vehicle has noticed the key information. If not noticed, the voice broadcast timing and its corresponding voice content are dynamically adjusted, so that the key information ignored by the user can be emphasized again.

[0099] The following are embodiments of the apparatus of the present disclosure, which can be used to execute embodiments of the method of the present disclosure.

[0100] Figure 6 FIG. 1 is a block diagram of a voice navigation device according to an embodiment of the present disclosure. The device can be implemented as part or all of an electronic device through software, hardware, or a combination of both. Figure 6 As shown, the voice navigation device comprises:

[0101] The acquisition module 601 is configured to acquire a navigation route and voice navigation content; the voice navigation content includes voice content and voice broadcast timing;

[0102] The broadcast module 602 is configured to broadcast the voice content based on the voice broadcast timing when the guided object is traveling along the navigation route;

[0103] The adjustment module 603 is configured to dynamically adjust the voice content of the next voice broadcasting opportunity based on the behavior feedback information of the navigated object after the voice content is broadcasted.

[0104] In this embodiment, the voice navigation device is executed in the navigation terminal. Voice navigation can be understood as voice-controlled voice navigation, which uses representative intelligent voice technologies such as voice recognition and voice encoding and decoding, and is usually used in vehicles, user terminals, etc. Voice content can be understood as, in the navigation process of the navigated object, reminding the navigated object of the direction and lane of travel and other information through voice interaction, that is, the voice content mainly involves guiding the user to perform navigation actions that need to be performed at the upcoming moment; the voice broadcasting time can be a fixed GPS location point. After the navigation route is planned, the voice content and the voice broadcasting time are basically fixed. The navigation terminal can match the voice broadcasting time based on the current positioning information of the navigated object, and broadcast the voice content corresponding to the voice broadcasting time by voice when matching. It can be understood that each voice broadcasting time can correspond to one or more candidate broadcasting contents, and the navigation terminal can select one or more voice contents for broadcasting randomly or according to preset rules.

[0105] The navigated object may include a person, and the navigation terminal may include but is not limited to a mobile phone, iPad, computer, smart watch, vehicle, robot, etc. The navigated object sends a navigation request from the starting point to the end point to the navigation server through the navigation terminal. The navigation server plans the navigation route based on the starting point and the end point and sends it to the navigated object together with the navigation content. In voice navigation, the navigation content may include but is not limited to the voice content and the voice broadcasting time; the voice content and the voice broadcasting time are set correspondingly.

[0106] When the navigated object is traveling along the navigation route, the navigation terminal detects the current location information of the navigated object in real time, matches the location information with the voice broadcast timing in the voice navigation content, and broadcasts the corresponding voice content after the match is successful.

[0107] In the embodiment of the present disclosure, each time after the voice content is reported, the navigation terminal also detects the behavior feedback information of the navigated object. The behavior feedback information can be understood as the information fed back by the driving behavior of the navigated object, including but not limited to the speed change information, driving direction change information, positioning information, etc. of the navigated object. The behavior feedback information of the navigated object can be detected by the vehicle driven by the navigation object or the handheld terminal carried by the navigation object. Through the behavior feedback information, it can be determined whether the navigated object has performed a corresponding behavior based on the currently broadcast voice content. If the corresponding behavior is performed, it can be considered that the navigated object has received the voice content, otherwise it can be considered that the navigated object has not received the voice content. In the embodiment of the present disclosure, whether the navigated object receives the voice content can be understood as whether the user has noticed the current voice content and performed a corresponding behavior based on the voice content.

[0108] In some embodiments, the user may not be able to concentrate enough while driving and cannot extract effective information from the voice content broadcast by the navigation object, which may easily lead to deviation.

[0109] Therefore, the disclosed embodiment can dynamically adjust the voice content of the next voice broadcast opportunity based on the behavioral feedback information of the navigated object. The adjusted voice content can emphasize key information ignored by the user, so as to reduce the user's yaw rate by repeatedly reminding the user of the key information.

[0110] The following example illustrates: if at the first voice broadcast timing, after the corresponding voice content is played, the navigated object does not exhibit corresponding driving behavior based on the voice content, such as slowing down, changing direction, etc.; at this time, the voice content of the next voice broadcast timing can be adjusted in the navigation, such as selecting candidate content containing key information from multiple voice contents corresponding to the next voice broadcast timing in the predetermined voice navigation content and repeatedly broadcasting it, without broadcasting other candidate content.

[0111] In the voice navigation of the disclosed embodiment, after the voice content corresponding to a voice broadcasting time is broadcasted, the behavior feedback information of the navigated object is detected in real time, and the voice content corresponding to the next voice broadcasting time is dynamically adjusted based on the behavior feedback information. Through the disclosed embodiment, the problem that the user may easily deviate when the user is not paying attention during driving and the existing fixed voice broadcasting time and fixed voice content are used can be avoided, and the user's yaw rate can be reduced, thereby improving the user's navigation experience.

[0112] In an optional implementation of this embodiment, the adjustment module includes:

[0113] A first determination submodule is configured to detect behavior feedback information of the navigated object after the voice content is broadcast;

[0114] A first judgment submodule is configured to judge whether the navigated object has noticed the key information in the speech content based on the behavior feedback information;

[0115] The selection submodule is configured to select the voice content including the key information for broadcast at the next voice broadcasting opportunity after determining that the navigated object has not noticed the voice content.

[0116] In this optional implementation method, in a voice navigation scenario, after the navigation server plans the navigation route, it sends the planned navigation route and the corresponding voice navigation content to the navigation terminal of the navigated object. The navigation terminal provides voice navigation services to the navigated object based on the real-time positioning information of the navigated object, the navigation route and the voice navigation content. The navigation terminal matches the real-time positioning information of the navigated object with the location points in the navigation route, and when matching the location points where the voice content is set, voice broadcasts the corresponding voice content.

[0117] The disclosed embodiments take into account that after the voice content is broadcast, the navigated object may not actually receive the voice content due to reasons such as lack of concentration. Therefore, the behavior feedback information of the navigated object can be detected after the voice content is broadcast. The behavior feedback information may include but is not limited to information such as changes in speed and driving direction of the navigated object.

[0118] After determining the behavioral feedback information of the navigated object, it can be determined based on the behavioral feedback information whether the navigated object has noticed the key information in the voice content, such as the voice content prompting the user to exit the highway at the next highway intersection and prompting the user to change lanes in advance; however, the detected behavioral feedback information shows that the navigated object did not make any obvious behavioral changes after the voice content was broadcast, such as not slowing down or changing direction, etc., in this case it can be determined that the navigated object did not notice the key information in the voice content; on the contrary, if the detected behavioral feedback information shows that the navigated object made corresponding behavioral changes after the voice content was broadcast, such as slowing down or changing direction, in this case it can be determined that the navigated object noticed the key information in the voice content.

[0119] After determining that the navigated object has not noticed the voice content, the voice content that only includes the key information or can emphasize the key information can be selected for broadcast at the next voice broadcast time to remind the navigated object to pay attention to the key information. After determining that the navigated object has noticed the voice content, the voice content to be broadcast can be selected in a conventional manner at the next voice broadcast time, and it is not necessary to select the voice content that only includes the key information or can emphasize the key information. It can even select the voice content that does not include the key information. The specific method can be determined according to the set voice content selection method, which is not specifically limited here.

[0120] In an optional implementation of this embodiment, the first determination submodule includes:

[0121] The second determination submodule is configured to determine whether the navigated object has noticed the key information in the voice content based on the matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content after the voice content is broadcast.

[0122] In this optional implementation, as described above, the navigation server pushes the navigation route and voice navigation content to the navigation terminal, and the voice navigation content includes the voice content and the voice broadcasting timing of playing the voice content.

[0123] After playing the voice content at the voice broadcast opportunity, the embodiment of the present disclosure determines whether to adjust the voice content at the next voice broadcast opportunity based on the behavior feedback information of the navigated object.

[0124] In this embodiment, the navigated object can determine whether the navigated object has noticed the key information in the voice content based on the matching relationship between the behavioral feedback information of the navigated object and the navigation action involved in the voice content. The behavioral feedback information can be measured from at least two aspects, such as the change in speed and the change in driving direction of the navigated object, and the navigation action is the action that the navigated object needs to perform according to the navigation route, which is usually related to the driving direction, and because the navigated object will coordinate with the corresponding driving speed when performing the navigation action, it is possible to establish a mapping relationship between the speed change, the driving direction change, etc. and the navigation action in advance. During the navigation process, it is determined whether the navigated object has noticed the key information in the voice content by matching the speed change, driving change, etc. in the behavioral feedback information with the navigation action.

[0125] In an optional implementation of this embodiment, the second determining submodule includes:

[0126] The third determination submodule is configured to determine whether the navigated object has noticed the key information in the voice content based on the driving speed of the navigated object when the voice content involves a navigation action of guiding the navigated object to turn or drive at a complex intersection.

[0127] In this optional implementation, the voice content corresponding to different voice broadcasting times may be different, and the navigation actions involved in different voice contents may also be different. A mapping relationship between different navigation actions and behavioral feedback information of the navigated object can be set in advance, as well as a judgment conclusion on whether the navigated object has noticed the voice content involving the navigation action under this mapping relationship.

[0128] In one implementation mode, before a simple intersection and / or a complex intersection on the navigation route, the navigation server will set a corresponding voice broadcast timing and voice content in the voice navigation content. The voice content may involve other navigation actions to guide the navigated object to turn or drive at a complex intersection (such as a roundabout, a three-way intersection, etc.). When the navigated object notices the voice content, its driving speed will usually change, such as slowing down to prepare for a turn. Therefore, it can be determined whether the navigated object has noticed the key information in the voice content based on the speed change in the behavioral feedback information of the navigated object.

[0129] In an optional implementation of this embodiment, the third determining submodule includes:

[0130] The fourth determining submodule is configured to determine that the navigated object has not noticed the key information in the voice content when the voice content involves guiding the navigated object to turn and the driving speed of the navigated object has not decreased.

[0131] In this optional implementation, as described above, before a simple intersection and / or a complex intersection of the navigation route, the navigation server will include a corresponding voice broadcast timing in the voice navigation content. Based on the voice content, the voice content may involve other navigation actions that guide the navigated object to turn or drive at a complex intersection (such as a roundabout, a three-way intersection, etc.), and when the navigated object notices the voice content, its driving speed will usually change, such as slowing down to prepare for a turn. That is to say, at a turn or a complex intersection, the normal driving feedback information of the navigated object at least includes speed reduction, and after the voice content is broadcast, if the navigated object does not slow down, it can be determined that the navigated object has not noticed the key information in the voice content, and it is necessary to emphasize this key information again at the next voice broadcast timing.

[0132] In an optional implementation of this embodiment, the third determining submodule includes:

[0133] The fifth determination submodule is configured to determine that the navigated object has noticed the voice navigation content if the speed reduction of the navigated object is greater than or equal to a preset speed value when the voice content involves a navigation action of guiding the navigated object to travel at a complex intersection.

[0134] In this optional implementation, when the navigated object is near a complex intersection such as a roundabout or a three-way intersection, if the road shape of the intersection is unfamiliar and the key content is not noticed after the voice content is broadcast, the more likely behavior is to slow down or stop the car to a large extent. At this time, it can be determined that the navigated object is hesitating because it is not clear which direction to go. Therefore, based on this situation, when the voice content involves a navigation action to guide the navigated object to travel at a complex intersection, the embodiment of the present disclosure can be based on whether the speed reduction of the navigated object is greater than or equal to the preset speed value to determine whether the navigated object has noticed the key information in the voice content. If the speed reduction is greater than or equal to the preset speed value, it can be considered that the navigated object has noticed the key information in the voice content. At this time, the voice content corresponding to the next voice broadcast opportunity can be dynamically adjusted so as to emphasize the key information in the next voice content and guide the navigated object to correctly follow the navigation route at the complex intersection.

[0135] In an optional implementation of this embodiment, the second determining submodule includes:

[0136] The second judgment submodule is configured to judge whether the navigated object has switched to the target lane based on the positioning information of the navigated object when the voice content involves a navigation action of guiding the navigated object to travel in the target lane, and determine whether the navigated object has noticed the key information in the voice content based on the judgment result.

[0137] In this optional implementation, when the voice content involves a navigation action of guiding the navigated object to drive in the target lane, for example, when the navigated object is driving on a highway and is about to exit the highway exit, the voice content will prompt the navigated object to merge to the rightmost lane in advance so that it can exit smoothly when approaching the highway exit. If the positioning information of the navigated object indicates that it is still driving in the leftmost lane and has not slowed down or made any changes in direction (i.e., has not merged), it can be determined that the navigated object has not noticed the previous voice content, so the voice content corresponding to the next voice broadcast timing can be dynamically adjusted to re-emphasize the key information in the voice content that guides the navigated object to merge in advance.

[0138] In an optional implementation of this embodiment, the adjustment module includes:

[0139] The adding submodule is configured to add the next voice broadcasting opportunity and the next voice content corresponding to the next voice broadcasting opportunity after the voice content is broadcasted, and the added next voice content at least includes the key information in the voice content.

[0140] In this optional implementation, after broadcasting a voice content, this embodiment also obtains behavioral feedback information of the navigated object, determines whether the navigated object has noticed the voice content based on the behavioral feedback information, and dynamically adjusts the next voice broadcast timing and the corresponding voice content if the navigated object has not noticed the voice content.

[0141] As described above, after planning the navigation route, the navigation server will push the navigation route and voice navigation content to the navigation terminal. The voice navigation content includes voice broadcasting opportunities corresponding to multiple location points on the navigation route and at least one voice content that can be broadcast at the voice broadcasting opportunity.

[0142] Based on the above voice navigation content, the disclosed embodiment can dynamically adjust the next voice broadcasting time and the corresponding voice content set by the navigation server based on the behavior feedback information of the navigated object on the voice content that has been played.

[0143] In some embodiments, the navigation terminal can adjust the voice content corresponding to the next voice broadcast opportunity set by the navigation server based on the behavior feedback information of the navigated object, for example, a voice content involving key information can be selected from multiple candidate contents corresponding to the next voice broadcast opportunity, or a voice content emphasizing the key information can be added. In this embodiment, the next voice broadcast opportunity can be pre-set by the navigation server.

[0144] In other embodiments, the navigation terminal may also adjust the next voice broadcast timing and its corresponding voice content based on the behavioral feedback information of the navigated object, that is, the navigation terminal may add another next voice broadcast timing and the voice content corresponding to the next voice broadcast timing based on the voice broadcast timing set by the navigation server. The voice broadcast timing may be set based on the urgency of the navigation action involved in the voice content missed by the navigated object. For example, if the navigated object needs to execute the navigation action immediately, the voice broadcast timing may be set to a time point closer to the current moment, such as immediate execution. The voice broadcast timing may usually be set before the voice broadcast timing closest to the current moment in the voice navigation content. The dynamically added next voice content may be obtained by extracting the key information of the voice content missed by the navigated object, and then obtaining the next voice content based on the key information. For example, the key information may be repeated at least once in the newly added next voice content.

[0145] Figure 7 It is a structural schematic diagram of an electronic device suitable for implementing the voice navigation method according to an embodiment of the present disclosure.

[0146] like Figure 7As shown, the electronic device 700 includes a processing unit 701, which can be implemented as a processing unit such as a CPU, a GPU, an FPGA, and an NPU. The processing unit 701 can perform various processes in the embodiments of any of the above methods of the present disclosure according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage part 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 are also stored. The processing unit 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0147] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage section 708 as needed.

[0148] In particular, according to an embodiment of the present disclosure, any method in the above referenced embodiment of the present disclosure may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program tangibly contained on a machine-readable medium, and the computer program includes a program code for executing any method in the embodiment of the present disclosure. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 709, and / or installed from a removable medium 711.

[0149] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the road map or block diagram can represent a part of a module, program segment or code, and the part of the module, program segment or code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a different order from the order marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0150] The units or modules involved in the embodiments described in the present disclosure may be implemented by software or hardware. The units or modules described may also be set in a processor, and the names of these units or modules do not constitute limitations on the units or modules themselves in some cases.

[0151] As another aspect, the present disclosure further provides a computer-readable storage medium, which may be a computer-readable storage medium included in the device described in the above embodiment; or a computer-readable storage medium that exists independently and is not assembled into the device. The computer-readable storage medium stores one or more programs, and the programs are used by one or more processors to execute the method described in the present disclosure.

[0152] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present disclosure is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other.

Claims

1. A voice navigation method, wherein: include: Get navigation routes and voice navigation content; The voice navigation content includes voice content and voice broadcast timing; During the driving process of the guided object based on the navigation route, broadcasting the voice content based on the voice broadcasting timing; After the voice content is broadcast, based on the behavioral feedback information of the navigated object, it is determined that the navigated object has not noticed the key information in the voice content, and the voice content of the next voice broadcast opportunity is dynamically adjusted so that the voice content of the next voice broadcast opportunity at least includes the key information in the broadcast voice content.

2. The method according to claim 1, wherein: After the voice content is broadcasted, the voice content of the next voice broadcasting opportunity is dynamically adjusted based on the behavior feedback information of the navigated object, including: After the voice content is broadcasted, detecting behavior feedback information of the navigated object; Determining whether the navigated object has noticed key information in the speech content based on the behavior feedback information; After determining that the navigated object has not noticed the voice content, the voice content including the key information is selected for broadcasting at the next voice broadcasting opportunity.

3. The method according to claim 2, wherein: Judging whether the navigated object has noticed the key information in the voice content based on the behavior feedback information includes: After the voice content is broadcasted, it is determined whether the navigated object has noticed the key information in the voice content based on the matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content.

4. The method according to claim 3, wherein: Determining whether the navigated object has noticed key information in the voice content based on a matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content includes: When the voice content involves a navigation action of guiding the navigated object to turn or travel at a complex intersection, it is determined whether the navigated object has noticed key information in the voice content based on the travel speed of the navigated object.

5. The method according to claim 4, wherein: When the voice content involves a navigation action of guiding the navigated object to turn or drive at a complex intersection, determining whether the navigated object has noticed key information in the voice content based on the driving speed of the navigated object includes: When the voice content involves guiding the guided object to turn, and the driving speed of the guided object does not decrease, it is determined that the guided object does not notice the key information in the voice content.

6. The method according to claim 4, wherein: When the voice content involves a navigation action of guiding the navigated object to turn or drive at a complex intersection, determining whether the navigated object has noticed key information in the voice content based on the driving speed of the navigated object includes: When the voice content involves a navigation action of guiding the guided object to travel at a complex intersection, if the speed reduction amplitude of the guided object is greater than or equal to a preset speed value, it is determined that the guided object has noticed the voice navigation content.

7. The method according to any one of claims 3 to 6, wherein: Determining whether the navigated object has noticed key information in the voice content based on a matching relationship between the behavior feedback information of the navigated object and the navigation action corresponding to the voice content includes: When the voice content involves a navigation action of guiding the navigated object to travel in a target lane, it is determined whether the navigated object has switched to the target lane based on the positioning information of the navigated object, and it is determined whether the navigated object has noticed the key information in the voice content based on the judgment result.

8. The method according to any one of claims 1 to 6, wherein: After the voice content is broadcasted, the voice content of the next voice broadcasting opportunity is dynamically adjusted based on the behavior feedback information of the navigated object, including: After the voice content is broadcasted, a next voice broadcasting opportunity and a next voice content corresponding to the next voice broadcasting opportunity are added, and the added next voice content at least includes key information in the voice content.

9. An electronic device, wherein: The method comprises a memory, a processor and a computer program stored in the memory, wherein the processor executes the computer program to implement the method according to any one of claims 1 to 8.

10. A computer program product comprising computer instructions, wherein: When the computer instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images