Vehicle navigation method based on voice instruction, vehicle-mounted terminal and storage medium

Abstract

The invention provides a vehicle navigation method based on a voice instruction, a vehicle-mounted terminal and a storage medium, and relates to the technical field of vehicle-mounted navigation. The vehicle-mounted terminal can respond to the voice instruction and recognize semantic information represented by the voice instruction based on the voice assistant. Determining whether the navigation application of the vehicle-mounted terminal takes the target end point address as a navigation end point or not under the condition that the semantic information is recognized to represent navigation to the target end point address; if the target end point address is taken as the navigation end point, acquiring current positioning information; and executing a navigation function from the navigation starting point to the target end point address according to the historical navigation path under the condition that the historical navigation path taking the current positioning information as the navigation starting point and taking the target end point address as the navigation end point exists. Therefore, the user can trigger the navigation function only by inputting the voice instruction, complicated operation steps are not needed, the efficiency is high, and the experience feeling of the user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of vehicle navigation, and in particular, to a vehicle navigation method, an in-vehicle terminal, and a storage medium based on voice commands. Background Art

[0002] With the development of technology, intelligent cockpit systems are making great strides towards increasing intelligence. Among them, the in-vehicle voice assistant is a convenient intelligent software that enables users to control the vehicle to perform functions such as navigation through voice.

[0003] Currently, when voice navigation is required, after waking up the in-vehicle voice assistant, the user needs to input a navigation command by voice and select a destination address from multiple addresses associated with the navigation command displayed on the display interface; then, the vehicle plans multiple navigation paths based on the current address information and the destination address, and the user selects one navigation path from the multiple navigation paths to trigger the vehicle to start performing the navigation operation. The above implementation of the vehicle navigation function is very complex, inefficient, and has a poor user experience. Summary of the Invention

[0004] The present application provides a vehicle navigation method, an in-vehicle terminal, and a storage medium based on voice commands, which are used to solve the problems that the function of implementing vehicle navigation in the prior art is very complex, inefficient, and has a poor user experience.

[0005] In a first aspect, the present application provides a vehicle navigation method based on voice commands, which is applied to an in-vehicle terminal. The method provided by the present application includes:

[0006] In response to a wake-up operation on a preset voice assistant, wake up the voice assistant;

[0007] In response to a voice command, identify the semantic information represented by the voice command based on the voice assistant;

[0008] In the case where it is recognized that the semantic information represents navigation to a target end address, determine whether the navigation application of the in-vehicle terminal has ever used the target end address as a navigation end point;

[0009] If the target end address has ever been used as a navigation end point, collect the current positioning information;

[0010] In the case where it is determined that there is a historical navigation path with the current positioning information as the navigation start point and the target end address as the navigation end point, perform the navigation function from the navigation start point to the target end address according to the historical navigation path.

[0011] In some embodiments, determining whether the navigation application of the in-vehicle terminal has ever used the target end address as a navigation end point includes:

[0012] In the case where semantic information indicating navigation to a target end address is recognized, extract multiple historical navigation paths from a preset navigation application;

[0013] Determine whether the navigation end points of the multiple historical navigation paths are the same as the target end address;

[0014] If any of them is the same, determine that the navigation application of the vehicle-mounted terminal has used the target end address as a navigation end point.

[0015] In some embodiments, if the target end address has been used as a navigation end point, collect the current positioning information, including:

[0016] If the target end address has been used as a navigation end point, output a target prompt message for indicating navigation to the target end address;

[0017] If no negative operation on the target prompt message is received within a preset duration, collect the current positioning information.

[0018] In some embodiments, if the target end address has been used as a navigation end point, output a target prompt message for indicating navigation to the target end address, including:

[0019] If the target end address has been used as a navigation end point, play the target prompt message for indicating navigation to the target end address by voice;

[0020] If no negative operation on the target prompt message is received within a preset duration, collect the current positioning information, including:

[0021] If no voice data for indicating negation of the target prompt message is received within a preset duration, collect the current positioning information.

[0022] In some embodiments, after collecting the current positioning information, the method provided by this application further includes:

[0023] If there is no historical navigation path with the current positioning information as the navigation start point and the target end address as the navigation end point, use the current positioning information as the navigation start point and the target end address as the navigation end point for path planning to obtain multiple current planned paths;

[0024] In response to a selection operation on a target planned path among the multiple current planned paths, execute a navigation function according to the target planned path.

[0025] In some embodiments, the method provided by this application further includes:

[0026] If the target end address has not been used as the navigation end point, search for multiple address information associated with the target end address based on a preset map database;

[0027] In response to a selection operation on the target address information among the multiple address information, use the target address information as the navigation end point;

[0028] Collect the current positioning information;

[0029] Use the current positioning information as the navigation start point and the target end address as the navigation end point for path planning to obtain multiple currently planned paths;

[0030] In response to a selection operation on the target planned path among the multiple currently planned paths, execute the navigation function according to the target planned path.

[0031] In some embodiments, based on the voice assistant to identify the semantic information represented by the voice command, including:

[0032] Input the voice command into a pre-trained semantic recognition model based on the voice assistant to obtain the semantic information represented by the voice command, where the semantic recognition model is obtained by training multiple training samples input into a network to be trained, and each training sample includes a historical voice command and the corresponding semantic information.

[0033] In a second aspect, the present application provides a vehicle-mounted terminal, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the vehicle-mounted terminal executes the method provided in the first aspect of the present application.

[0034] In a third aspect, the present application further provides a storage medium storing a computer program, and when the computer program is executed by a processor, the computer executes the method provided in the first aspect of the present application.

[0035] In a fourth aspect, the present application further provides a computer program product including a computer program, and when the computer program is run, the vehicle-mounted terminal executes the method provided in the first aspect of the present application.

[0036] The present application provides a vehicle navigation method, an in-vehicle terminal, and a storage medium based on voice commands. The in-vehicle terminal can respond to voice commands from a user and identify the semantic information represented by the voice commands based on a voice assistant. When it is recognized that the semantic information represents navigation to a target end address, it is determined whether the navigation application of the in-vehicle terminal has ever used the target end address as a navigation destination; if the target end address has ever been used as a navigation destination, the current positioning information is collected; when it is determined that there is a historical navigation path with the current positioning information as the navigation starting point and the target end address as the navigation destination, the navigation function from the navigation starting point to the target end address is executed according to the historical navigation path. In this way, the user only needs to input a voice command to trigger the navigation function, without complex operation steps, with high efficiency and improved user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0038] Figure 1 FIG. 1 is one of the flowcharts of the vehicle navigation method based on voice commands provided by the embodiments of the present application;

[0039] Figure 2 FIG. 2 is another flowchart of the vehicle navigation method based on voice commands provided by the embodiments of the present application;

[0040] Figure 3 FIG. 3 is a functional module block diagram of the vehicle navigation device based on voice commands provided by the embodiments of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0041] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. However, it should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present disclosure. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily confusing the concepts of the present disclosure.

[0042] Various structural schematic diagrams according to embodiments of the present disclosure are shown in the drawings. These figures are not drawn to scale, and some details are enlarged for the purpose of clear expression, and some details may be omitted. The shapes of various regions and layers shown in the figures, as well as their relative sizes and positional relationships, are only exemplary. In practice, there may be deviations due to manufacturing tolerances or technical limitations, and those skilled in the art can design regions / layers with different shapes, sizes, and relative positions according to actual needs.

[0043] In the context of the present disclosure, when a layer / component is referred to as being "on" another layer / component, the layer / component may be directly on the other layer / component, or there may be an intermediate layer / component therebetween. Additionally, if a layer / component is "on" another layer / component in one orientation, then when the orientation is reversed, the layer / component may be "under" the other layer / component.

[0044] Hereinafter, the technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail with specific embodiments. These several specific embodiments below can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

[0045] An embodiment of the present application provides a vehicle navigation method based on voice commands, which is applied to an in-vehicle terminal. Among them, the in-vehicle terminal may be, but is not limited to, an in-vehicle computer ECU (electronic control unit, ECU). Application programs such as a voice assistant and a navigation application are installed on the in-vehicle terminal. As Figure 1 shown, the method provided by the embodiment of the present application includes:

[0046] S101: Wake up the voice assistant in response to a user's wake-up operation on a preset voice assistant.

[0047] Exemplarily, the ways for the user to wake up the voice assistant include, but are not limited to, the following two:

[0048] The first one: The user triggers a wake-up button on the vehicle's steering wheel as the user's wake-up operation on the voice assistant.

[0049] The second one: The user inputs wake-up voice data (such as "Hello, my car") to a plurality of microphones arranged in an array in the vehicle as the user's wake-up operation on the voice assistant.

[0050] S102: In response to a voice command from the user, identify the semantic information represented by the voice command based on the voice assistant.

[0051] For example, the identified voice command may be a voice command of "Please navigate to Binjiang Road". Specifically, the voice command can be input into a pre-trained semantic recognition model based on the voice assistant to obtain the semantic information represented by the voice command. Among them, the semantic recognition model is obtained by training a plurality of training samples input into a network to be trained, and each training sample includes a historical voice command and the corresponding semantic information.

[0052] S103: When it is recognized that the semantic information represents navigation to the target end address, determine whether the navigation application of the vehicle terminal has ever used the target end address as the navigation destination. If yes, execute S104; optionally, if not, execute S201.

[0053] Exemplarily, the voice command "Please navigate to Binjiang Community" represents navigation to "Binjiang Community" (i.e., the target end address). Further, determine whether the navigation application of the vehicle terminal has ever used "Binjiang Community" as the navigation destination.

[0054] Exemplarily, when it is recognized that the semantic information represents navigation to the target end address, extract multiple historical navigation paths from the preset navigation application; determine whether the navigation destinations of the multiple historical navigation paths are the same as the target end address; if any one is the same, determine that the navigation application of the vehicle terminal has ever used the target end address as the navigation destination.

[0055] Further, if the target end address has ever been used as the navigation destination, output a target prompt message for representing navigation to the target end address.

[0056] Specifically, if the target end address has ever been used as the navigation destination, play the target prompt message for representing navigation to the target end address by voice. For example, play the voice "About to navigate to Binjiang Community". If within a preset duration (such as 3 s), no voice data from the user for representing the negative target prompt message is received, collect the current location information.

[0057] For example, when the target end address is "Binjiang Community", the target prompt message is "About to navigate to Binjiang Community, please confirm". If within a preset duration (such as 3 s), no negative operation on the target prompt message from the user is received, collect the current location information. Exemplarily, the negative operation can be inputting a voice command not to go to the target end address, such as "If not going to Binjiang Community", and the negative operation can also be a trigger operation on the negative control on one side of the target prompt message, which is not limited herein.

[0058] S104: Collect the current location information.

[0059] For example, the current location information can be collected based on the vehicle-mounted GPS. For example, the currently collected location information is "XXX Company Office Building".

[0060] S105: When it is determined that there is a historical navigation path with the current location information as the navigation starting point and the target end address as the navigation destination, execute the navigation function from the navigation starting point to the target end address according to the historical navigation path.

[0061] For example, if there is a historical navigation path with the "XXX Company Office Building" as the navigation starting point and the "Binjiang Community" as the navigation ending point, directly execute the navigation function from the "XXX Company Office Building" to the "Binjiang Community" according to the historical navigation path.

[0062] In addition, after S104, the method provided by the embodiments of the present application further includes: if there is no historical navigation path with the current positioning information as the navigation starting point and the target end address as the navigation ending point, then use the current positioning information as the navigation starting point and the target end address as the navigation ending point for path planning to obtain multiple currently planned paths; in response to the user's selection operation on the target planned path among the multiple currently planned paths, execute the navigation function according to the target planned path.

[0063] In addition, as Figure 2 shown, the method provided by the embodiments of the present application further includes:

[0064] S201: Search for multiple address information associated with the target end address based on a preset map database.

[0065] S202: In response to the user's selection operation on the target address information among the multiple address information, use the target address information as the navigation ending point.

[0066] S203: Collect the current positioning information.

[0067] S204: Use the current positioning information as the navigation starting point and the target end address as the navigation ending point for path planning to obtain multiple currently planned paths.

[0068] S205: In response to the user's selection operation on the target planned path among the multiple currently planned paths, execute the navigation function according to the target planned path.

[0069] In summary, for a vehicle navigation method based on voice commands provided by the embodiments of the present application, the in-vehicle terminal can respond to a voice command from the user and recognize the semantic information represented by the voice command based on a voice assistant. When it recognizes that the semantic information represents navigation to a target end address, it determines whether the navigation application of the in-vehicle terminal has ever used the target end address as the navigation ending point; if it has ever used the target end address as the navigation ending point, it collects the current positioning information; when it determines that there is a historical navigation path with the current positioning information as the navigation starting point and the target end address as the navigation ending point, it executes the navigation function from the navigation starting point to the target end address according to the historical navigation path. In this way, the user only needs to input a voice command to trigger the navigation function, without complex operation steps, with high efficiency and improved user experience.

[0070] In addition, an embodiment of the present application further provides a vehicle navigation device based on voice commands, which is configured in a vehicle-mounted terminal. It should be noted that the basic principle and the technical effects generated by the vehicle navigation device based on voice commands provided in the embodiments of the present application are the same as those in the above embodiments. For the sake of brief description, for the parts not mentioned in the embodiments of the present application, reference can be made to the corresponding content in the above embodiments. As Figure 3 shown, the device provided in the embodiment of the present application includes a voice wake-up unit, a voice recognition unit, a historical record determination unit, a positioning acquisition unit, and a path navigation unit. Among them,

[0071] The voice wake-up unit is used to wake up the voice assistant in response to the user's wake-up operation on the preset voice assistant.

[0072] The voice recognition unit is used to recognize the semantic information represented by the voice command based on the voice assistant in response to the voice command from the user.

[0073] In some embodiments, the voice recognition unit is specifically used to input the voice command into a pre-trained semantic recognition model based on the voice assistant to obtain the semantic information represented by the voice command. Among them, the semantic recognition model is obtained by training multiple training samples input into the network to be trained, and each training sample includes a historical voice command and the corresponding semantic information.

[0074] The historical record determination unit is used to determine whether the navigation application of the vehicle-mounted terminal has ever used the target end address as the navigation end point when it is recognized that the semantic information represents navigation to the target end address.

[0075] The positioning acquisition unit is used to collect the current positioning information if the target end address has ever been used as the navigation end point.

[0076] The path navigation unit is used to execute the navigation function from the navigation start point to the target end address according to the historical navigation path when it is determined that there is a historical navigation path with the current positioning information as the navigation start point and the target end address as the navigation end point.

[0077] In some embodiments, the historical record determination unit is specifically used to extract multiple historical navigation paths from the preset navigation application when it is recognized that the semantic information represents navigation to the target end address; determine whether the navigation end points of the multiple historical navigation paths are the same as the target end address; if any of them is the same, determine that the navigation application of the vehicle-mounted terminal has ever used the target end address as the navigation end point.

[0078] In some embodiments, the device provided by the embodiments of the present application further includes a prompt information output unit, configured to output target prompt information for characterizing navigation to the target end address if the target end address has ever been used as a navigation end point. A positioning information acquisition unit, configured to acquire the current positioning information if no negative operation on the target prompt information from the user is received within a preset duration.

[0079] In some embodiments, the prompt information output unit is specifically configured to, if the target end address has ever been used as a navigation end point, play the target prompt information for characterizing navigation to the target end address through voice;

[0080] The positioning information acquisition unit is configured to acquire the current positioning information if no voice data from the user for characterizing negating the target prompt information is received within a preset duration.

[0081] In some embodiments, the device provided by the embodiments of the present application further includes:

[0082] A path planning unit, configured to, if there is no historical navigation path with the current positioning information as a navigation start point and the target end address as a navigation end point, use the current positioning information as a navigation start point and the target end address as a navigation end point to perform path planning, and obtain multiple current planned paths.

[0083] A path selection unit, configured to, in response to a user's selection operation on a target planned path among the multiple current planned paths, perform a navigation function according to the target planned path.

[0084] In some embodiments, the device provided by the present application may further include:

[0085] An address search unit, configured to, if the target end address has never been used as a navigation end point, search for multiple address information associated with the target end address based on a preset map database.

[0086] An address selection unit, configured to, in response to a user's selection operation on target address information among the multiple address information, use the target address information as a navigation end point.

[0087] A positioning information acquisition unit, configured to acquire the current positioning information.

[0088] A path planning unit, configured to use the current positioning information as a navigation start point and the target end address as a navigation end point to perform path planning, and obtain multiple current planned paths.

[0089] A path navigation unit, configured to, in response to a user's selection operation on a target planned path among the multiple current planned paths, perform a navigation function according to the target planned path.

[0090] In addition, an embodiment of the present application provides a vehicle-mounted terminal, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the vehicle-mounted terminal executes the method provided in the above embodiments of the present application.

[0091] In addition, an embodiment of the present application further provides a storage medium storing a computer program. When the computer program is executed by a processor, the computer executes the method provided in the above embodiments of the present application.

[0092] In addition, an embodiment of the present application further provides a computer program product including a computer program. When the computer program is run, the vehicle-mounted terminal executes the method provided in the above embodiments of the present application.

[0093] In the above description, no detailed description is made of technical details such as the composition of each layer. However, those skilled in the art should understand that various technical means can be used to form layers, regions, etc. of the required shapes. In addition, in order to form the same structure, those skilled in the art can also design methods that are not exactly the same as the methods described above. In addition, although the above embodiments are described separately, this does not mean that the measures in each embodiment cannot be used advantageously in combination.

[0094] Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications once they learn the basic creative concepts. Therefore, the appended claims are intended to be construed to include the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0095] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

Claims

1. A vehicle navigation method based on voice commands, characterized in that: Applied to a vehicle-mounted terminal, the method comprises: In response to a wake-up operation on a preset voice assistant, waking up the voice assistant; In response to the voice command, identifying semantic information represented by the voice command based on the voice assistant; In the case where it is recognized that the semantic information represents navigation to the target destination address, determining whether the navigation application of the vehicle terminal has ever used the target destination address as a navigation destination; If the target destination address has been used as the navigation destination, the current location information is collected; When it is determined that there is a historical navigation path that takes the current location information as the navigation starting point and the target end address as the navigation end point, a navigation function from the navigation starting point to the target end address is performed according to the historical navigation path.

2. The method according to claim 1, characterized in that The determining whether the navigation application of the vehicle terminal has ever used the target destination address as the navigation destination includes: extracting a plurality of historical navigation paths from a preset navigation application when it is recognized that the semantic information represents navigation to a target destination address; Determine whether the navigation end points of multiple historical navigation paths are the same as the target end point address; If any one of them is the same, it is determined that the navigation application of the vehicle-mounted terminal has used the target destination address as the navigation destination.

3. The method according to claim 1, characterized in that If the target destination address has been used as the navigation destination, the current location information is collected, including: If the target destination address has been used as a navigation destination, outputting target prompt information for indicating navigation to the target destination address; If no negative operation on the target prompt information is received within the preset time, the current positioning information is collected.

4. The method according to claim 3, characterized in that: If the target destination address has been used as the navigation destination, outputting target prompt information for indicating navigation to the target destination address includes: If the target destination address has been used as the navigation destination, the voice playback is used to represent the target prompt information of navigating to the target destination address; If no negative operation on the target prompt information is received within the preset time, the current location information is collected, including: If no voice data indicating the negation of the target prompt information is received within a preset time period, the current location information is collected.

5. The method according to claim 1, characterized in that: After collecting the current location information, the method further includes: If there is no historical navigation path that uses the current location information as the navigation starting point and the target destination address as the navigation destination, then use the current location information as the navigation starting point and the target destination address as the navigation destination for path planning to obtain multiple currently planned paths; In response to a selection operation of a target planned path among the multiple current planned paths, a navigation function is performed according to the target planned path.

6. The method according to claim 1, characterized in that The method further comprises: If the target destination address has not been used as a navigation destination, searching for multiple address information associated with the target destination address based on a preset map database; In response to a selection operation of target address information among the plurality of address information, taking the target address information as a navigation destination; Collect current location information; The current location information is used as the navigation starting point, and the target destination address is used as the navigation destination to perform path planning, thereby obtaining multiple currently planned paths; In response to a selection operation of a target planned path among the multiple current planned paths, a navigation function is performed according to the target planned path.

7. The method according to any one of claims 1 to 6, characterized in that: The identifying of the semantic information represented by the voice command based on the voice assistant includes: Based on the voice assistant, the voice command is input into a pre-trained semantic recognition model to obtain semantic information represented by the voice command, wherein the semantic recognition model is trained by inputting multiple training samples into a network to be trained, and each training sample includes a historical voice command and corresponding semantic information.

8. A vehicle-mounted terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the vehicle-mounted terminal executes the method according to any one of claims 1 to 7.

9. A storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the computer is caused to perform the method according to any one of claims 1 to 7.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed, the vehicle-mounted terminal executes the method as claimed in any one of claims 1 to 7.

Images