Voice interaction method and device, vehicle and storage medium

Abstract

The invention provides a voice interaction method and device, a vehicle and a storage medium, and the method comprises the steps: obtaining a first voice instruction interacting with a user interface, and the first voice instruction is used for operating a target function; determining to enter a multi-round voice dialogue mode, and displaying an interactive interface of the target function in the multi-round voice dialogue mode; obtaining a first execution result of a first interaction event on the interaction interface, wherein the first interaction event is triggered through a touch operation on the interaction interface; and according to the first execution result, when it is determined that the voice dialogue process of the multi-round voice dialogue mode is continued, entering the next round of dialogue of the multi-round voice dialogue mode, so that whether the voice dialogue process is continued or not is judged through the first execution result, the performance of fusing voice interaction and manual touch interaction is improved, and the interaction experience is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a voice interaction method, device, vehicle and storage medium. Background Art

[0002] At present, with the development of intelligent transportation, the mode of human-computer interaction has gradually evolved from the manual operation of the Graphical User Interface (GUI) to the voice user interface (VUI), which has improved driving safety and convenience. In related technologies, during the voice interaction process, if the user manually operates the controls of the GUI page, the voice conversation will be interrupted and the GUI interaction process will be entered, reducing the flexibility of the interaction. Summary of the invention

[0003] The embodiments of the present disclosure at least provide a voice interaction method, device, vehicle and storage medium.

[0004] In a first aspect, an embodiment of the present disclosure provides a voice interaction method, including:

[0005] Obtaining a first voice instruction for interacting with a user interface, wherein the first voice instruction is used to operate a target function;

[0006] Determining to enter a multi-round voice dialogue mode, and displaying an interactive interface of the target function in the multi-round voice dialogue mode;

[0007] Obtaining a first execution result of a first interaction event on the interaction interface, where the first interaction event is triggered by a touch operation on the interaction interface;

[0008] According to the first execution result, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, the next round of dialogue of the multi-round voice dialogue mode is entered.

[0009] In an embodiment of the present disclosure, based on a first voice instruction, it is determined to enter a multi-round voice dialogue mode, and an interactive interface of the target function in the multi-round voice dialogue mode is displayed, and a first execution result of a first interactive event on the interactive interface is obtained, wherein the first interactive event is triggered by a touch operation on the interactive interface, and then according to the first execution result, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, the next round of dialogue in the multi-round voice dialogue mode is entered. In this way, in the multi-round voice dialogue mode, a touch operation is performed on the interactive interface, and whether to continue the multi-round voice dialogue process is determined by the first execution result corresponding to the touch operation. The implementation logic of voice interaction is also simpler, and voice interaction can be better integrated with GUI interaction. The voice interaction process will not be directly interrupted by manual touch operations, thereby improving the interaction flexibility and convenience, and also improving the user's interaction experience.

[0010] In an optional implementation, determining to continue the voice dialogue process of the multi-round voice dialogue mode according to the first execution result includes:

[0011] Determining, according to the first execution result, an operation to be executed corresponding to the first execution result, wherein the operation to be executed is used to trigger a second interaction event that is located after the first interaction event;

[0012] Determining whether the second interaction event belongs to the target interaction event associated with the multi-round voice dialogue mode, or determining whether the scene type corresponding to the second interaction event belongs to the target scene type associated with the multi-round voice dialogue mode;

[0013] If so, determine to continue the voice dialogue process of the multi-round voice dialogue mode.

[0014] In the disclosed embodiment, in the multi-round voice dialogue mode, the first execution result can be judged based on the first execution result of the touch operation. If the operation to be executed corresponding to the first execution result is still judged to belong to the target interaction event or target scene type associated with the voice party, then the touch operation will not interrupt the multi-round voice dialogue mode, and the language dialogue process can continue.

[0015] In an optional implementation, determining to continue the voice dialogue process of the multi-round voice dialogue mode according to the first execution result includes:

[0016] Determining whether the first execution result belongs to the target execution result of the target interaction event associated with the multi-round voice dialogue mode;

[0017] If so, determine to continue the voice dialogue process of the multi-round voice dialogue mode.

[0018] In the disclosed embodiment, the judgment efficiency can also be improved by judging that the first execution result belongs to the target execution result associated with the voice service, that is, continuing to maintain the multi-round voice dialogue mode.

[0019] In an optional implementation, after displaying the interactive interface of the target function in the multi-round voice dialogue mode, the method further includes:

[0020] Determine to enter the full-duplex waiting state of the multi-round voice dialogue mode;

[0021] If the first execution result is not obtained before the timing duration of the full-duplex waiting state is reached, the multi-round voice dialogue mode is terminated.

[0022] In the disclosed embodiment, the timing duration of the full-duplex waiting state for entering the multi-round voice conversation mode can be monitored to determine whether to end the multi-round voice conversation mode, thereby avoiding the problem of power consumption or resource performance consumption caused by the multi-round voice conversation mode being turned on for a long time while the user does not engage in voice conversation for a long time.

[0023] In an optional implementation manner, the method further includes:

[0024] When it is determined according to the first execution result that the voice conversation process of the multi-round voice conversation mode is no longer to be continued, maintaining the full-duplex waiting state;

[0025] After the timing duration of the full-duplex waiting state is reached, the multi-round voice dialogue mode is terminated; or, if a second voice instruction is received before the timing duration of the full-duplex waiting state is reached, it is determined to enter a new multi-round voice dialogue mode.

[0026] In the disclosed embodiment, based on the first execution result, when it is determined that the voice conversation process does not want to continue, a full-duplex waiting state can be maintained for a certain period of time. This can reduce the time it takes to enter the multi-round voice conversation mode when the voice is triggered again later, thereby improving the response speed.

[0027] In an optional implementation manner, obtaining a first execution result of a first interaction event on the interaction interface includes:

[0028] A callback interface for monitoring the first interactive event on the interactive interface, wherein the callback interface represents an interface registered for obtaining the execution result;

[0029] According to the monitoring result, a return value of the callback interface is obtained, where the return value is used to indicate a first execution result of the first interaction event.

[0030] In the disclosed embodiment, the first execution result can be monitored through a pre-registered interface, which is simple to implement and improves efficiency.

[0031] In an optional implementation manner, before determining to continue the voice dialogue process of the multi-round voice dialogue mode, the method further includes:

[0032] It is determined that the voice state corresponding to the multi-round voice dialogue mode is in an activated state.

[0033] In the disclosed embodiment, the first execution result and whether the voice state is in an activated state are combined to determine whether to continue the voice dialogue process, thereby improving the accuracy of the judgment and thus enhancing the voice interaction experience.

[0034] In a second aspect, an embodiment of the present disclosure further provides a voice interaction device, including a processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the processor is used to perform the following steps:

[0035] Obtaining a first voice instruction for interacting with a user interface, wherein the first voice instruction is used to operate a target function;

[0036] Determining to enter a multi-round voice dialogue mode, and displaying an interactive interface of the target function in the multi-round voice dialogue mode;

[0037] Obtaining a first execution result of a first interaction event on the interaction interface, where the first interaction event is triggered by a touch operation on the interaction interface;

[0038] According to the first execution result, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, the next round of dialogue of the multi-round voice dialogue mode is entered.

[0039] In a third aspect, an optional implementation of the present disclosure further provides a vehicle, which includes the device in the above-mentioned second aspect.

[0040] In a fourth aspect, an optional implementation of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the above-mentioned first aspect, or the steps in any possible implementation of the first aspect.

[0041] For a description of the effects of the above-mentioned voice interaction device, vehicle, and computer-readable storage medium, please refer to the description of the above-mentioned voice interaction method, which will not be repeated here.

[0042] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present disclosure.

[0043] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A flow chart of a voice interaction method provided by an embodiment of the present disclosure is shown;

[0045] Figure 2 A schematic diagram of a voice interaction device provided by an embodiment of the present disclosure is shown;

[0046] Figure 3 A schematic diagram of a vehicle provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0047] To facilitate the understanding of the technical solution of the present disclosure, the technical terms in the embodiments of the present disclosure are first explained:

[0048] Graphical User Interface (GUI): refers to a computer operation user interface that is displayed in graphical form. It is a dialogue interface between a computer and its user. Users can operate icons or menu options on the graphical user interface through methods such as mouse or finger touch.

[0049] Voice User Interface (VUI): refers to the voice interaction interface, which can realize voice interaction between people and computers. VUI does not need to have a specific visual interface and can be completely auditory or tactile, such as light flashing and vibration controlled by sound.

[0050] The human-computer interaction mode based on intelligent transportation tools has also gradually developed from the manual operation GUI interaction mode to the VUI interaction mode. The voice interaction mode of VUI makes vehicle driving more convenient and safer. In related technologies, for example, users establish a voice interaction process through voice wake-up commands, and then users can input voice control commands through voice. However, in this voice interaction process, if the user manually clicks on the GUI control, the voice interaction process will be interrupted and the GUI interaction process will be entered. In this solution, the VUI and GUI have a high coupling, and the VUI and GUI cannot be well integrated, which reduces the interaction flexibility and affects the convenience of voice interaction.

[0051] In order to solve the above problems, the present disclosure provides a solution for a voice interaction method, which includes obtaining a first voice instruction for interacting with a user interface, the first voice instruction being used to operate a target function; determining to enter a multi-round voice dialogue mode, and displaying an interactive interface of the target function in the multi-round voice dialogue mode, and then if a first interactive event is triggered by a touch operation on the interactive interface, a first execution result of the first interactive event on the interactive interface can be obtained, and according to the first execution result, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, the next round of dialogue in the multi-round voice dialogue mode is entered. In this way, when entering the multi-round voice dialogue mode, it is possible to determine whether to continue the multi-round voice dialogue mode by the first execution result corresponding to the touch operation, instead of interrupting the voice dialogue process upon receiving a manual touch operation. It is not subject to interference from manual operations, and only needs to monitor the first execution result to determine whether to continue the voice dialogue process, without real-time monitoring of various touch operations, and without the target function actively sending various touch operations to the voice party. It is also possible to achieve decoupling of function and voice, thereby improving interaction flexibility.

[0052] To facilitate understanding of this embodiment, the voice interaction method in the embodiment of the present disclosure is first described below. The execution subject of the voice interaction method provided in the embodiment of the present disclosure is generally a computer device with certain computing capabilities, and the computer device includes, for example: a vehicle-mounted terminal, a vehicle computer, a terminal device or other processing equipment. For example, in the application scenario of intelligent transportation tools, the intelligent transportation tools are, for example, electric vehicles, fuel vehicles, hybrid vehicles, etc. The vehicle computer represents the vehicle-mounted infotainment product installed in the vehicle, which can provide a variety of service functions and human-computer interaction functions, etc. The user can interact with the vehicle through the display device such as the vehicle screen, through the interaction method of GUI or VUI, to achieve control of the vehicle functions. The execution subject of the voice interaction method in the embodiment of the present disclosure can be the vehicle computer end of the vehicle. In addition, in some possible implementation methods, the voice interaction method can be implemented by a processor calling computer-readable instructions stored in a memory.

[0053] The following uses the vehicle terminal of the vehicle as an example to illustrate the voice interaction method provided by the embodiment of the present disclosure. Figure 1 FIG. 1 is a flow chart of a voice interaction method provided by an embodiment of the present disclosure, the method comprising:

[0054] S101: Obtain a first voice instruction for interacting with a user interface, where the first voice instruction is used to operate a target function.

[0055] One possible implementation method is that the target function can be a function in the target application, for example, the temperature adjustment function in the air conditioner. The operation of this function can be performed in the air conditioner application interface, or it can be operated on the function card displayed on the vehicle computer interface based on the activated functional component (without activating the air conditioner application).

[0056] S102: Determine to enter the multi-round voice dialogue mode, and display an interactive interface of a target function in the multi-round voice dialogue mode.

[0057] In the disclosed embodiment, it is mainly aimed at the application scenario of intelligent transportation tools, and supports a multi-round voice dialogue mode. The multi-round voice dialogue mode means that multiple rounds of dialogues can be carried out, and only one wake-up is required. For example, the user can input a first voice command through the vehicle voice assistant, such as "Please turn on target function A", and then enter a new round of dialogue in the multi-round voice dialogue mode. The trigger of the multi-round voice dialogue mode can be the timing duration that triggered the voice dialogue process at least once before and did not reach the full-duplex waiting state. Then, the dialogue management module can trigger the opening of the target function A and display the interactive interface of the target function A based on the semantic understanding and analysis of the first voice command.

[0058] S103: Obtain a first execution result of a first interaction event on the interaction interface, where the first interaction event is triggered by a touch operation on the interaction interface.

[0059] Specifically for step S103, the present disclosure provides a possible implementation method, including: monitoring the callback interface of the first interactive event on the interactive interface, the callback interface represents the interface registered for obtaining the execution result; according to the monitoring result, obtaining the return value of the callback interface, the return value is used to indicate the first execution result of the first interactive event.

[0060] For example, a corresponding callback interface can be pre-set and registered for a target function in a target application. By listening to the return value of the callback interface, the first execution result of the first interaction event associated with the target function can be obtained. In addition, some target functions usually have limited execution results that need to be listened to. Therefore, the corresponding callback interface can be pre-registered according to demand, and the return value can be listened to through the corresponding callback interface to obtain the corresponding first execution result.

[0061] Among them, since the first interaction event is triggered by a touch operation on the interactive interface of the target function, the first execution result is usually also generated by the application service, wherein the application service can be understood as a module that provides background services for the target function. For example, after receiving the first interaction event input through a touch operation on the interactive interface of the target function, the application service can perform corresponding processing based on the first interaction event to obtain the first execution result. For example, if the target function is the navigation function in the map, and the first interaction event is clicking a navigation button to a certain place, the first execution result can be a successful route planning and a planned navigation route.

[0062] In the above process, in the embodiment of the present disclosure, the voice service can actively monitor the first execution result from the application service in real time, wherein the voice service can be understood as a module that provides background services for the voice function, and then after the application service generates the first execution result for the first interaction event, the voice service can also obtain the first execution result of the first interaction event.

[0063] It should be noted that the voice service in the disclosed embodiment does not need to care what the first interaction event is, nor does it need to care whether the first interaction event is triggered by voice or manual click. It only needs to monitor the first execution result, and then can determine whether to continue the multi-round voice dialogue mode based on the first execution result, thereby reducing the coupling between the application service and the voice service, and also reducing the access threshold and cost of application developers.

[0064] In this way, the ability to obtain the required data can be transferred from the method of active notification by the application service to active monitoring and acquisition by the voice service. The application service does not need to actively inform the voice service of various touch operations, thereby reducing the dependence of the voice service on the application service and realizing the decoupling of the application service and the voice service. The voice service does not need to monitor touch operations or interaction events, but only cares about the first execution result, and the implementation logic is simpler.

[0065] S104: According to the first execution result, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, entering the next round of dialogue in the multi-round voice dialogue mode.

[0066] The following specifically describes how to determine whether to continue the voice dialogue process of the multi-round voice dialogue mode according to the first execution result. In the disclosed embodiment, after obtaining the first execution result of the first interaction event, it can be determined whether to continue the voice dialogue process of the multi-round voice dialogue mode to avoid the situation where the manual touch operation directly interrupts the voice interaction process.

[0067] Specifically, with respect to determining the voice dialogue process of continuing the multi-round voice dialogue mode according to the first execution result, the present disclosure provides several possible implementations, including:

[0068] In one possible implementation, determining the voice conversation process of continuing the multi-round voice conversation mode based on the first execution result includes: 1) determining the operation to be executed corresponding to the first execution result based on the first execution result, the operation to be executed is used to trigger a second interaction event located after the first interaction event; 2) determining whether the second interaction event belongs to the target interaction event associated with the multi-round voice conversation mode, or determining whether the scene type corresponding to the second interaction event belongs to the target scene type associated with the multi-round voice conversation mode; 3) if so, determining to continue the voice conversation process of the multi-round voice conversation mode.

[0069] Among them, the target interaction event or target scene type associated with the multi-round voice dialogue mode can be set in advance. For example, the target scene type associated with the voice service can be set to include a navigation scene, or a specific detailed scene under the navigation scene, etc., without limitation.

[0070] For example, the user uses voice to turn on the navigation function in the map application, enters the multi-round voice dialogue mode, and displays the interactive interface of the navigation function. If the user clicks on the route calculation icon through touch operation in the interactive interface, the first execution result of success or failure of the route calculation can be obtained through the route calculation processing. If the first execution result is that the route calculation is successful, the calculated multiple candidate paths can be displayed to the user. If the path selection event from multiple candidate paths is pre-set as an event responded to by the voice service, that is, it is a target interaction event associated with the multi-round dialogue mode, then it can be determined that the voice dialogue process needs to continue.

[0071] In this way, when the second interaction event corresponding to the first execution result of the touch operation is judged to be still associated with the voice service, the multi-round voice dialogue mode can be maintained to avoid manual touch operation interrupting the multi-round voice dialogue mode. Afterwards, voice interaction can still be directly carried out without restarting the multi-round voice dialogue mode, thereby improving efficiency and interactive experience.

[0072] In another possible embodiment, determining to continue the voice conversation process of the multi-round voice conversation mode based on the first execution result includes: determining whether the first execution result belongs to the target execution result of the target interaction event associated with the multi-round voice conversation mode; if so, determining to continue the voice conversation process of the multi-round voice conversation mode.

[0073] Specifically, in the embodiments of the present disclosure, an association list corresponding to the voice service can be set, and the association list includes multiple target interaction events or multiple target execution results. For different applications or functions, the voice service needs to pay attention to which target interaction events and their target execution results, which can be pre-set based on experience and needs. For example, for in-vehicle entertainment functions, search results of search interaction events associated with music, video, etc., playback control events, etc. can be pre-set as target interaction events or target execution results that the voice service needs to pay attention to.

[0074] Furthermore, in the embodiments of the present disclosure, for the target execution results of the target interaction events that need attention, the interface functions of the corresponding callback interfaces can be pre-defined, and the caller of the interface functions can be set as the voice service to register the corresponding callback interfaces to the voice service. The voice service needs to monitor or respond to the first execution results of the functions, and the corresponding callback interfaces can be pre-registered to the voice service. The voice service can then actively monitor these callback interfaces to obtain the first execution results. In this way, if it is determined that the first execution results correspond to these callback interfaces of interest, it can be determined that they are the target execution results of the target interaction events associated with the multi-round voice dialogue mode, and the voice dialogue process of the multi-round voice dialogue mode can be determined to continue.

[0075] Furthermore, in the embodiments of the present disclosure, in order to further enhance the interactive experience of voice and manual touch, the waiting countdown method of the multi-round voice dialogue mode can also be combined to avoid the multi-round voice mode being started all the time without any triggering operation, which can reduce performance consumption. Specifically, the present disclosure also provides possible implementation methods:

[0076] 1) In one possible implementation, after displaying the interactive interface of the target function in the multi-round voice dialogue mode, it can also be determined to enter the full-duplex waiting state of the multi-round voice dialogue mode; if the first execution result is not obtained before the timing duration of the full-duplex waiting state is reached, the multi-round voice dialogue mode is terminated.

[0077] For example, the preset timing duration of the full-duplex waiting state is 10 seconds. In the multi-round voice dialogue mode, the user initiates a round of dialogue, enters the first voice command "Please play a song", plays the song and displays the interactive interface associated with the song on the vehicle display screen, and enters the full-duplex waiting state at the same time. Within 10 seconds after the end of this round of dialogue, if no new voice command is received and no first execution result corresponding to the touch operation on the interactive interface is obtained, the multi-round voice dialogue mode is terminated.

[0078] In the embodiment of the present disclosure, based on the first voice command, a multi-round voice dialogue mode is entered, and after the interactive interface of the target function in the multi-round voice dialogue mode is displayed, a full-duplex waiting state is entered. The full-duplex waiting state indicates a countdown wait. If the first execution result is not obtained during the full-duplex waiting state, the multi-round voice dialogue mode can be terminated. At this time, the multi-round voice dialogue mode will enter an inactive state and will no longer respond to voice or touch operations. If the user needs to use the voice service subsequently, it needs to be woken up again.

[0079] 2) In one possible implementation, when it is determined based on the first execution result that the voice conversation process of the multi-round voice conversation mode is no longer to be continued, the full-duplex waiting state is maintained; after the timing duration of the full-duplex waiting state is reached, the multi-round voice conversation mode is ended; or, if a second voice instruction is received before the timing duration of the full-duplex waiting state is reached, it is determined to enter a new multi-round voice conversation mode.

[0080] In this embodiment, when it is determined based on the first execution result that the voice conversation process of the multi-round voice conversation mode is no longer to be continued, the full-duplex waiting state is still maintained and the waiting is maintained for a period of time. In this way, if there are voice instructions or other target execution results associated with the multi-round voice conversation mode before the timing period is reached, the voice service can still be used to improve efficiency, thereby enhancing the user interaction experience.

[0081] Furthermore, in the embodiment of the present disclosure, based on the timing duration of the full-duplex waiting state, before determining to continue the voice dialogue process of the multi-round voice dialogue mode, the embodiment of the present disclosure also needs to determine that the voice state corresponding to the multi-round voice dialogue mode is in an activated state.

[0082] In this way, by judging the voice state and the first execution result, if the voice is in an activated state and needs to respond to or process the first execution result, the voice conversation process of the multi-round voice conversation mode can continue to be maintained and enter the next round of conversation without interrupting the voice conversation process due to manual touch operations, thereby improving the user interaction experience.

[0083] Of course, in the disclosed embodiment, if the voice state corresponding to the current multi-round voice dialogue mode is in an inactive state, the voice dialogue process of the multi-round voice dialogue mode will not be continued, and the GUI process can be executed to avoid suddenly entering the voice dialogue process for voice playback and affecting the user interaction experience, which is not in line with the actual voice interaction scenario.

[0084] In addition, in the embodiment of the present disclosure, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, the next round of dialogue in the multi-round voice dialogue mode can be entered. At this time, the present disclosure also provides a possible implementation method, playing voice guidance information, wherein the voice guidance information can be understood as information guiding the subsequent voice dialogue, such as question information, result prompt information, etc., which is not limited. Specifically, the present disclosure also provides several possible implementation methods:

[0085] 1) A possible implementation method is to perform semantic analysis on the first execution result to determine the intention information when determining to continue the voice dialogue process of the multi-round voice dialogue mode; determine the voice guidance information corresponding to the intention information based on the intention information, and enter the next round of dialogue in the multi-round voice dialogue mode.

[0086] In the disclosed embodiment, when determining to continue the voice conversation process of the multi-round voice conversation mode, the intention information after obtaining the first execution result can be determined based on the first execution result. Specifically, based on the trained intention model, the first execution result can be input into the intention model, and the first execution result can be semantically analyzed to obtain the intention information corresponding to the first execution result. For example, it can be determined what the user wants to do after obtaining the first execution result, and then the voice guidance information corresponding to the intention information can be played to guide the user to the next round of voice conversation.

[0087] For example, a user opens a map application, searches for a location through voice commands, and displays a list of locations in the interactive interface. The user can manually click or use voice commands to select one of the locations for navigation. The voice service will obtain a first execution result, which is a navigation result. The first execution result determines that the current voice state is an activated state, and determines to continue the voice dialogue process of the multi-round voice dialogue mode. Then, by performing an intent analysis on the first execution result, the voice guidance information corresponding to the first execution result is obtained. The voice guidance information may be "A route has been planned for you, start navigation". For the user, the navigation result page is displayed to the user and the voice guidance information can be played at the same time.

[0088] 2) Another possible implementation method is to determine the voice dialogue process of continuing the multi-round voice dialogue mode, determine the voice guidance information corresponding to the first execution result according to the mapping relationship between the preset execution result and the voice guidance information, and enter the next round of dialogue in the multi-round voice dialogue mode.

[0089] That is, in the embodiment of the present disclosure, the mapping relationship between each first execution result and the voice guidance information can be pre-set, and different first execution results can play different voice guidance information. Then, according to the mapping relationship, the corresponding voice guidance information can be directly obtained for playback, which is relatively simple to implement and highly efficient.

[0090] Furthermore, after playing the voice guidance information corresponding to the first execution result, the embodiment of the present disclosure can also obtain voice instructions based on the voice guidance information feedback, generate control information based on the voice instructions, and send the control information to the corresponding control device of the vehicle. The control information is used to control the vehicle through the control device, thereby realizing voice control of the vehicle, for example, lowering the playback volume, closing the driver's window, etc.

[0091] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0092] Based on the same inventive concept, a voice interaction device corresponding to the voice interaction method is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the voice interaction device in the embodiment of the present disclosure is similar to the above-mentioned voice interaction method in the embodiment of the present disclosure, the specific implementation of the device can refer to the implementation method of the above-mentioned method, and the repeated parts will not be repeated.

[0093] See also Figure 2 As shown, it is a schematic diagram of a voice interaction device provided by an embodiment of the present disclosure, and the device includes: a processor 21 and a memory 22; the memory 22 stores machine-readable instructions executable by the processor 21, and the processor 21 is used to execute the machine-readable instructions stored in the memory 22. When the machine-readable instructions are executed by the processor 21, the processor 21 is used to perform the following steps:

[0094] Obtaining a first voice instruction for interacting with a user interface, wherein the first voice instruction is used to operate a target function;

[0095] Determining to enter a multi-round voice dialogue mode, and displaying an interactive interface of the target function in the multi-round voice dialogue mode;

[0096] Obtaining a first execution result of a first interaction event on the interaction interface, where the first interaction event is triggered by a touch operation on the interaction interface;

[0097] According to the first execution result, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, the next round of dialogue of the multi-round voice dialogue mode is entered.

[0098] In an optional embodiment, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode according to the first execution result, the processor 21:

[0099] Determining, according to the first execution result, an operation to be executed corresponding to the first execution result, wherein the operation to be executed is used to trigger a second interaction event that is located after the first interaction event;

[0100] Determining whether the second interaction event belongs to the target interaction event associated with the multi-round voice dialogue mode, or determining whether the scene type corresponding to the second interaction event belongs to the target scene type associated with the multi-round voice dialogue mode;

[0101] If so, determine to continue the voice dialogue process of the multi-round voice dialogue mode.

[0102] In an optional embodiment, when determining to continue the voice dialogue process of the multi-round voice dialogue mode according to the first execution result, the processor 21 is configured to:

[0103] Determine whether the first execution result belongs to the target execution result of the target interaction event associated with the multi-round voice dialogue mode; if so, determine to continue the voice dialogue process of the multi-round voice dialogue mode.

[0104] In an optional embodiment, after displaying the interactive interface of the target function in the multi-round voice dialogue mode, the processor 21 is further configured to:

[0105] Determine to enter the full-duplex waiting state of the multi-round voice dialogue mode;

[0106] If the first execution result is not obtained before the timing duration of the full-duplex waiting state is reached, the multi-round voice dialogue mode is terminated.

[0107] In an optional embodiment, the processor 21 is further configured to:

[0108] When it is determined according to the first execution result that the voice conversation process of the multi-round voice conversation mode is no longer to be continued, maintaining the full-duplex waiting state;

[0109] After the timing duration of the full-duplex waiting state is reached, the multi-round voice dialogue mode is terminated; or, if a second voice instruction is received before the timing duration of the full-duplex waiting state is reached, it is determined to enter a new multi-round voice dialogue mode.

[0110] In an optional embodiment, obtaining a first execution result of a first interaction event on the interaction interface includes:

[0111] A callback interface for monitoring the first interactive event on the interactive interface, wherein the callback interface represents an interface registered for obtaining the execution result;

[0112] According to the monitoring result, a return value of the callback interface is obtained, where the return value is used to indicate a first execution result of the first interaction event.

[0113] In an optional embodiment, before determining to continue the voice dialogue process of the multi-round voice dialogue mode, the processor 21 is further used to: determine that the voice state corresponding to the multi-round voice dialogue mode is in an activated state.

[0114] The above-mentioned memory 22 includes internal memory 221 and external memory 222; the memory 221 here is also called internal memory, which is used to temporarily store the calculation data in the processor 21, as well as the data exchanged with the external memory 222 such as the hard disk. The processor 21 exchanges data with the external memory 222 through the internal memory 221.

[0115] The specific execution process of the above instructions can refer to the steps of the voice interaction method described in the embodiment of the present disclosure, which will not be repeated here.

[0116] The description of the processing flow of each component in the device and the interaction flow between each component does not mean any limitation on the implementation process by strict processing flow and interaction flow. The processing flow and interaction flow of each component should be determined by its function and possible internal logic.

[0117] See also Figure 3 , which is a schematic diagram of a vehicle provided in an embodiment of the present disclosure, and the vehicle includes the voice interaction device in the above embodiment.

[0118] In the disclosed embodiment, the interactive interface of the target function can be displayed through the screen of the vehicle, wherein the screen of the vehicle can also be divided into multiple areas, such as a central control screen, a main screen, a secondary screen, etc., without limitation, and a voice assistant can be installed in the vehicle system, and the user can interact with the vehicle through touch or voice. For example, the user can input a voice command "open the door", and the voice assistant generates a control command based on the voice command and sends it to the controller of the vehicle, and the controller of the vehicle can control the door of the vehicle to open.

[0119] In practice, when interacting with the vehicle, the user may alternate between touch and voice based on habit or convenience. For example, the user may use voice to open multimedia music, and then manually touch and click on the list to select and play. In the disclosed embodiment, the first execution result of the touch selection and playback event can be used to determine whether to continue the voice dialogue process of the multi-round voice dialogue mode. When it is determined to continue, the next round of dialogue in the multi-round voice dialogue mode is entered, and the corresponding voice guidance information can also be played to guide the user to the next round of dialogue, thereby improving the user's interactive experience.

[0120] The present disclosure also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the voice interaction method described in the above method embodiment are executed. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0121] The present disclosure also provides a computer program product on which a computer program is stored. When the computer program is executed by a processor, the steps of the voice interaction method described in the above method embodiment are implemented. For details, please refer to the above method embodiment, which will not be repeated here.

[0122] The method in the present application can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed on a computer, the process or function described in the present application is executed in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, a core network device, an operation administration and maintenance (OAM) or other programmable device or other programmable device.

[0123] The computer program or instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid-state drive. The computer-readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.

[0124] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0125] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0126] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0127] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0128] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A voice interaction method, characterized in that: include: Obtaining a first voice instruction for interacting with a user interface, wherein the first voice instruction is used to operate a target function; Determining to enter a multi-round voice dialogue mode, and displaying an interactive interface of the target function in the multi-round voice dialogue mode; Obtaining a first execution result of a first interaction event on the interaction interface, where the first interaction event is triggered by a touch operation on the interaction interface; According to the first execution result, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, the next round of dialogue of the multi-round voice dialogue mode is entered.

2. The method according to claim 1, characterized in that Determining, according to the first execution result, to continue the voice dialogue process of the multi-round voice dialogue mode includes: Determining, according to the first execution result, an operation to be executed corresponding to the first execution result, wherein the operation to be executed is used to trigger a second interaction event that is located after the first interaction event; Determining whether the second interaction event belongs to the target interaction event associated with the multi-round voice dialogue mode, or determining whether the scene type corresponding to the second interaction event belongs to the target scene type associated with the multi-round voice dialogue mode; If so, determine to continue the voice dialogue process of the multi-round voice dialogue mode.

3. The method according to claim 1, characterized in that Determining, according to the first execution result, to continue the voice dialogue process of the multi-round voice dialogue mode includes: Determining whether the first execution result belongs to the target execution result of the target interaction event associated with the multi-round voice dialogue mode; If so, determine to continue the voice dialogue process of the multi-round voice dialogue mode.

4. The method according to any one of claims 1 to 3, characterized in that: After displaying the interactive interface of the target function in the multi-round voice dialogue mode, the method further includes: Determine to enter the full-duplex waiting state of the multi-round voice dialogue mode; If the first execution result is not obtained before the timing duration of the full-duplex waiting state is reached, the multi-round voice dialogue mode is terminated.

5. The method according to claim 4, characterized in that The method further comprises: When it is determined according to the first execution result that the voice conversation process of the multi-round voice conversation mode is no longer to be continued, maintaining the full-duplex waiting state; After the timing duration of the full-duplex waiting state is reached, the multi-round voice dialogue mode is terminated; or, if a second voice instruction is received before the timing duration of the full-duplex waiting state is reached, it is determined to enter a new multi-round voice dialogue mode.

6. The method according to claim 1, characterized in that The obtaining a first execution result of the first interaction event on the interaction interface includes: A callback interface for monitoring the first interactive event on the interactive interface, wherein the callback interface represents an interface registered for obtaining the execution result; According to the monitoring result, a return value of the callback interface is obtained, where the return value is used to indicate a first execution result of the first interaction event.

7. The method according to claim 1, characterized in that Before determining to continue the voice dialogue process of the multi-round voice dialogue mode, the method further includes: It is determined that the voice state corresponding to the multi-round voice dialogue mode is in an activated state.

8. A voice interaction device, characterized in that: The invention comprises a processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the processor is used to perform the following steps: Obtaining a first voice instruction for interacting with a user interface, wherein the first voice instruction is used to operate a target function; Determining to enter a multi-round voice dialogue mode, and displaying an interactive interface of the target function in the multi-round voice dialogue mode; Obtaining a first execution result of a first interaction event on the interaction interface, where the first interaction event is triggered by a touch operation on the interaction interface; According to the first execution result, when it is determined to continue the voice dialogue process of the multi-round voice dialogue mode, the next round of dialogue of the multi-round voice dialogue mode is entered.

9. A vehicle, characterized in that: The vehicle includes the voice interaction device as claimed in claim 8.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images