Voice interaction method and device, vehicle and computer storage medium

Abstract

The invention provides a voice interaction method and device, a vehicle and a computer storage medium, and the method comprises the steps: receiving a display instruction for displaying a first page; the first page is a page supporting a visible speaking function; determining a first control to be updated according to the page information of the first page; the first control supports an operation instruction of a first type; when the first page is displayed, updating the first control to be updated into a second control; the second control supports the operation instruction of the first type and the operation instruction of the second type, and the second control is used for sending the operation instruction of the first type to the corresponding application module based on the received operation instruction.

Description

Technical Field

[0001] The present disclosure relates to the field of voice processing technology, and in particular to a voice interaction method, device, vehicle and computer storage medium. Background Art

[0002] With the development of voice processing technology, voice is increasingly being used in cars. Users can control the vehicle without contact by interacting with the in-vehicle voice system.

[0003] Normally, users need to manually turn on the barrier-free mode. Only after the vehicle turns on the barrier-free mode can users interact with the in-vehicle voice system. Summary of the invention

[0004] The embodiments of the present disclosure at least provide a voice interaction method, device, vehicle and computer storage medium.

[0005] In a first aspect, an embodiment of the present disclosure provides a voice interaction method, including:

[0006] Receiving a display instruction for displaying a first page; the first page is a page that supports a visible and talkable function;

[0007] Determining a first control to be updated according to the page information of the first page; the first control supports a first type of operation instruction;

[0008] When displaying the first page, the first control to be updated is updated to a second control; the second control supports the first type of operation instructions and the second type of operation instructions, and the second control is used to send the first type of operation instructions to the corresponding application module based on the received operation instructions.

[0009] By adopting the above-mentioned voice interaction method, when the current page (first page) is opened on the vehicle interface, the first control of the first page can be replaced with the second control. Taking the first control as a native control and the second control as a custom control as an example, the difference between the custom control and the native control is that the native control can only support interface triggering (first type of operation instructions), while the custom control can simultaneously support interface triggering and voice triggering (second type of operation instructions); supporting voice triggering can be understood as: after receiving a voice triggering instruction carrying the custom control identifier, a trigger signal simulating the interface triggering can be generated. Therefore, the voice interaction method can realize automatic support for voice triggering for the function in the currently opened page, without the need to manually switch between normal mode and voice mode, thereby realizing automatic voice interaction function.

[0010] In addition, the control replacement of the embodiment of the present disclosure is for the currently displayed page, that is, only the currently displayed page needs to support voice triggering. Since the user generally does not initiate voice triggering without seeing the page function, the embodiment of the present disclosure can also reduce the voice monitoring burden to a certain extent and reduce the monitoring errors caused by too many monitoring functions.

[0011] In a possible implementation, determining the first control to be updated according to the page information of the first page includes:

[0012] Determining, according to the page information of the first page, a first control indicated by the page information;

[0013] Determine a target first control according to the first control indicated by the page information, wherein the target first control corresponds to a second control;

[0014] According to the target first control, the first control to be updated is determined.

[0015] In the above implementation, according to the page information of the first page, the native control (target first control) corresponding to the custom control (second control) can be determined as the first control to be updated, so that the first control to be updated can be updated to the second control.

[0016] In a possible implementation, the first type of operation instruction includes an interface trigger instruction, and the second type of operation instruction includes a voice trigger instruction; after updating the first control to be updated to the second control, the method further includes:

[0017] Receive voice trigger commands from users;

[0018] Determine, according to a mapping relationship between the second control and the voice trigger instruction, a target second control to be triggered by the voice trigger instruction;

[0019] According to the voice trigger instruction and the target second control, an interface trigger instruction for the target second control is generated, and the generated interface trigger instruction is sent to an application module corresponding to the target second control.

[0020] In the above implementation, after the first control to be updated is updated to the second control, by receiving the user's voice trigger instruction and after the voice trigger instruction hits the target second control, an interface trigger instruction for the target second control can be generated, and then the application module can be controlled to execute the operation instruction through simulation triggering; the above process realizes that the application module can be controlled to execute the operation instruction when the user only needs to issue a voice trigger instruction without touching the page on the vehicle screen, thereby realizing a visible and speakable service.

[0021] In a possible implementation, the second control includes a second control for monitoring and registering a first processing function; the first processing function is determined based on a processing function corresponding to the first page; and the method further includes:

[0022] A first indication message is sent to a voice processing module of the vehicle, where the first indication message is used to instruct voice monitoring of the first processing function.

[0023] In the above implementation, sending the first indication information to the voice processing module can enable the voice processing module to perform relevant voice monitoring on the registered first processing function. On the one hand, it can avoid confusion during voice command processing (too many enabled custom controls make it difficult to distinguish them), and on the other hand, it can reduce resource consumption, only provide voice monitoring processing services for registered functions, and more accurately generate a second control that is triggered by the user's voice information indication.

[0024] In a possible implementation, the method further includes:

[0025] When the first condition is met, the first processing function is monitored and deregistered, and second indication information is sent to the voice processing module, where the second indication information is used to indicate the cancellation of voice monitoring of the first processing function.

[0026] In a possible implementation manner, the first condition includes at least one of the following:

[0027] The first page is adjusted to an invisible state;

[0028] The duration of voice monitoring exceeds a first threshold;

[0029] The monitoring duration of the voice monitoring exceeds the second threshold, and no voice trigger instruction is received.

[0030] In the above implementation, when the first page is invisible, or the monitoring time of voice monitoring exceeds the first threshold, or the monitoring time of voice monitoring exceeds the second threshold, and no voice trigger instruction is received, the first processing function of the first page can be monitored and unregistered, and the function of the custom control and voice monitoring can be provided only for the processing function that may be triggered by the user, thereby reducing resource consumption.

[0031] In a possible implementation manner, after monitoring and deregistering the first processing function, the method further includes:

[0032] The second control corresponding to the first processing function is updated to the first control.

[0033] In the above implementation, after the first processing function is monitored and unregistered, the second control corresponding to the first processing function is updated to the first control, that is, the state in which the interface trigger instruction controls the first control can be restored, which can reduce resource consumption.

[0034] In a possible implementation, updating the first control to be updated to the second control includes:

[0035] The first calling method corresponding to the first control to be updated is updated to the second calling method corresponding to the second control; the first calling method is used to respond to a first type of operation instruction, and the second calling method is used to respond to a first type of operation instruction and a second type of operation instruction.

[0036] In the above implementation, by changing the calling relationship, the first calling method corresponding to the first control to be updated is updated to the second calling method corresponding to the second control, so that the second control can be called after receiving the second type of operation instruction.

[0037] In a second aspect, an embodiment of the present disclosure further provides a voice interaction device, including: a control management module, an application module and a display module, wherein:

[0038] The display module is used to receive a display instruction for displaying a first page, display the first page, and notify the control management module of the page information of the first page; the first page is a page that supports the visible and talkable function;

[0039] The control management module is used to determine a first control to be updated according to the page information of the first page; the first control supports a first type of operation instruction; when displaying the first page, the first control to be updated is updated to a second control; the second control supports a first type of operation instruction and a second type of operation instruction, and the second control is used to send the first type of operation instruction to the corresponding application module based on the received operation instruction;

[0040] The application module is used to execute the received operation instruction of the first type.

[0041] In a possible implementation manner, the second type of operation instruction includes a voice trigger instruction; and the device further includes:

[0042] The voice processing module is used to receive the user's voice trigger instruction; determine the target second control that is triggered by the voice trigger instruction according to the mapping relationship between the second control and the voice trigger instruction; and transmit the identification information of the target second control to the visible and speakable module;

[0043] The visible and speakable module is used to receive the identification information of the target second control based on the data links established with the voice processing module and the control management module respectively, and transmit the identification information of the target second control to the control management module;

[0044] The control management module is used to control the target second control to execute the corresponding calling method to generate the first type of operation instruction, and send the first type of operation instruction to the application module.

[0045] In a third aspect, an embodiment of the present disclosure further provides a vehicle, comprising: a voice interaction device as described in the second aspect, or any embodiment of the second aspect.

[0046] In a fourth aspect, an embodiment of the present disclosure further provides a computer storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the voice interaction method described in the first aspect or any embodiment of the first aspect are executed.

[0047] The beneficial effects of the second to fourth aspects mentioned above can be found in the previous description of the voice interaction method and will not be repeated here.

[0048] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 A schematic diagram of the structure of a voice interaction device provided by an embodiment of the present disclosure is shown;

[0050] Figure 2 A workflow diagram of a voice interaction device provided by an embodiment of the present disclosure is shown;

[0051] Figure 3 A workflow diagram of another voice interaction device provided by an embodiment of the present disclosure is shown;

[0052] Figure 4 A flow chart of a voice interaction method provided by an embodiment of the present disclosure is shown;

[0053] Figure 5 A schematic diagram of a computer device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure more clear, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure.

[0055] During the process of voice interaction between the user and the in-vehicle voice system, the auxiliary mode service of the in-vehicle application is usually manually triggered on the settings page. The in-vehicle voice system will send a broadcast to the auxiliary mode management service module. After receiving the broadcast information, the auxiliary mode management service module can bind the auxiliary mode service to enable the auxiliary mode service. However, the above process requires manual activation of the auxiliary mode service, and the in-vehicle application cannot distinguish between voice triggering and manual triggering, resulting in the above voice interaction process being unable to achieve the automatic voice interaction function.

[0056] Based on this, the embodiment of the present disclosure provides a voice interaction device, which can be applied to a vehicle. The voice interaction device can be used to control the vehicle by voice.

[0057] To facilitate understanding of this embodiment, a voice interaction device provided by the embodiment of the present disclosure is first described in detail. Figure 1 The voice interaction device 100 shown in the embodiment of the present disclosure divides the voice interaction device 100 into: a display module 101, a control management module 102, and an application module 103 from a functional perspective.

[0058] The display module 101 is used to receive a display instruction for displaying a first page, display the first page, and notify the control management module 102 of the page information of the first page; the first page is a page that supports the visible and talkable function.

[0059] The control management module 102 is used to determine the first control to be updated based on the page information of the first page; the first control supports the first type of operation instructions; when displaying the first page, the first control to be updated is updated to the second control; the second control supports the first type of operation instructions and the second type of operation instructions, and the second control is used to send the first type of operation instructions to the corresponding application module 103 based on the received operation instructions.

[0060] The application module 103 is configured to execute the received operation instruction of the first type.

[0061] The workflow diagram of the voice interaction device 100 provided in the embodiment of the present disclosure can be found in Figure 2 In the voice interaction device 100 provided in the embodiment of the present disclosure, various pages in the vehicle-mounted application can be displayed through the vehicle-mounted screen. The first page displayed by the display module 101 can be any function page opened by the user on the vehicle-mounted screen, and specifically can be any page in the vehicle-mounted application, such as a new page opened in the vehicle-mounted application, or a previous page returned.

[0062] The display instruction for displaying the first page may be a first type of operation instruction input by the user. The first type of operation instruction here may include an interface trigger instruction, that is, an instruction for the user to manually trigger the interface.

[0063] The display instruction for displaying the first page may be a second type of operation instruction input by the user. The second type of operation instruction here may include a voice trigger instruction, that is, an instruction for triggering the interface through voice. For example, the user wants to return to the previous page or open the next page. At this time, the page information of the current page is displayed on the vehicle screen. The display module 101 can notify the control management module 102 of the page information of the current page. The control management module 102 determines the first control to be updated based on the page information of the current page, and updates the first control to be updated to the second control when displaying the current page; the second control sends an interface trigger instruction to the application module 103 based on the received voice trigger instruction, and the application module 103 executes the received interface trigger instruction to return to the previous page or open the next page, that is, the first page. According to the page information of the current page, the process of displaying the first page can be seen in the description below.

[0064] The page information of the first page may include display information of each page element in the first page. The page elements may include window controls, text controls, button controls, image controls, conversion controls, progress bar controls, etc., and the display information may include information such as display positions and display characteristics of the page elements. The page information of the first page may be obtained through the installation package of the vehicle-mounted application or the information storage directory of the operating system, and the method for obtaining the page information may not be specifically limited.

[0065] The first page may support a visible and audible function. The visible and audible function may be understood as a function in which the controls displayed on the first page can be controlled by voice triggering instructions to realize voice interaction between the user and the voice interaction device.

[0066] like Figure 2 As shown, the first page may correspond to various processing functions. Each processing function corresponding to the first page may convert the trigger instruction input for the first page into a task to be completed for output, such as a function of adjusting the air conditioning temperature, a function of turning on the lights, a function of playing music, etc. A page may correspond to at least one processing function, and different pages may correspond to different processing functions.

[0067] The processing function can be associated with at least one first control. Each first control can implement different sub-processing functions under the processing function. For example, the function of adjusting the air conditioning temperature can specifically include sub-processing functions such as raising the air conditioning temperature, lowering the air conditioning temperature, and adjusting the wind direction, so the associated first control can include controls such as the increase button, the decrease button, and the wind direction adjustment button; the function of playing music can specifically include sub-processing functions such as play, pause, switch to the next song, switch to the previous song, and fast forward, so the associated first control can include controls such as the play / pause button, the next song button, the previous song button, and the progress bar; the function of turning on the lights can specifically include sub-functions such as selecting the lights and adjusting the brightness, so the associated first control can include controls such as the light selection button and the brightness adjustment button.

[0068] like Figure 2 As shown, the application module 103 may indicate an in-vehicle application. The in-vehicle application may be integrated with the control management module 102, i.e., a unified layer. The unified layer may provide a general encapsulated application programming interface (Application Programming Interface, API), and also includes a page parsing module, a page base class module, a module for providing custom controls, and a module for reflecting calls to processing functions.

[0069] The page parsing module may include a view parser, which may parse the page information in the first page and determine at least one first control associated with the processing function in the first page.

[0070] The page base class module may include a processing function registration module and a processing function deregistration module. The function registration module may register the processing function in the first page, and the processing function deregistration module may deregister the processing function in the first page. In a specific implementation, after determining the first control associated with each processing function, the processing function registration module may perform monitoring registration for each processing function. The processing function deregistration module may perform monitoring deregistration on the first processing function that is monitored and registered when the first condition is met, and the specific process will be described later.

[0071] The custom control module can be used to provide second controls corresponding to each first control in the first page.

[0072] The module that reflects the call to the processing function (or asynchronous callback, AsyncCallback) can provide the execution logic of the voice trigger command.

[0073] In a specific implementation, after receiving the voice trigger instruction, the voice processing module can determine the target second control triggered by the voice trigger instruction based on the voice trigger instruction and the established mapping relationship between each second control and the voice trigger instruction.

[0074] The voice processing module can generate a voice trigger instruction carrying the second control identifier of the target second control, and define a voice service through the interface provided by the visible and speakable module, and asynchronously call back the voice trigger instruction to the control management module 102.

[0075] After the control management module 102 receives the voice trigger instruction for the target second control from the voice processing module, it can use the reflection of the unified layer to call the processing function module, generate an interface trigger instruction for the target second control based on the voice trigger instruction and the target second control, and send the generated interface trigger instruction to the application module 103 corresponding to the target second control.

[0076] The first control to be updated may include a target first control corresponding to a second control among the first controls indicated by the page information.

[0077] The control management module 102, when determining the first control to be updated according to the page information of the first page, can be specifically used to: determine the first control indicated by the page information according to the page information of the first page; determine the target first control corresponding to the second control according to the first control indicated by the page information; determine the first control to be updated according to the target first control.

[0078] The first control may support a first type of operation instruction. The first type of operation command may include an interface trigger instruction. That is, after the user performs an interface trigger on the first control, the first control may implement a corresponding function. The second control may support a first type of operation instruction and a second type of operation instruction. The second type of operation instruction may include a voice trigger instruction. That is, after the user performs an interface trigger on the second control, the second control may implement a corresponding function; and after the user performs a voice trigger on the second control, the second control may also implement a corresponding function. Exemplarily, the first control may be a native control, and the second control may be a custom control.

[0079] After the control management module 102 determines the first control to be updated, when the display module 101 displays the first page, the control management module 102 may update the first control to be updated to the second control.

[0080] When updating the first control to be updated to the second control, the control management module 102 can be specifically used to: update the first calling method corresponding to the first control to be updated to the second calling method corresponding to the second control; wherein the first calling method is used to respond to the first type of operation instruction, that is, the control management module 102 can control the first control to execute the first calling method, and send the first type of operation instruction to the application module 103. The second calling method is used to respond to the first type of operation instruction and the second type of operation instruction, that is, the control management module 102 can control the second control to execute the second calling method to generate the first type of operation instruction, and send the first type of operation instruction to the application module 103.

[0081] After the control management module 102 updates the first control to be updated to the second control, the second control is used to send the first type of operation instruction to the corresponding application module 103 based on the received operation instruction. The received operation instruction can be an operation instruction of the first type or an operation instruction of the second type. The second control can be used to send the first type of operation instruction to the corresponding application module 103 based on the received first type of operation instruction or the second type of operation instruction.

[0082] When the first type of operation instruction includes an interface trigger instruction and the second type of operation instruction includes a voice trigger instruction, the second control can send an interface trigger instruction to the corresponding application module 103 based on the received voice trigger instruction.

[0083] The interface triggering instruction here is not a real interface triggering instruction triggered by the user, but a trigger signal of a simulated interface triggering. The generated trigger signal of the simulated interface triggering can be sent to the application module 103, so that the application module 103 executes the interface triggering instruction corresponding to the triggering signal.

[0084] In a specific implementation, the voice interaction device 100 may further include: a voice processing module and a visible and audible module.

[0085] The voice processing module is used to receive the user's voice trigger instruction; determine the target second control triggered by the voice trigger instruction according to the mapping relationship between the second control and the voice trigger instruction; and transmit the identification information of the target second control to the visible and speakable module.

[0086] The visible and speakable module is used to receive the identification information of the target second control based on the data links established with the voice processing module and the control management module 102 respectively, and transmit the identification information of the target second control to the control management module 102.

[0087] The control management module 102 is used to control the target second control to execute the corresponding calling method to generate a first type of operation instruction, and send the first type of operation instruction to the application module 103.

[0088] The mapping relationship between the second control and the voice trigger instruction can be predetermined. For example, the mapping relationship between the custom playback control and "play", the mapping relationship between the custom temperature control and "increase the temperature", etc. can be predetermined.

[0089] After the vehicle system is started, the visible and speakable service can be automatically, and the voice processing module and the control management module 102 can be automatically bound to the visible and speakable module to establish a data link.

[0090] The visible and speakable module can provide a cross-process data link between the voice processing module and the control management module 102. Specifically, the visible and speakable module can transmit the identification information of the target second control transmitted by the voice processing module to the control management module 102 through the data link. The visible and speakable module can provide an interface definition voice service, and the voice trigger instruction carrying the identification information of the target second control generated by the voice processing module can asynchronously call back the voice trigger instruction to the control management module 102 through the interface definition voice service provided by the visible and speakable module.

[0091] The control management module 102 can generate an interface trigger instruction for the target second control according to the voice trigger instruction and the target second control by controlling the target second control to execute the corresponding calling method, and send the generated interface trigger instruction to the application module 103 corresponding to the target second control.

[0092] In the embodiment of the present disclosure, the second control includes a second control for monitoring and registering the first processing function. The first processing function is determined based on the processing function corresponding to the first page. Specifically, each processing function corresponding to the first page can be determined based on the page information of the first page.

[0093] In the embodiment of the present disclosure, the control management module 102 is further used to send first indication information to the voice processing module. The first indication information is used to instruct to perform voice monitoring on the first processing function.

[0094] After receiving the first indication information, the voice processing module may perform voice monitoring on the processing function registered for monitoring in the first page to receive the user's voice triggering instruction.

[0095] By registering the monitoring of the first processing function, at least one first control under the processing function for which the monitoring is registered can be replaced with a second control. Afterwards, the first indication information is sent to the voice processing module, so that the voice processing module can perform relevant voice monitoring on the registered processing function. On the one hand, it can avoid confusion during voice instruction processing (too many enabled second controls make it difficult to distinguish them), and on the other hand, it can reduce resource consumption. Only providing voice monitoring processing services for registered functions can more accurately generate the target second control triggered by the trigger instruction.

[0096] After the application module 103 executes the first type of operation instruction, the execution result can be notified to the voice processing module. The voice processing module is also used to broadcast the execution result. By broadcasting the execution result in the form of voice broadcast, the user can obtain the execution result more easily and conveniently.

[0097] In one implementation, the speech processing module may send the execution result to the text-to-speech (TTS) module via a service-oriented architecture (SOA), and the execution result may be voice broadcasted via the TTS module.

[0098] For example, what is currently displayed is a page in a music player application, and the page displays controls such as "Play", "Next", and "Previous", and the corresponding preset voice commands are Play, Play Next, and Play Previous. At this time, after the user issues a voice command of "Play the next song", the voice processing module can recognize the voice command and derive the voice command of "Play the next song". Then, based on the established mapping relationship between each second control and the voice trigger instruction, according to the voice command of "Play the next song", it is determined that the second control to be clicked in the music player application currently displayed on the car screen is "Next", and the triggering click of the "Next" control is simulated, so that the music player application plays the next song.

[0099] In an embodiment of the present disclosure, a trigger effect may be displayed when a trigger instruction is executed. In order to distinguish the trigger effects of an interface trigger instruction from a voice trigger instruction on the interface. In one embodiment, a first trigger effect may be displayed when a voice trigger instruction is executed on a target second control. A second trigger effect may be displayed when a voice trigger instruction is executed on a target second control.

[0100] The first trigger special effect may be different from the second trigger special effect. Exemplarily, the first trigger special effect may include a special effect of enlarging and displaying the target second control, and the second trigger special effect may include a special effect of displaying a vibration.

[0101] In the embodiment of the present disclosure, the control management module 102 is also used to deregister the monitoring of the first processing function when the first condition is met, and send a second indication information to the voice processing module, wherein the second indication information is used to indicate the cancellation of the voice monitoring of the first processing function.

[0102] The first condition may include at least one of the following: the first page is adjusted to an invisible state; the monitoring time of voice monitoring exceeds a first threshold; the monitoring time of voice monitoring exceeds a second threshold, and no voice trigger instruction is received. The first threshold and the second threshold may be the same or different.

[0103] After the target second control is simulated and triggered, it is possible to enter the next page, or return to the previous page, or close the first page, so that the first page can be adjusted to an invisible state.

[0104] After receiving the second indication information, the voice processing module can cancel the voice monitoring of the processing function that is currently monitoring and unregistering, and can only provide the function of the second control and voice monitoring for the processing function that the user may trigger (the processing function that has not been monitored and unregistered). In addition, the voice processing module can also clear the information such as the received voice trigger instruction and the target second control triggered by the voice trigger instruction.

[0105] By monitoring and unregistering the first processing function of the first page, voice monitoring can be performed only on processing functions that may be triggered by the user, thereby reducing resource consumption.

[0106] In one embodiment, after the first processing function is monitored and deregistered, the control management module 102 is also used to update the second control corresponding to the first processing function to the first control. It should be understood here that after the first processing function is monitored and deregistered, the second control may not be updated to the first control. In this case, the first processing function will no longer be monitored for voice, that is, the received voice trigger instruction will no longer be executed, thereby reducing resource consumption.

[0107] Figure 3 Another work flow diagram of a voice interaction device is provided. After the vehicle is started, the visible and speakable module can realize the automatic start of the visible and speakable service. The voice processing module can automatically bind to the visible and speakable service and register for monitoring with the visible and speakable module.

[0108] After the user opens the in-vehicle application, it can also be automatically bound to the visible and audible module. Therefore, based on the visible and audible module, a data link is established between the control management module 102 and the voice processing module. Through the established data link, the visible and audible module can provide cross-process communication services for the control management module 102 and the voice processing module.

[0109] The first page in the in-vehicle application opened by the user displays page information, and the page information of the first page may include display information of each page element in the first page. The page element may include a window control, a text control, a button control, an image control, a conversion control, a progress bar control, etc., and the display information may include information such as the display position and display characteristics of the page element.

[0110] The page functions that can be implemented by the second control and the corresponding first control can be the same, wherein the first control only supports interface triggering and cannot support voice triggering, while the second control can simultaneously support interface triggering and voice triggering.

[0111] After determining at least one first control associated with each processing function, the control management module 102 can monitor and register each processing function, and replace at least one first control under the processing function for which the monitoring is registered with a second control having the same page function as the at least one first control.

[0112] Then, the control management module 102 may send the first indication information to the visible and audible module. The visible and audible module calls back the first indication information to the voice processing module. The first indication information may indicate to perform voice monitoring on the processing function currently registered for monitoring.

[0113] After receiving the first indication information, the voice processing module may perform voice monitoring on the processing function registered for monitoring in the first page to receive a voice trigger instruction.

[0114] After receiving the voice trigger instruction, the voice processing module can determine the target second control to be triggered by the voice trigger instruction based on the voice trigger instruction and the established mapping relationship between each second control and the voice trigger instruction.

[0115] Then, the voice processing module can generate a voice trigger instruction carrying the identification information of the target second control, and define the voice service through the interface provided by the visible and speakable module, and asynchronously call back the voice trigger instruction to the control management module 102.

[0116] After receiving the voice trigger instruction for the target second control from the voice processing module, the control management module 102 can use the reflection of the unified layer to call the processing function, generate an interface trigger instruction for the target second control according to the voice trigger instruction and the target second control, and send the generated interface trigger instruction to the application module 103 corresponding to the target second control. Among them, the simulation trigger can generate a trigger signal for interface triggering of the target second control.

[0117] After executing the simulated trigger on the target second control, the control management module 102 can call back the execution result after executing the simulated trigger to the voice processing module through the visible and speakable module.

[0118] The voice processing module can send the execution result to the TTS module through SOA, and then the TTS module can voice broadcast the execution result.

[0119] After simulating the triggering of the target second control, you can enter the next page, or return to the previous page, or close the target page, that is, the current target page is in an invisible state. In this case, the control management module 102 can monitor and cancel each processing function of the first page, and replace the second control under the processing function that has been monitored and cancelled with the first control. In addition, the control management module 102 can send a second indication message to the visible and speakable module, and the visible and speakable module can call back the second indication message to the visible and speakable module. Among them, the second indication message can indicate the cancellation of voice monitoring of the processing function that is currently monitored and cancelled.

[0120] After the visible and speakable module receives the second indication information, it can clear the cached information such as the target second control triggered by the voice trigger instruction.

[0121] After receiving the second indication information, the voice processing module can cancel voice monitoring for the processing function that is currently being monitored and unregistered, and can only provide the function of the second control and voice monitoring for the processing function that may be triggered by the user (processing function that has not been monitored and unregistered), and can clear the cached received voice trigger instructions, the target custom control triggered by the voice trigger instruction, and other information.

[0122] Those skilled in the art will understand that, in the above-mentioned voice interaction device of a specific implementation mode, the writing order between the steps executed by each module does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0123] Based on the same inventive concept, a voice interaction method corresponding to the voice interaction device is also provided in the embodiment of the present disclosure.

[0124] Reference Figure 4 FIG. 1 is a flow chart of a voice interaction method provided by an embodiment of the present disclosure, wherein the method comprises:

[0125] S401: receiving a display instruction for displaying a first page; the first page is a page that supports a visible and talkable function.

[0126] S402: Determine a first control to be updated according to the page information of the first page; the first control supports a first type of operation instruction.

[0127] S403: When displaying the first page, the first control to be updated is updated to a second control; the second control supports the first type of operation instructions and the second type of operation instructions, and the second control is used to send the first type of operation instructions to the corresponding application module based on the received operation instructions.

[0128] In a possible implementation, determining the first control to be updated according to the page information of the first page includes:

[0129] Determining, according to the page information of the first page, a first control indicated by the page information;

[0130] Determine a target first control according to the first control indicated by the page information, wherein the target first control corresponds to a second control;

[0131] According to the target first control, the first control to be updated is determined.

[0132] In a possible implementation, the first type of operation instruction includes an interface trigger instruction, and the second type of operation instruction includes a voice trigger instruction; after updating the first control to be updated to the second control, the method further includes:

[0133] Receive voice trigger commands from users;

[0134] Determine, according to a mapping relationship between the second control and the voice trigger instruction, a target second control to be triggered by the voice trigger instruction;

[0135] According to the voice trigger instruction and the target second control, an interface trigger instruction for the target second control is generated, and the generated interface trigger instruction is sent to an application module corresponding to the target second control.

[0136] In a possible implementation, the second control includes a second control for monitoring and registering a first processing function; the first processing function is determined based on a processing function corresponding to the first page; and the method further includes:

[0137] A first indication message is sent to a voice processing module of the vehicle, where the first indication message is used to instruct voice monitoring of the first processing function.

[0138] In a possible implementation, it further includes:

[0139] When the first condition is met, the first processing function is monitored and deregistered, and second indication information is sent to the voice processing module, where the second indication information is used to indicate the cancellation of voice monitoring of the first processing function.

[0140] In a possible implementation manner, the first condition includes at least one of the following:

[0141] The first page is adjusted to an invisible state;

[0142] The duration of voice monitoring exceeds a first threshold;

[0143] The monitoring duration of the voice monitoring exceeds the second threshold, and no voice triggering instruction is received;

[0144] In a possible implementation manner, after monitoring and deregistering the first processing function, the method further includes:

[0145] The second control corresponding to the first processing function is updated to the first control.

[0146] In a possible implementation, updating the first control to be updated to the second control includes:

[0147] The first calling method corresponding to the first control to be updated is updated to the second calling method corresponding to the second control; the first calling method is used to respond to a first type of operation instruction, and the second calling method is used to respond to a first type of operation instruction and a second type of operation instruction.

[0148] Since the principle of solving the problem by the method in the embodiment of the present disclosure is similar to that of the above-mentioned voice interaction device in the embodiment of the present disclosure, the implementation of the method can refer to the implementation of the device, and the repeated parts will not be repeated.

[0149] Based on the same inventive concept, a vehicle is also provided in an embodiment of the present disclosure, on which a voice interaction device as provided in the embodiment of the present disclosure is provided. The specific implementation process can refer to the description of the above voice interaction device.

[0150] Based on the same technical concept, the embodiment of the present disclosure also provides a computer device. Figure 5As shown, it is a schematic diagram of the structure of a computer device 500 provided in an embodiment of the present disclosure, including a processor 501, a memory 502, and a bus 503. Among them, the memory 502 is used to store execution instructions, including a memory 5021 and an external memory 5022; the memory 5021 here is also called an internal memory, which is used to temporarily store the operation data in the processor 501, and the data exchanged with the external memory 5022 such as a hard disk. The processor 501 exchanges data with the external memory 5022 through the memory 5021. When the control device 500 is running, the processor 501 communicates with the memory 502 through the bus 503, so that the processor 501 executes the following instructions:

[0151] Receiving a display instruction for displaying a first page; the first page is a page that supports a visible and talkable function;

[0152] Determining a first control to be updated according to the page information of the first page; the first control supports a first type of operation instruction;

[0153] When displaying the first page, the first control to be updated is updated to a second control; the second control supports the first type of operation instructions and the second type of operation instructions, and the second control is used to send the first type of operation instructions to the corresponding application module based on the received operation instructions.

[0154] The present disclosure also provides a computer program product that carries a program code. The program code includes instructions that can be used to execute the steps of the voice interaction method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.

[0155] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0156] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the method described above can refer to the corresponding process in the aforementioned system embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0157] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0158] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0159] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0160] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be based on the protection scope of the claims.

Claims

1. A voice interaction method, characterized in that: include: Receiving a display instruction for displaying a first page; the first page is a page that supports a visible and talkable function; Determining a first control to be updated according to the page information of the first page; The first control supports a first type of operation instructions; When displaying the first page, the first control to be updated is updated to a second control; the second control supports the first type of operation instructions and the second type of operation instructions, and the second control is used to send the first type of operation instructions to the corresponding application module based on the received operation instructions.

2. The method according to claim 1, characterized in that The determining, according to the page information of the first page, a first control to be updated includes: Determining, according to the page information of the first page, a first control indicated by the page information; Determine a target first control according to the first control indicated by the page information, wherein the target first control corresponds to a second control; According to the target first control, the first control to be updated is determined.

3. The method according to claim 1, characterized in that The first type of operation instruction includes an interface trigger instruction, and the second type of operation instruction includes a voice trigger instruction; after updating the first control to be updated to the second control, the method further includes: Receive voice trigger commands from users; Determine, according to a mapping relationship between the second control and the voice trigger instruction, a target second control to be triggered by the voice trigger instruction; According to the voice trigger instruction and the target second control, an interface trigger instruction for the target second control is generated, and the generated interface trigger instruction is sent to an application module corresponding to the target second control.

4. The method according to claim 1, characterized in that: The second control includes a second control for monitoring and registering the first processing function; the first processing function is determined based on the processing function corresponding to the first page; and the method further includes: A first indication message is sent to a voice processing module of the vehicle, where the first indication message is used to instruct voice monitoring of the first processing function.

5. The method according to claim 4, characterized in that Also includes: When the first condition is met, the first processing function is monitored and deregistered, and second indication information is sent to the voice processing module, where the second indication information is used to indicate the cancellation of voice monitoring of the first processing function.

6. The method according to claim 5, characterized in that The first condition includes at least one of the following: The first page is adjusted to an invisible state; The duration of voice monitoring exceeds a first threshold; The monitoring duration of the voice monitoring exceeds the second threshold, and no voice trigger instruction is received.

7. The method according to claim 5 or 6, characterized in that: After monitoring and deregistering the first processing function, the method further includes: The second control corresponding to the first processing function is updated to the first control.

8. The method according to claim 1, characterized in that The updating of the first control to be updated into the second control includes: The first calling method corresponding to the first control to be updated is updated to the second calling method corresponding to the second control; the first calling method is used to respond to a first type of operation instruction, and the second calling method is used to respond to a first type of operation instruction and a second type of operation instruction.

9. A voice interaction device, characterized in that: include: Control management module, application module and display module, including: The display module is used to receive a display instruction for displaying a first page, display the first page, and notify the control management module of page information of the first page; the first page is a page that supports a visible and talkable function; The control management module is used to determine a first control to be updated according to the page information of the first page; the first control supports a first type of operation instruction; when displaying the first page, the first control to be updated is updated to a second control; the second control supports a first type of operation instruction and a second type of operation instruction, and the second control is used to send the first type of operation instruction to the corresponding application module based on the received operation instruction; The application module is used to execute the received operation instruction of the first type.

10. The device according to claim 9, characterized in that The second type of operation instruction includes a voice trigger instruction; the device also includes: The voice processing module is used to receive the user's voice trigger instruction; determine the target second control that is triggered by the voice trigger instruction according to the mapping relationship between the second control and the voice instruction; and transmit the identification information of the target second control to the visible and speakable module; The visible and speakable module is used to receive the identification information of the target second control based on the data links established with the voice processing module and the control management module respectively, and transmit the identification information of the target second control to the control management module; The control management module is used to control the target second control to execute the corresponding calling method to generate the first type of operation instruction, and send the first type of operation instruction to the application module.

11. A vehicle, characterized in that: include: A voice interaction device as claimed in any one of claims 9 to 10.

12. A computer storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed by a processor, executes the steps of the voice interaction method as described in any one of claims 1 to 8.

Images