Instruction processing method and apparatus, and electronic device

Abstract

Provided in the present application are an instruction processing method and apparatus, and an electronic device. The method comprises: receiving a user operation instruction in the process of executing a voice interaction operation; if the user operation instruction can be executed simultaneously with a voice interaction function, in response to the user operation instruction, executing a target operation corresponding to the user operation instruction; controlling the voice interaction function to operate in a delayed listening state; and after switching to the delayed listening state is successful, receiving a user voice instruction within a preset delayed listening time, and performing the voice interaction operation in response to the user voice instruction. That is, in the present application, if a voice interaction operation and another user operation are simultaneously present, the two operations are simultaneously executed when simultaneous execution of the two operations is available, thereby improving the user experience. Furthermore, if no user voice instruction is received within a preset delayed listening time, resources occupied by a voice interaction function are released, so as to avoid the situation where another operation cannot be correctly executed due to unavailability of resources caused by resource occupation by the voice interaction function, thereby improving the user experience.

Description

Instruction processing method, device and electronic equipment

[0001] This application claims priority to a domestic application filed with the Patent Office of China on December 20, 2023, with application number 202311760939.3 and invention name “A method, device and electronic device for processing instructions”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of data processing, and more specifically, to an instruction processing method, device, and electronic device. Background Art

[0003] With the continuous development of vehicle technology, in addition to providing original driving functions, vehicles also provide intelligent functions such as music playback function, navigation function, etc.

[0004] If the user wants to run a certain function, it can be achieved through touch operation. At this time, the vehicle responds to the user's touch operation. For example, if the user wants to play music, if the user clicks the music play button, the music play operation will be performed.

[0005] However, currently the vehicle only supports one user operation when responding to user operations. If the user inputs multiple user operations at the same time, the vehicle cannot respond to the user operation correctly, which reduces the user experience. Summary of the Invention

[0006] In view of this, the present application provides a command processing method, device and electronic device to solve the problem that when a user inputs multiple user operations at the same time, the user operations cannot be correctly responded to, thereby reducing the user experience.

[0007] To solve the above technical problems, this application adopts the following technical solutions:

[0008] A method for processing an instruction, comprising:

[0009] During the voice interaction operation, if a user operation instruction is received, determining whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; the voice interaction function is used to perform the voice interaction operation;

[0010] If so, responding to the user operation instruction, executing the target operation corresponding to the user operation instruction;

[0011] Controlling the operation state of the voice interaction function to switch to a delayed listening state;

[0012] After successfully switching to the delayed listening state, determining whether a user voice command is received within a preset delayed listening time;

[0013] If a user voice command is received, respond to the user voice command and perform voice interaction operations;

[0014] If no user voice command is received, the voice interaction function is controlled to execute a function exit operation.

[0015] Optionally, determining whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function includes:

[0016] Determining a target function corresponding to the user operation instruction;

[0017] Acquire a preconfigured function set; the function set includes a non-mutually exclusive function subset; the non-mutually exclusive function subset includes a function that can be executed simultaneously with the voice interaction function;

[0018] Determining whether the non-mutually exclusive function subset includes the target function;

[0019] If so, determine that the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function.

[0020] Optionally, when it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, the method further includes:

[0021] In response to the user operation instruction, the target operation corresponding to the user operation instruction is executed, and the voice interaction function is controlled to execute a function exit operation.

[0022] Optionally, the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function;

[0023] Determining that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function includes:

[0024] When the mutually exclusive function subset includes the target function corresponding to the user operation instruction, it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

[0025] Optionally, before responding to the user operation instruction and performing the target operation corresponding to the user operation instruction, the method further includes:

[0026] Adjust the attribute information of the voice interaction display box.

[0027] Optionally, adjusting the attribute information of the voice interaction display box includes:

[0028] Adjust the size of the voice interaction display box;

[0029] Adjust the display position of the resized voice interaction display frame to the specified display position.

[0030] Optionally, controlling the running state of the voice interaction function to switch to a delayed listening state includes:

[0031] Get the identification information corresponding to the delayed listening state;

[0032] The running status content of the voice interaction function is adjusted to the identification information corresponding to the delayed listening state.

[0033] Optionally, determining whether a user voice command is received within a preset delayed listening time includes:

[0034] During the preset delayed listening time, collecting the user's voice and performing an intent recognition operation on the user's voice;

[0035] If the preset intention recognition result is recognized, it is determined that the user voice command is received.

[0036] An instruction processing device, comprising:

[0037] An instruction determination module is used to, when receiving a user operation instruction during the voice interaction operation, determine whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; the voice interaction function is used to perform the voice interaction operation;

[0038] An instruction response module, configured to respond to the user operation instruction and execute a target operation corresponding to the user operation instruction;

[0039] A voice control module, used to control the operation state of the voice interaction function to switch to a delayed listening state;

[0040] A voice reception judgment module is used to judge whether a user voice command is received within a preset delayed listening time after successfully switching to the delayed listening state;

[0041] The voice processing module is used to respond to the user's voice command and perform voice interaction operations if a user voice command is received; if no user voice command is received, control the voice interaction function to execute a function exit operation.

[0042] An electronic device comprising: a memory and a processor;

[0043] Wherein, the memory is used to store programs;

[0044] The processor calls the program and is used to execute the above instruction processing method.

[0045] Compared with the prior art, this application has the following beneficial effects:

[0046] The present application provides a command processing method, apparatus, and electronic device. In this application, if a user operation instruction is received during a voice interaction operation, it is determined whether the user operation instruction is an instruction that can be executed simultaneously with a voice interaction function. If so, it indicates that the user operation and voice interaction can be responded to simultaneously. The method then responds to the user operation instruction and executes the target operation corresponding to the user operation instruction. The voice interaction function is controlled to operate in a delayed listening state. After successfully switching to the delayed listening state, it is determined whether a user voice instruction is received within a preset delayed listening time. If a user voice instruction is received, the method responds to the user voice instruction and performs the voice interaction operation. Specifically, through this application, if a voice interaction operation and another user operation are simultaneously present, both operations are executed simultaneously if both can be executed simultaneously, thereby improving the user experience. Furthermore, if no user voice instruction is received within the preset delayed listening time, indicating that the user no longer requires the voice interaction operation, the voice interaction function is controlled to execute a function exit operation, thereby releasing the resources occupied by the voice interaction function. This prevents other operations from being unable to execute correctly due to lack of resources due to the voice interaction function occupying resources, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0048] FIG1 is a flow chart of an instruction processing method provided by an embodiment of the present application;

[0049] FIG2 is a flow chart of a method for analyzing instruction mutual exclusion provided by an embodiment of the present application;

[0050] FIG3 is a flow chart of another instruction processing method provided by an embodiment of the present application;

[0051] FIG4 is a schematic structural diagram of an instruction processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0053] With the continuous development of vehicle technology, in addition to providing original driving functions, vehicles also provide intelligent functions such as music playback function, navigation function, etc.

[0054] If the user wants to run a certain function, it can be achieved through touch operation. At this time, the vehicle responds to the user's touch operation. For example, if the user wants to play music, if the user clicks the music play button, the music play operation will be performed.

[0055] However, the vehicle currently only supports one user operation when responding to user operations. If the user inputs multiple user operations at the same time, such as performing voice interaction operations and touch operations at the same time, the vehicle will receive two operation instructions, but the vehicle is not configured with a strategy for how to respond to these two operation instructions. At this time, the vehicle cannot respond to user operations correctly, reducing the user experience.

[0056] To this end, when receiving multiple commands simultaneously, such as two commands (a voice interaction command and a touch command), this application implements different strategies based on whether the two commands can be executed simultaneously. If they can be executed simultaneously, the two commands are responded to simultaneously. If they cannot be executed simultaneously, the touch command received during the voice interaction operation is responded to.

[0057] Specifically, the present application provides a command processing method, apparatus, and electronic device. In this application, if a user operation instruction is received during a voice interaction operation, it is determined whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function. If so, it indicates that the user operation and voice interaction can be responded to simultaneously. The method then responds to the user operation instruction and executes the target operation corresponding to the user operation instruction. The voice interaction function is controlled to operate in a delayed listening state. After successfully switching to the delayed listening state, it is determined whether a user voice instruction is received within a preset delayed listening time. If a user voice instruction is received, the method responds to the user voice instruction and performs the voice interaction operation. That is, through this application, if a voice interaction operation and another user operation are simultaneously present, both operations are executed simultaneously if both can be executed simultaneously, thereby improving the user experience. Furthermore, if no user voice instruction is received within the preset delayed listening time, indicating that the user no longer needs the voice interaction operation, the voice interaction function is controlled to execute a function exit operation, thereby releasing the resources occupied by the voice interaction function. This prevents other operations from being unable to execute correctly due to lack of resources due to the voice interaction function occupying resources, thereby improving the user experience.

[0058] Based on the above content, an embodiment of the present application provides a command processing method, which is applied to an electronic device. Referring to Figure 1, the command processing method may include:

[0059] S11. Receive user operation instructions during the voice interaction operation.

[0060] In actual applications, the application scenarios in this application may be, for example, navigation scenarios, in which users can interact with electronic devices, such as selecting a destination by voice, or selecting a navigation route.

[0061] If the electronic device receives a voice control command input by the user, it performs the operation corresponding to the voice control command. If in the process of responding to the user's voice control command, such as receiving the user's voice control command or performing the operation corresponding to the voice control command, the user can perform a manual touch operation.

[0062] In the navigation scenario, the user's manual touch operations can include clicking buttons such as team formation, return to parking space, point placement, toolbox, search entry, etc. The function buttons supported by navigation in the embodiment of this application can be configured according to actual needs.

[0063] If the user clicks a button, the user operation instruction will be received at this time, and it is necessary to determine whether to respond to the user operation instruction during the voice interaction process.

[0064] It should be noted that the above embodiment takes the navigation scenario as an example, and this application can also be applied to other scenarios, such as when a user clicks any button, such as a play music button, or turns on / off the air conditioner, during a voice conversation with the user (such as an artificial intelligence conversation in any scenario, such as a question-and-answer scenario). In this application, any scenario in which a user touches the button during voice interaction with the user is applicable.

[0065] S12. Determine whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; if so, execute step S13.

[0066] Specifically, the voice interaction function is used to perform voice interaction operations. In this application, the above-mentioned voice interaction operations are performed by calling the voice interaction function.

[0067] In practical applications, it is necessary to determine whether the user operation instruction can be executed simultaneously with the voice interaction function. If so, they are executed simultaneously.

[0068] In order to determine whether simultaneous execution is possible, in an embodiment of the present application, a function set is pre-configured according to the simultaneous use requirements of the functions.

[0069] The function set includes a non-mutually exclusive function subset and a mutually exclusive function subset. The non-mutually exclusive function subset includes functions that can be executed simultaneously with the voice interaction function, and the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function.

[0070] In practice, refer to Tables 1 and 2. Table 1 provides examples of non-mutually exclusive functions within a non-mutually exclusive function subset, while Table 2 provides examples of mutually exclusive functions within a mutually exclusive function subset. If you subsequently change the user interface or add or remove functions from the map, the contents of Tables 1 and 2 will be adjusted accordingly.

[0071] Table 1

[0072] Still using the navigation scenario as an example, Tables 1 and 2 list some examples of functions. Table 1 shows the map states divided into main map state and navigation state. Each state has corresponding functions that do not affect voice conversations. In this embodiment, functions that do not affect voice conversations can be executed simultaneously with voice interaction functions. These functions constitute a non-mutually exclusive subset of functions.

[0073] Table 2

[0074] Table 2 is similar to Table 1. According to the different map states, it is divided into main map state and navigation state. In each state, there is a corresponding function that affects voice dialogue. In this embodiment, affecting voice dialogue means that it cannot be executed at the same time as the voice interaction function. These functions will form a mutually exclusive function subset.

[0075] In this embodiment, determining whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function, with reference to FIG2 , may specifically include:

[0076] S21: Determine the target function corresponding to the user operation instruction.

[0077] Specifically, for each click operation of the user, the function corresponding to the user operation instruction will be called. Taking Table 1 as an example, if the "floor switch" button is clicked, the "floor switch" function will be called. In this embodiment, the corresponding target function is determined according to the specific content of the user operation instruction.

[0078] S22. Obtain a pre-configured function set.

[0079] Among them, the function set includes a non-mutually exclusive function subset and a mutually exclusive function subset; the non-mutually exclusive function subset includes functions that can be executed simultaneously with the voice interaction function, and the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function.

[0080] For detailed explanation of the function set, please refer to the corresponding description above.

[0081] S23. Determine whether the non-mutually exclusive function subset includes the target function; if so, execute step S24.

[0082] S24. Determine whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function.

[0083] In this embodiment, if the target function exists in the non-mutually exclusive function subset, it is considered that it is not mutually exclusive with the voice interaction function, and the two can be executed simultaneously. If the target function exists in the mutually exclusive function subset, it is considered that it is mutually exclusive with the voice interaction function, and the two cannot be executed simultaneously. That is, when the mutually exclusive function subset includes the target function corresponding to the user operation instruction, it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

[0084] It should be noted that the functions in the non-mutually exclusive function subsets and the mutually exclusive function subsets can be adjusted according to needs, such as adding or deleting some functions in the subsets, and the functions in the non-mutually exclusive function subsets can be adjusted to the mutually exclusive function subsets, and the functions in the mutually exclusive function subsets can be adjusted to the non-mutually exclusive function subsets. The specific configuration can be based on actual needs.

[0085] S13: Respond to the user operation instruction and execute the target operation corresponding to the user operation instruction.

[0086] If the target function corresponding to the user operation instruction can be executed simultaneously with the voice interaction function, the target operation corresponding to the user operation instruction will be executed in response to the user operation instruction. For example, if the user clicks the "Zoom in / out" operation, the "Zoom in / out" function will be called to zoom in or out of the map. If the user clicks the "Drag to move the map" operation, the "Drag to move the map" function will be called to drag and move the map.

[0087] In actual applications, during voice interaction, the electronic device's display interface can display the content of the user's voice interaction. If the user clicks on other operations, such as "drag to move the map," the map drag interface needs to be displayed. To ensure that the voice interaction content does not affect the display effect and display space of the "drag to move the map" operation, in this embodiment, after determining that the target function corresponding to the user's operation instruction can be executed simultaneously with the voice interaction function, before executing step S13, the attribute information of the voice interaction display box can be adjusted. The attribute information in this embodiment mainly refers to size and position.

[0088] Specifically, during voice interaction, for example, clicking "Drag Map" will cause the map to be dragged and moved. This requires the map dragging effect to be displayed on the display interface. If the voice interaction display box is large, the dragging map display interface will be smaller, hindering the user's ability to view the map. Therefore, in this embodiment, the voice interaction display box is resized. Generally, the voice interaction display box is reduced, such as to a specified size, such as 2cm*2cm.

[0089] In addition, in order to prevent the display position of the voice interaction display box from blocking or affecting the display effect of dragging the map, in this embodiment, the display position of the resized voice interaction display box will also be adjusted to the specified display position.

[0090] The designated display position is generally a position that does not affect the execution of the target operation, such as the status bar in the upper left corner.

[0091] In this embodiment, by reducing the voice interaction display frame and adjusting its position to a specified display position, it is possible to ensure that there is sufficient display space when executing the target operation, thereby improving the user experience.

[0092] S14. Control the running state of the voice interaction function to switch to a delayed listening state.

[0093] In actual applications, during the voice interaction operation, a user operation instruction is received. If it is determined through the above steps that the user operation instruction can be executed, the target operation corresponding to the user operation instruction is executed. At this time, the voice dialogue and voice list are not affected and continue to maintain the current state.

[0094] In order to ensure that the user's voice commands are responded to in a timely manner when the user outputs voice, the operating state of the voice interaction function can be switched to a delayed listening state.

[0095] The delayed listening state in this embodiment means that the user's voice is continuously monitored and, if a voice command is received within the preset delayed listening time, the user responds; if no voice command is received, the voice interaction function is exited. The preset delayed listening time can be configured according to actual needs, such as 30 seconds.

[0096] In actual applications, multiple operating states of the voice interaction function are pre-configured, such as normal operating state, abnormal operating state, delayed listening state, etc. Each state has corresponding identification information, such as using 1 to identify the normal operating state, 2 to identify the abnormal operating state, and 3 to identify the delayed listening state.

[0097] Therefore, in this embodiment, identification information corresponding to the delayed listening state can be obtained, and then the running state content of the voice interaction function can be adjusted to the identification information corresponding to the delayed listening state to achieve state switching.

[0098] It should be noted that in addition to using the delayed listening state, the operating state of the voice interaction function can also be configured as the normal operating state, but a countdown timer is set. Before the countdown timer reaches the specified time (which can be the same as the preset delayed listening time), if the user voice is received, it will respond. If the user voice is not received, the voice interaction function will be exited.

[0099] In addition, there is no restriction on the execution order between step S13 and step S14, and they can be executed simultaneously, or step S13 can be executed first and then step S14, or step S14 can be executed first and then step S13.

[0100] S15. After successfully switching to the delayed listening state, determine whether a user voice command is received within the preset delayed listening time; if so, execute step S16; if not, execute step S17.

[0101] Specifically, since in the delayed listening state, only responding to user voice commands within the preset delayed listening time is supported, in this embodiment, it is necessary to determine whether the user voice command is received within the preset delayed listening time after successfully switching to the delayed listening state.

[0102] At this time, the user's voice can be collected within the preset delayed listening time, and then the intention recognition operation can be performed on the user's voice.

[0103] Specifically, the user's voice is subjected to a speech recognition operation to obtain the corresponding text information, and then a keyword extraction operation is performed on it, and intent recognition is performed based on the extracted keywords to obtain the intent recognition result.

[0104] For example, the user's voice is "Help me switch the navigation route". After converting it into text information, the keywords "switch" and "navigation route" are extracted, which is conducive to keyword intent recognition. It can be determined that the user's intention is to switch the navigation route.

[0105] If the preset intention recognition result is recognized, it is determined that the user voice command has been received. The preset intention recognition result in this embodiment can be set to an intention recognition result related to a map function, such as the above-mentioned switching navigation route.

[0106] In actual application, if the switch to the delayed listening state is unsuccessful, you can try to switch again. If the switch to the delayed listening state is unsuccessful after multiple switches, the voice interaction function will be exited and the user will be prompted that the voice interaction function has failed and is temporarily unavailable.

[0107] S16. Respond to the user's voice command and perform voice interaction operations.

[0108] Specifically, the operation corresponding to the intention recognition result is performed. For example, if the user says "help me switch the navigation route", all available routes can be displayed on the interface, and the user can be prompted by voice "there are currently X routes, please select which one to use".

[0109] The user can voice-input the selected route, and then use the route for navigation.

[0110] S17: Control the voice interaction function to execute a function exit operation.

[0111] Specifically, if the user's voice is not received within the preset delayed listening time, it means that the user has no voice interaction needs temporarily. At this time, the voice interaction function is controlled to execute the function exit operation to avoid the function running occupying memory.

[0112] In this embodiment, if a user operation instruction is received during a voice interaction operation, a determination is made as to whether the user operation instruction is capable of being executed simultaneously with the voice interaction function. If so, indicating that both the user operation and voice interaction can be responded to simultaneously, the user operation instruction is responded to, the target operation corresponding to the user operation instruction is executed, and the voice interaction function is controlled to operate in a delayed listening state. After successfully switching to the delayed listening state, a determination is made as to whether a user voice instruction is received within a preset delayed listening time. If a user voice instruction is received, the user voice instruction is responded to and the voice interaction operation is performed. Specifically, through this application, if a voice interaction operation and another user operation are simultaneously present, both operations are executed simultaneously if both can be executed simultaneously, thereby improving the user experience. Furthermore, if no user voice instruction is received within the preset delayed listening time, indicating that the user no longer requires the voice interaction operation, the voice interaction function is controlled to execute a function exit operation, thereby releasing the resources occupied by the voice interaction function. This avoids the situation where other operations cannot be correctly executed due to lack of resources due to the voice interaction function occupying resources, thereby improving the user experience.

[0113] In addition, when a conflict arises between voice interaction and touch interaction, the embodiment of the present application avoids the problem that the electronic device cannot correctly respond to user operations due to the conflict between the two, and reasonably balances the user experience when voice interaction and touch interaction are used at the same time, allowing users to conveniently perform dual-operation interaction.

[0114] Based on the above content, when the mutually exclusive function subset includes the target function corresponding to the user operation instruction, it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function. Referring to Figure 3, when it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, it also includes:

[0115] S38. Respond to the user operation instruction, execute the target operation corresponding to the user operation instruction, and control the voice interaction function to execute a function exit operation.

[0116] In this embodiment, in response to the user operation instruction, the target operation corresponding to the user operation instruction is performed. Please refer to the corresponding description above.

[0117] In this step, the step of controlling the voice interaction function to execute the function exit operation has different implementation methods when the target operation is different, which are now introduced separately.

[0118] Referring to Table 2, the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function.

[0119] Specifically, the mutually exclusive function subset includes a first control function and a first message function when the map state is the main map state, and a second control function and a second message function when the map state is the navigation state.

[0120] In Table 2, the first control function includes team formation, returning to parking space, parking point, toolbox, and search portal. The first message function includes cloud-controlled messages (off, view route). The second control function includes continue navigation, team formation, exit, long press on the map, tap parking point, toolbox, search along the way, parking guidance, and route refresh. The second message function includes highway signboards and cloud-controlled messages (off, details).

[0121] Depending on the function type, when a touch operation is received during a voice conversation, the voice conversation ends at different times. For example, the first and second control functions end at "after a click." Specifically, "after a click" refers to receiving the user operation instruction. That is, if the target function corresponding to the user operation instruction is the first or second control function, after receiving the user operation instruction, the voice interaction function is controlled to perform a function exit operation. Controlling the voice interaction function to perform a function exit operation can include exiting a multi-round voice conversation or exiting the voice list display.

[0122] The first and second message functions are terminated during "display." "Display" refers to when the first or second message function is being used to display a message. That is, if the target function corresponding to the user operation instruction is the first or second message function, the voice interaction function is controlled to perform a function exit operation during the display of a message using the first or second message function.

[0123] In this embodiment, two different end timings are set to ensure normal operation of the target function in different function execution scenarios.

[0124] It should be noted that for the specific implementation of steps S31-S37 in this embodiment, please refer to the above corresponding descriptions.

[0125] Based on the above embodiment of the instruction processing method, another embodiment of the present application provides an instruction processing device, which, as shown in FIG4 , may include:

[0126] The instruction determination module 11 is used to determine whether, when receiving a user operation instruction during the voice interaction operation, the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; the voice interaction function is used to perform the voice interaction operation;

[0127] An instruction response module 12 is configured to respond to the user operation instruction and perform a target operation corresponding to the user operation instruction;

[0128] The voice control module 13 is used to control the operation state of the voice interaction function to switch to the delayed listening state;

[0129] The voice reception judgment module 14 is used to judge whether the user voice command is received within the preset delayed listening time after successfully switching to the delayed listening state;

[0130] The voice processing module 15 is used to respond to a user voice command and perform a voice interaction operation if a user voice command is received; if no user voice command is received, control the voice interaction function to execute a function exit operation.

[0131] Furthermore, the instruction determination module 11 includes:

[0132] A function determination submodule, configured to determine a target function corresponding to the user operation instruction;

[0133] A set acquisition submodule, configured to acquire a pre-configured function set; the function set includes a non-mutually exclusive function subset; the non-mutually exclusive function subset includes a function that can be executed simultaneously with the voice interaction function;

[0134] a judging submodule, configured to judge whether the non-mutually exclusive function subset includes the target function;

[0135] The determination submodule is used to determine, if yes, that the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function.

[0136] Furthermore, it also includes:

[0137] An operation processing module is used to respond to the user operation instruction, execute the target operation corresponding to the user operation instruction, and control the voice interaction function to execute a function exit operation when it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

[0138] Further, the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function;

[0139] The operation processing module is used to determine that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, specifically to:

[0140] When the mutually exclusive function subset includes the target function corresponding to the user operation instruction, it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

[0141] Furthermore, it also includes:

[0142] The display frame adjustment module is used to adjust the attribute information of the voice interaction display frame.

[0143] Furthermore, the display frame adjustment module is specifically used to:

[0144] The icon size of the voice interaction display frame is adjusted, and the display position of the voice interaction display frame after the icon size adjustment is adjusted to the specified display position.

[0145] Furthermore, the voice control module 13 is specifically used to:

[0146] Acquire identification information corresponding to the delayed listening state, and adjust the running state content of the voice interaction function to the identification information corresponding to the delayed listening state.

[0147] Furthermore, the voice reception determination module 14 is used to determine whether a user voice command is received within a preset delayed listening time, specifically to:

[0148] During the preset delayed listening time, the user voice is collected and an intention recognition operation is performed on the user voice. If a preset intention recognition result is recognized, it is determined that the user voice instruction has been received.

[0149] In this embodiment, if a user operation instruction is received during a voice interaction operation, a determination is made as to whether the user operation instruction is capable of being executed simultaneously with the voice interaction function. If so, indicating that both the user operation and voice interaction can be responded to simultaneously, the user operation instruction is responded to, the target operation corresponding to the user operation instruction is executed, and the voice interaction function is controlled to operate in a delayed listening state. After successfully switching to the delayed listening state, a determination is made as to whether a user voice instruction is received within a preset delayed listening time. If a user voice instruction is received, the user voice instruction is responded to and the voice interaction operation is performed. Specifically, through this application, if a voice interaction operation and another user operation are simultaneously present, both operations are executed simultaneously if both can be executed simultaneously, thereby improving the user experience. Furthermore, if no user voice instruction is received within the preset delayed listening time, indicating that the user no longer requires the voice interaction operation, the voice interaction function is controlled to execute a function exit operation, thereby releasing the resources occupied by the voice interaction function. This avoids the situation where other operations cannot be correctly executed due to lack of resources due to the voice interaction function occupying resources, thereby improving the user experience.

[0150] It should be noted that for the specific implementation of each module in this embodiment, please refer to the corresponding description in the above embodiment, which will not be repeated here.

[0151] Based on the above embodiments of the instruction processing method and apparatus, another embodiment of the present application provides an electronic device, including: a memory and a processor;

[0152] Wherein, the memory is used to store programs;

[0153] The processor calls the program and is used to execute the above instruction processing method.

[0154] The electronic device in this embodiment can be an in-vehicle multimedia host (HUT). In actual use, a system consisting of a cloud platform, a T-BOX (Telematics Box, an in-vehicle wireless terminal), the in-vehicle multimedia host (HUT), and a mobile phone can be configured to facilitate user navigation. The HUT primarily provides functional effect demonstration and logical judgment and decision-making for command execution. The T-BOX provides a network channel for communication between the cloud platform and the HUT. The cloud platform primarily parses commands, issues intent, and responds after decision-making. For example, when acquiring or updating map data, the HUT outputs the map data acquisition or update command and transmits it to the cloud platform via the T-BOX. The cloud platform then transmits the latest map data to the HUT via the T-BOX, and the HUT forwards it to the map module for updating.

[0155] Modules such as maps can also execute corresponding instructions and display them on the HMI (Human Machine Interface), for example, displaying navigation routes through the HMI.

[0156] In this embodiment, if a user operation instruction is received during a voice interaction operation, a determination is made as to whether the user operation instruction is capable of being executed simultaneously with the voice interaction function. If so, indicating that both the user operation and voice interaction can be responded to simultaneously, the user operation instruction is responded to, the target operation corresponding to the user operation instruction is executed, and the voice interaction function is controlled to operate in a delayed listening state. After successfully switching to the delayed listening state, a determination is made as to whether a user voice instruction is received within a preset delayed listening time. If a user voice instruction is received, the user voice instruction is responded to and the voice interaction operation is performed. Specifically, through this application, if a voice interaction operation and another user operation are simultaneously present, both operations are executed simultaneously if both can be executed simultaneously, thereby improving the user experience. Furthermore, if no user voice instruction is received within the preset delayed listening time, indicating that the user no longer requires the voice interaction operation, the voice interaction function is controlled to execute a function exit operation, thereby releasing the resources occupied by the voice interaction function. This avoids the situation where other operations cannot be correctly executed due to lack of resources due to the voice interaction function occupying resources, thereby improving the user experience.

[0157] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A command processing method, characterized in that: include: During the voice interaction operation, if a user operation instruction is received, determining whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; The voice interaction function is used to perform voice interaction operations; If so, responding to the user operation instruction, executing the target operation corresponding to the user operation instruction; Controlling the operation state of the voice interaction function to switch to a delayed listening state; After successfully switching to the delayed listening state, determining whether a user voice command is received within a preset delayed listening time; If a user voice command is received, respond to the user voice command and perform voice interaction operation; If no user voice command is received, the voice interaction function is controlled to execute a function exit operation.

2. The instruction processing method according to claim 1, characterized in that: Determining whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function includes: Determining a target function corresponding to the user operation instruction; Acquire a preconfigured function set; the function set includes a non-mutually exclusive function subset; the non-mutually exclusive function subset includes a function that can be executed simultaneously with the voice interaction function; Determining whether the non-mutually exclusive function subset includes the target function; If so, determine that the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function.

3. The instruction processing method according to claim 1, characterized in that: In the case where it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, the method further includes: In response to the user operation instruction, the target operation corresponding to the user operation instruction is executed, and the voice interaction function is controlled to execute a function exit operation.

4. The instruction processing method according to claim 3, characterized in that: The mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function; Determining that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function includes: When the mutually exclusive function subset includes the target function corresponding to the user operation instruction, it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

5. The instruction processing method according to claim 1, characterized in that: Before responding to the user operation instruction and performing the target operation corresponding to the user operation instruction, the method further includes: Adjust the attribute information of the voice interaction display box.

6. The instruction processing method according to claim 5, characterized in that: Adjust the attribute information of the voice interaction display box, including: Adjust the size of the voice interaction display box; The display position of the resized voice interaction display frame is adjusted to the specified display position.

7. The instruction processing method according to claim 1, characterized in that: Controlling the running state of the voice interaction function to switch to a delayed listening state includes: Obtain identification information corresponding to the delayed listening state; The running status content of the voice interaction function is adjusted to the identification information corresponding to the delayed listening state.

8. The instruction processing method according to claim 1, characterized in that: The step of determining whether a user voice command is received within a preset delayed listening time includes: During the preset delayed listening time, collecting the user's voice and performing an intention recognition operation on the user's voice; If a preset intention recognition result is recognized, it is determined that the user voice command is received.

9. An instruction processing device, characterized in that: include: An instruction determination module is used to determine whether, when receiving a user operation instruction during the voice interaction operation, the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; the voice interaction function is used to perform the voice interaction operation; An instruction response module, used for responding to the user operation instruction and executing a target operation corresponding to the user operation instruction; A voice control module, used to control the operation state of the voice interaction function to switch to a delayed listening state; A voice reception judgment module, used to judge whether a user voice command is received within a preset delayed listening time after successfully switching to the delayed listening state; The voice processing module is used to respond to the user's voice command and perform voice interaction operations if a user's voice command is received; if no user's voice command is received, control the voice interaction function to execute a function exit operation.

10. An electronic device, characterized in that: include: Memory and processor; Wherein, the memory is used to store programs; The processor calls the program and is used to execute the instruction processing method according to any one of claims 1 to 8.

Images