Instruction processing method and device and electronic equipment

Abstract

The invention provides an instruction processing method and device and electronic equipment, and the method comprises the steps: receiving a user operation instruction in a voice interaction operation execution process, responding to the user operation instruction if the user operation instruction and a voice interaction function can be executed at the same time, and executing a target operation corresponding to the user operation instruction, and controlling the voice interaction function to run in a delayed listening state, receiving a user voice instruction within a preset delayed listening time after the voice interaction function is successfully switched to the delayed listening state, and performing voice interaction operation in response to the user voice instruction. In other words, if the voice interaction operation and other user operations exist at the same time, under the condition that the two operations can be executed at the same time, the two operations are executed at the same time, and user experience is improved. Furthermore, if the user voice instruction is not received within the preset delayed listening time, resources occupied by the voice interaction function are released, so that the situation that other operations cannot be correctly executed due to no resource use caused by the fact that the voice interaction function occupies the resources is avoided, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing, and more particularly, to an instruction processing method, apparatus, and electronic device. Background Art

[0002] With the continuous development of vehicle technology, in addition to providing the original driving function, vehicles also provide intelligent functions, such as music playing function, navigation function, etc.

[0003] If a user wants to run a certain function, it can be achieved through touch operations. At this time, the vehicle responds to the user's touch operations. For example, if the user wants to play music and clicks the music play button, the music play operation is executed at this time.

[0004] However, currently, when the vehicle responds to user operations, it only supports one user operation. If the user outputs multiple user operations simultaneously, the vehicle cannot correctly respond to the user operations at this time, reducing the user experience. Summary of the Invention

[0005] In view of this, the present invention provides an instruction processing method, apparatus, and electronic device to solve the problem that when the user outputs multiple user operations simultaneously, the vehicle cannot correctly respond to the user operations at this time, reducing the user experience.

[0006] To solve the above technical problems, the present invention adopts the following technical solutions:

[0007] An instruction processing method includes:

[0008] During the execution of a voice interaction operation, if a user operation instruction is received, determine whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; the voice interaction function is used to execute voice interaction operations;

[0009] If so, respond to the user operation instruction and execute the target operation corresponding to the user operation instruction;

[0010] Control the running state of the voice interaction function to switch to a delayed listening state;

[0011] After successfully switching to the delayed listening state, determine whether a user voice instruction is received within a preset delayed listening time;

[0012] If a user voice instruction is received, respond to the user voice instruction and perform a voice interaction operation;

[0013] If no user voice instruction is received, control the voice interaction function to perform a function exit operation.

[0014] Optionally, determining whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function includes:

[0015] Determine the target function corresponding to the user operation instruction;

[0016] Obtain a pre-configured function set; the function set includes a non-exclusive function subset; the non-exclusive function subset includes functions that can be executed simultaneously with the voice interaction function;

[0017] Determine whether the non-exclusive function subset includes the target function;

[0018] If so, determine that the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function.

[0019] Optionally, in the case where it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, it further includes:

[0020] Respond to the user operation instruction, execute the target operation corresponding to the user operation instruction, and control the voice interaction function to execute a function exit operation.

[0021] Optionally, the exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function;

[0022] Determine that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, including:

[0023] When the exclusive function subset includes the target function corresponding to the user operation instruction, determine that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

[0024] Optionally, before responding to the user operation instruction and executing the target operation corresponding to the user operation instruction, it further includes:

[0025] Perform an adjustment operation on the attribute information of the voice interaction display box.

[0026] Optionally, performing an adjustment operation on the attribute information of the voice interaction display box includes:

[0027] Adjust the size of the voice interaction display box;

[0028] Adjust the display position of the resized voice interaction display box to a specified display position.

[0029] Optionally, controlling the operating state of the voice interaction function to switch to a delayed listening state includes:

[0030] Obtain the identification information corresponding to the delayed listening state;

[0031] Adjust the operating state content of the voice interaction function to the identification information corresponding to the delayed listening state.

[0032] Optionally, determining whether a user voice command is received within a preset delay listening time includes:

[0033] During the preset delay listening time, collect user voice and perform an intent recognition operation on the user voice;

[0034] If a preset intent recognition result is recognized, it is determined that a user voice command is received.

[0035] An instruction processing device includes:

[0036] An instruction determination module, configured to determine, during a voice interaction operation, whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; the voice interaction function is used to perform a voice interaction operation;

[0037] An instruction response module, configured to, if so, respond to the user operation instruction and perform a target operation corresponding to the user operation instruction;

[0038] A voice control module, configured to control the operating state of the voice interaction function to be switched to a delay listening state;

[0039] A voice reception judgment module, configured to, after successfully switching to the delay listening state, judge whether a user voice command is received within a preset delay listening time;

[0040] A voice processing module, configured to, if a user voice command is received, respond to the user voice command and perform a voice interaction operation; if no user voice command is received, control the voice interaction function to perform a function exit operation.

[0041] An electronic device includes: a memory and a processor;

[0042] Wherein, the memory is used to store a program;

[0043] The processor calls the program and is used to execute the above-mentioned instruction processing method.

[0044] Compared with the prior art, the present invention has the following beneficial effects:

[0045] The present invention provides an instruction processing method, apparatus and electronic device. In the present invention, if a user operation instruction is received during the execution of a voice interaction operation, it is determined whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function. If so, it means that the user operation and the voice interaction can be responded to simultaneously. Then, the user operation instruction is responded to, the target operation corresponding to the user operation instruction is executed, and the voice interaction function is controlled to run in a delayed listening state. After successfully switching to the delayed listening state, it is judged whether a user voice instruction is received within a preset delayed listening time. If a user voice instruction is received, the user voice instruction is responded to and a voice interaction operation is performed. That is, through the present invention, if there are both a voice interaction operation and other user operations and they can be executed simultaneously, the two operations are executed simultaneously, improving the user experience. Further, if no user voice instruction is received within the preset delayed listening time, it indicates that the user no longer needs the voice interaction operation. At this time, the voice interaction function is controlled to perform a function exit operation, releasing the resources occupied by the voice interaction function, avoiding the situation where other operations cannot be correctly executed due to lack of resources caused by the voice interaction function occupying resources, and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only the embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained according to the provided drawings.

[0047] Figure 1 It is a flowchart of a method for an instruction processing method provided by an embodiment of the present invention;

[0048] Figure 2 It is a flowchart of a method for instruction mutual exclusion analysis provided by an embodiment of the present invention;

[0049] Figure 3 It is a flowchart of another instruction processing method provided by an embodiment of the present invention;

[0050] Figure 4 It is a schematic structural diagram of an instruction processing apparatus provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0051] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0052] With the continuous development of vehicle technology, in addition to providing the original driving function, the vehicle also provides intelligent functions, such as music playing function, navigation function, etc.

[0053] If a user wants to run a certain function, it can be achieved through touch operations. At this time, the vehicle responds to the user's touch operations. For example, if the user wants to play music and clicks the music play button, the music play operation is executed at this time.

[0054] However, currently, when the vehicle responds to user operations, it only supports one user operation. If the user outputs multiple user operations simultaneously, such as performing voice interaction operations and touch operations at the same time, the vehicle will receive two operation instructions at this time. However, the vehicle is not configured with a strategy on how to respond to these two operation instructions. At this time, the vehicle cannot correctly respond to the user operations, reducing the user experience.

[0055] Therefore, when the present invention receives multiple instructions simultaneously, such as two instructions (voice interaction instruction and touch instruction), different strategies are executed based on whether these two instructions can be executed simultaneously. If they can be executed simultaneously, both instructions are responded to simultaneously. If they cannot be executed simultaneously, the touch operation received in the voice interaction operation is responded to.

[0056] Specifically, the present invention provides an instruction processing method, apparatus, and electronic device. In the present invention, if a user operation instruction is received during the execution of a voice interaction operation, it is determined whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function. If so, it means that the user operation and the voice interaction can be responded to simultaneously. Then, the user operation instruction is responded to, and the target operation corresponding to the user operation instruction is executed. The voice interaction function is controlled to run in the delayed listening state. After successfully switching to the delayed listening state, it is determined whether a user voice instruction is received within a preset delayed listening time. If a user voice instruction is received, the user voice instruction is responded to, and a voice interaction operation is performed. That is, through the present invention, if there are both a voice interaction operation and other user operations and they can be executed simultaneously, the two operations are executed simultaneously, improving the user experience. Further, if no user voice instruction is received within the preset delayed listening time, it indicates that the user no longer needs the voice interaction operation. At this time, the voice interaction function is controlled to perform a function exit operation, releasing the resources occupied by the voice interaction function, avoiding the situation where other operations cannot be correctly executed due to lack of resources caused by the voice interaction function occupying resources, and improving the user experience.

[0057] Based on the above, an embodiment of the present invention provides an instruction processing method, which is applied to an electronic device. Referring to Figure 1 , the instruction processing method may include:

[0058] S11. During the execution of the voice interaction operation, receive a user operation instruction.

[0059] In practical applications, the application scenario in the present invention can be, for example, a navigation scenario. In the navigation scenario, the user can interact with the electronic device, such as selecting a destination by voice or selecting a navigation route.

[0060] If the electronic device receives a voice control instruction output by the user, the operation corresponding to the voice control instruction is executed. If during the process of responding to the user's voice control instruction, such as when receiving the user's voice control instruction or executing the operation corresponding to the voice control instruction, the user can perform a manual touch operation.

[0061] In the navigation scenario, the user's manual touch operation can be, for example, clicking buttons such as forming a team, returning to the parking space, marking a point, toolbox, search entry, etc. The function buttons supported by the navigation in the embodiments of the present invention can be configured according to actual needs.

[0062] If the user clicks a certain button, a user operation instruction will be received at this time, and it is necessary to determine whether to respond to the user operation instruction during the execution of the voice interaction.

[0063] It should be noted that in the above embodiments, the navigation scenario is taken as an example. The present invention can also be applied to other scenarios. For example, during a voice conversation with the user (such as an artificial intelligence conversation in any scenario, such as a question-and-answer scenario), the user clicks on any button, such as a play music button, or an operation such as turning on / off the air conditioner button. In the present invention, as long as there is a scenario where the user touches and operates during the voice interaction with the user, it is applicable.

[0064] S12. Determine whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; if so, execute step S13.

[0065] Specifically, the voice interaction function is used to perform voice interaction operations. In the present invention, the above-mentioned voice interaction operations are executed by calling the voice interaction function.

[0066] In practical applications, it is necessary to determine whether the user operation instruction can be executed simultaneously with the voice interaction function. If it can be executed, it will be executed simultaneously.

[0067] In order to determine whether they can be executed simultaneously, in the embodiments of the present invention, according to the simultaneous use requirements of functions, a function set is pre-configured.

[0068] The function set includes a non-mutually exclusive function subset and a mutually exclusive function subset. The non-mutually exclusive function subset includes functions that can be executed simultaneously with the voice interaction function, and the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function.

[0069] In practical applications, referring to Table 1 and Table 2, Table 1 is an example of non-mutually exclusive functions in the non-mutually exclusive function subset, and Table 2 is an example of mutually exclusive functions in the mutually exclusive function subset. If the user interface is changed or functions are added or removed from the map later, the contents in Table 1 and Table 2 will be adjusted accordingly.

[0070] Table 1

[0071]

[0072]

[0073] Still taking the navigation scenario as an example, in Table 1 and Table 2, examples of some functions are listed. In Table 1, according to different map states, it is divided into the main map state and the navigation state. In each state, there are corresponding functions that do not affect the voice conversation. In this embodiment, not affecting the voice conversation means being able to be executed simultaneously with the voice interaction function, and these functions will form a non-mutually exclusive function subset.

[0074] Table 2

[0075]

[0076] In Table 2, similar to Table 1, according to different map states, it is divided into the main map state and the navigation state. In each state, there are corresponding functions that affect voice conversations. In this embodiment, affecting voice conversations means that it cannot be executed simultaneously with the voice interaction function, and these functions will form a mutually exclusive function subset.

[0077] In this embodiment, to determine whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function, refer to Figure 2 , and specifically may include:

[0078] S21. Determine the target function corresponding to the user operation instruction.

[0079] Specifically, for each click operation of the user, the function corresponding to the user operation instruction will be called. Taking Table 1 as an example, if the "floor switching" button is clicked, the "floor switching" function will be called. Then in this embodiment, according to the specific content of the user operation instruction, its corresponding target function is determined.

[0080] S22. Obtain the pre-configured function set.

[0081] Among them, the function set includes a non-mutually exclusive function subset and a mutually exclusive function subset; the non-mutually exclusive function subset includes functions that can be executed simultaneously with the voice interaction function, and the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function.

[0082] For the specific explanatory description of the function set, please refer to the corresponding description above.

[0083] S23. Determine whether the non-mutually exclusive function subset includes the target function; if so, execute step S24.

[0084] S24. Determine that the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function.

[0085] In this embodiment, if the target function exists in the non-mutually exclusive function subset, it is considered that it is not mutually exclusive with the voice interaction function, and the two can be executed simultaneously. If the target function exists in the mutually exclusive function subset, it is considered that it is mutually exclusive with the voice interaction function, and the two cannot be executed simultaneously. That is, when the mutually exclusive function subset includes the target function corresponding to the user operation instruction, it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

[0086] It should be noted that the functions in the non-mutually exclusive function subset and the mutually exclusive function subset can be adjusted according to needs, such as adding or deleting some functions in the subset, or adjusting the functions in the non-mutually exclusive function subset to the mutually exclusive function subset, or adjusting the functions in the mutually exclusive function subset to the non-mutually exclusive function subset, which can be specifically configured according to actual needs.

[0087] S13. In response to the user operation instruction, execute the target operation corresponding to the user operation instruction.

[0088] If the target function corresponding to the user operation instruction can be executed simultaneously with the voice interaction function, then in response to the user operation instruction, execute the target operation corresponding to the user operation instruction. For example, if the user clicks the "Zoom in / out" operation, then call the "Zoom in / out" function to zoom in or out the map. If the user clicks the "Drag and move the map" operation, then call the "Drag and move the map" function to drag and move the map.

[0089] In practical applications, during the execution of the voice interaction process, the display interface of the electronic device can display the content of the user's voice interaction. If the user clicks other operations, such as the "Drag and move the map" operation, at this time, the drag interface of the map needs to be displayed. In order to prevent the voice interaction content from affecting the display effect and display space of the "Drag and move the map" operation, in this embodiment, after determining that the target function corresponding to the user operation instruction can be executed simultaneously with the voice interaction function and before executing step S13, an adjustment operation can be performed on the attribute information of the voice interaction display box. The attribute information in this embodiment mainly refers to the size and position.

[0090] Specifically, taking the example of clicking the "Drag and move the map" operation during the voice interaction process, since the "Drag and move the map" function needs to be called to drag and move the map, at this time, the drag effect of the map needs to be displayed on the display interface. If the voice interaction display box is relatively large, then the display interface for dragging and moving the map will be relatively small, which is not conducive to the user viewing the map. Therefore, in this embodiment, the size of the voice interaction display box will be adjusted. Generally, the voice interaction display box will be reduced, such as reduced to a specified size, and the specified size can be, for example, 2 cm * 2 cm.

[0091] In addition, in order to prevent the display position of the voice interaction display box from blocking or affecting the display effect of dragging and moving the map, in this embodiment, the display position of the voice interaction display box after size adjustment will also be adjusted to the specified display position.

[0092] Among them, the specified display position is generally a position that does not affect the execution of the target operation, and can be, for example, the upper left corner status bar.

[0093] In this embodiment, by reducing the voice interaction display box and adjusting its position to the specified display position, it can ensure that there is sufficient display space when executing the target operation and improve the user experience.

[0094] S14. Control the running state of the voice interaction function to switch to the delayed listening state.

[0095] In practical applications, during the execution of a voice interaction operation, when a user operation instruction is received, if it is determined through the above steps that the user operation instruction is executable, the target operation corresponding to the user operation instruction is executed. At this time, the voice conversation and the voice list are not affected and continue to maintain the current state.

[0096] To ensure that the user's voice output is timely responded to the user's voice instruction, the running state of the voice interaction function can be switched to the delayed listening state.

[0097] The delayed listening state in this embodiment means that the user voice is continuously monitored. If a user voice instruction is received within the preset delayed listening time, it is responded to; if not, the voice interaction function is exited. Among them, the preset delayed listening time can be configured according to the actual situation, such as 30 seconds.

[0098] In practical applications, multiple running states of the voice interaction function are pre-configured, such as the normal running state, the abnormal running state, the delayed listening state, etc. Each state has corresponding identification information. For example, 1 is used to identify the normal running state, 2 is used to identify the abnormal running state, and 3 is used to identify the delayed listening state.

[0099] Therefore, in this embodiment, the identification information corresponding to the delayed listening state can be obtained, and then the content of the running state of the voice interaction function is adjusted to the identification information corresponding to the delayed listening state to achieve the state switch.

[0100] It should be noted that in addition to using the delayed listening state, the running state of the voice interaction function can also be configured as the normal running state, but a countdown timer is set. If a user voice is received within the specified time (which can be the same as the preset delayed listening time) before the countdown timer times out, it is responded to; if no user voice is received, the voice interaction function is exited.

[0101] In addition, there is no restriction on the execution order between step S13 and step S14. They can be executed simultaneously, or step S13 can be executed first and then step S14, or step S14 can be executed first and then step S13.

[0102] S15. After successfully switching to the delayed listening state, determine whether a user voice instruction is received within the preset delayed listening time; if so, execute step S16; if not, execute step S17.

[0103] Specifically, since in the delayed listening state, only the user voice instruction within the preset delayed listening time is supported, in this embodiment, it is necessary to determine whether a user voice instruction is received within the preset delayed listening time after successfully switching to the delayed listening state.

[0104] At this time, within the preset delay listening time, user speech can be collected, and then an intention recognition operation can be performed on the user speech.

[0105] Specifically, perform a speech recognition operation on the user speech to obtain the corresponding text information, then perform a keyword extraction operation on it, and perform intention recognition based on the extracted keywords to obtain an intention recognition result.

[0106] For example, the user speech is "Help me switch the navigation route". After converting it into text information, extract the keywords "switch" and "navigation route", and perform intention recognition using the keywords, and the user's intention to switch the navigation route can be obtained.

[0107] If a preset intention recognition result is recognized, it is determined that a user speech command has been received. The preset intention recognition result in this embodiment can be set as an intention recognition result related to the map function, such as switching the navigation route as described above.

[0108] In practical applications, if the delay listening state cannot be successfully switched, an attempt can be made to switch again. If the delay listening state cannot be successfully switched after multiple attempts, the voice interaction function is exited, and the user is prompted that the voice interaction function has a fault and is temporarily unavailable.

[0109] S16. Respond to the user speech command and perform a voice interaction operation.

[0110] Specifically, perform an operation corresponding to the intention recognition result. For example, if the user speech is "Help me switch the navigation route", at this time, all available routes can be displayed on the interface, and the user is prompted by voice "There are currently X routes, please select which one to use".

[0111] The user can output the selected route by voice, and at this time, the selected route is used for navigation operation.

[0112] S17. Control the voice interaction function to perform a function exit operation.

[0113] Specifically, if no user speech is received within the preset delay listening time, it means that the user has no voice interaction requirement for the time being. At this time, control the voice interaction function to perform a function exit operation to avoid the function running and occupying memory.

[0114] In this embodiment, if a user operation instruction is received during the execution of the voice interaction operation, it is determined whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function. If so, it means that the user operation and the voice interaction can be responded to simultaneously. Then, the user operation instruction is responded to, the target operation corresponding to the user operation instruction is executed, and the voice interaction function is controlled to run in the delayed listening state. After successfully switching to the delayed listening state, it is determined whether a user voice instruction is received within the preset delayed listening time. If a user voice instruction is received, the user voice instruction is responded to and a voice interaction operation is performed. That is, through the present invention, if there are both a voice interaction operation and other user operations and they can be executed simultaneously, the two operations are executed simultaneously, improving the user experience. Further, if no user voice instruction is received within the preset delayed listening time, it means that the user no longer needs the voice interaction operation. At this time, the voice interaction function is controlled to perform a function exit operation, releasing the resources occupied by the voice interaction function, avoiding the situation where other operations cannot be correctly executed due to lack of resources caused by the voice interaction function occupying resources, and improving the user experience.

[0115] In addition, when a conflict occurs between voice interaction and touch interaction in the embodiment of the present invention, the problem that the electronic device cannot correctly respond to the user operation due to the conflict between the two is avoided, and the user experience when using voice interaction and touch interaction simultaneously is reasonably balanced, allowing the user to conveniently perform dual-operation interaction.

[0116] On the basis of the above content, when the mutually exclusive function subset includes the target function corresponding to the user operation instruction, it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function. Refer to Figure 3 , in the case where it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, it further includes:

[0117] S38. Respond to the user operation instruction, execute the target operation corresponding to the user operation instruction, and control the voice interaction function to perform a function exit operation.

[0118] In this embodiment, for responding to the user operation instruction and executing the target operation corresponding to the user operation instruction, please refer to the above corresponding description.

[0119] This step of controlling the voice interaction function to perform a function exit operation in this step has different implementation manners when the target operations are different, and will be introduced separately below.

[0120] Referring to Table 2, the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function.

[0121] Specifically, the mutually exclusive function subset includes a first control function and a first message function when the map state is the main map state, and a second control function and a second message function when the map state is the navigation state.

[0122] In Table 2, the first control function includes functions such as forming a team, returning to the parking space, setting up a point, toolbox, search entry, etc. The first message function includes the function of cloud control messages (closing, viewing the route). The second control function includes functions such as continuing navigation, forming a team, exiting, long-pressing the map, selecting a point, toolbox, searching along the way, parking lot guidance, route refreshing, etc. The second message function includes two functions, namely, the highway dashboard and cloud control messages (closing, details).

[0123] According to different function types, during the voice conversation process, when a touch operation is received, the end timing of the voice conversation is different. For example, the end timing of the first control function and the second control function is "after clicking". Specifically, "after clicking" means receiving the user operation instruction, that is, when the target function corresponding to the user operation instruction is the first control function or the second control function, after receiving the user operation instruction, controlling the voice interaction function to perform a function exit operation. Controlling the voice interaction function to perform a function exit operation can be, for example, exiting the voice multi-round conversation, exiting the voice list display, etc.

[0124] The end timing of the first message function and the second message function is "when displaying". "When displaying" means when using the first message function or the second message function for message display, that is, when the target function corresponding to the user operation instruction is the first message function or the second message function, when using the first message function or the second message function for message display, controlling the voice interaction function to perform a function exit operation.

[0125] In this embodiment, setting two different end timings is to ensure the normal operation of the target function in different function execution scenarios.

[0126] It should be noted that for the specific implementation of steps S31 - S37 in this embodiment, please refer to the corresponding descriptions above.

[0127] Based on the above embodiment of the instruction processing method, another embodiment of the present invention provides an instruction processing device, referring to Figure 4 , which may include:

[0128] An instruction determination module 11, configured to determine, during the execution of the voice interaction operation, if a user operation instruction is received, whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; the voice interaction function is used to perform the voice interaction operation;

[0129] The instruction response module 12 is used to, if so, respond to the user operation instruction and execute the target operation corresponding to the user operation instruction;

[0130] The voice control module 13 is used to control the operating state of the voice interaction function to switch to the delayed listening state;

[0131] The voice reception judgment module 14 is used to judge whether a user voice instruction is received within a preset delayed listening time after successfully switching to the delayed listening state;

[0132] The voice processing module 15 is used to, if a user voice instruction is received, respond to the user voice instruction and perform voice interaction operations; if no user voice instruction is received, control the voice interaction function to perform a function exit operation.

[0133] Furthermore, the instruction determination module 11 includes:

[0134] The function determination sub-module is used to determine the target function corresponding to the user operation instruction;

[0135] The set acquisition sub-module is used to acquire a pre-configured function set; the function set includes a non-mutually exclusive function subset; the non-mutually exclusive function subset includes functions that can be executed simultaneously with the voice interaction function;

[0136] The judgment sub-module is used to judge whether the non-mutually exclusive function subset includes the target function;

[0137] The determination sub-module is used to, if so, determine that the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function.

[0138] Furthermore, it further includes:

[0139] The operation processing module is used to, when it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, respond to the user operation instruction, execute the target operation corresponding to the user operation instruction, and control the voice interaction function to perform a function exit operation.

[0140] Furthermore, the mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function;

[0141] When the operation processing module is used to determine that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, specifically:

[0142] When the mutually exclusive function subset includes the target function corresponding to the user operation instruction, determine that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

[0143] Furthermore, it further includes:

[0144] A display box adjustment module for performing adjustment operations on the attribute information of the voice interaction display box.

[0145] Furthermore, the display box adjustment module is specifically configured to:

[0146] Adjust the icon size of the voice interaction display box, and adjust the display position of the voice interaction display box with the adjusted icon size to a specified display position.

[0147] Furthermore, the voice control module 13 is specifically configured to:

[0148] Obtain the identification information corresponding to the delayed listening state, and adjust the operation state content of the voice interaction function to the identification information corresponding to the delayed listening state.

[0149] Furthermore, when the voice reception judgment module 14 is used to judge whether a user voice command is received within a preset delayed listening time, it is specifically configured to:

[0150] Within the preset delayed listening time, collect the user voice and perform an intention recognition operation on the user voice. If a preset intention recognition result is recognized, it is determined that a user voice command is received.

[0151] In this embodiment, if a user operation command is received during the execution of the voice interaction operation, it is determined whether the user operation command is a command that can be executed simultaneously with the voice interaction function. If so, it means that the user operation and the voice interaction can be responded to simultaneously. Then, respond to the user operation command, execute the target operation corresponding to the user operation command, control the voice interaction function to run in the delayed listening state. After successfully switching to the delayed listening state, judge whether a user voice command is received within the preset delayed listening time. If a user voice command is received, respond to the user voice command and perform a voice interaction operation. That is, through the present invention, if there are both voice interaction operations and other user operations and they can be executed simultaneously, the two operations are executed simultaneously to improve the user experience. Furthermore, if no user voice command is received within the preset delayed listening time, it means that the user no longer needs the voice interaction operation. At this time, control the voice interaction function to perform a function exit operation, release the resources occupied by the voice interaction function, and avoid the situation that other operations cannot be correctly executed due to the lack of resources caused by the voice interaction function occupying resources, thereby improving the user experience.

[0152] It should be noted that for the specific implementation of each module in this embodiment, please refer to the corresponding description in the above embodiment, and details are not described herein again.

[0153] Based on the above embodiments of the instruction processing method and device, another embodiment of the present invention provides an electronic device, including: a memory and a processor;

[0154] Among them, the memory is used to store programs;

[0155] The processor calls the program and is used to execute the above-mentioned instruction processing method.

[0156] The electronic device in this embodiment can be an in-vehicle multimedia host HUT. In practical applications, a system composed of a cloud platform, a T-BOX (Telematics Box, in-vehicle wireless terminal), an in-vehicle multimedia host HUT, a mobile phone terminal, etc. can be configured to facilitate users to initiate navigation. Among them, the HUT mainly provides the display of function effect realization, the logical judgment and decision-making of instruction execution. The T-BOX provides a network channel for communication between the cloud platform and the HUT. The cloud platform mainly performs the parsing of instructions, the issuance of intentions, and the reply after the decision-making. For example, when obtaining or updating map data, the HUT outputs a map data acquisition or update instruction, which is output to the cloud platform through the T-BOX. The cloud platform outputs the latest map data to the HUT through the T-BOX, and the HUT forwards it to the map module for update.

[0157] Modules such as maps can also execute corresponding execution instructions and be reflected on the HMI (Human Machine Interface). For example, the navigation route is displayed through the HMI.

[0158] In this embodiment, if a user operation instruction is received during the execution of the voice interaction operation, it is determined whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function. If so, it means that the user operation and the voice interaction can be responded to simultaneously. Then, the user operation instruction is responded to, the target operation corresponding to the user operation instruction is executed, and the voice interaction function is controlled to run in the delayed listening state. After successfully switching to the delayed listening state, it is judged whether a user voice instruction is received within the preset delayed listening time. If a user voice instruction is received, the user voice instruction is responded to for voice interaction operation. That is, through the present invention, if there are both voice interaction operations and other user operations and the two can be executed simultaneously, the two operations are executed simultaneously to improve the user experience. Further, if no user voice instruction is received within the preset delayed listening time, it means that the user no longer needs the voice interaction operation. At this time, the voice interaction function is controlled to execute a function exit operation to release the resources occupied by the voice interaction function, avoiding the situation that other operations cannot be correctly executed due to no resources available because the voice interaction function occupies resources, and improving the user experience.

[0159] The foregoing description of the disclosed embodiments enables those skilled in the art to practice or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An instruction processing method, characterized in that, Including: During the execution of the voice interaction operation, if a user operation instruction is received, determine whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function; The voice interaction function is used to execute the voice interaction operation; If so, in response to the user operation instruction, execute the target operation corresponding to the user operation instruction; Control the running state of the voice interaction function to switch to the delayed listening state; After successfully switching to the delayed listening state, determine whether a user voice instruction is received within the preset delayed listening time; If a user voice instruction is received, in response to the user voice instruction, perform a voice interaction operation; If no user voice instruction is received, control the voice interaction function to perform a function exit operation.

2. The instruction processing method according to claim 1, characterized in that, Determining whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function includes: Determine the target function corresponding to the user operation instruction; Obtain a pre-configured function set; the function set includes a non-mutually exclusive function subset; the non-mutually exclusive function subset includes functions that can be executed simultaneously with the voice interaction function; Determine whether the non-mutually exclusive function subset includes the target function; If so, determine that the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function.

3. The instruction processing method according to claim 1, characterized in that, In the case where it is determined that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function, it further includes: In response to the user operation instruction, execute the target operation corresponding to the user operation instruction, and control the voice interaction function to perform a function exit operation.

4. The instruction processing method according to claim 3, characterized in that, The mutually exclusive function subset includes functions that cannot be executed simultaneously with the voice interaction function; Determining that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function includes: When the mutually exclusive function subset includes the target function corresponding to the user operation instruction, determine that the user operation instruction is not an instruction that can be executed simultaneously with the voice interaction function.

5. The instruction processing method according to claim 1, characterized in that, Before responding to the user operation instruction and executing the target operation corresponding to the user operation instruction, it further includes: Perform an adjustment operation on the attribute information of the voice interaction display box.

6. The instruction processing method according to claim 5, characterized in that, Performing an adjustment operation on the attribute information of the voice interaction display box includes: Adjust the size of the voice interaction display box; Adjust the display position of the voice interaction display box with the adjusted size to the specified display position.

7. The instruction processing method according to claim 1, characterized in that, Controlling the running state of the voice interaction function to switch to the delayed listening state includes: Obtain the identification information corresponding to the delayed listening state; Adjust the running state content of the voice interaction function to the identification information corresponding to the delayed listening state.

8. The instruction processing method according to claim 1, characterized in that, The determination of whether a user voice instruction is received within the preset delayed listening time includes: Within the preset delayed listening time, collect user voice and perform an intention recognition operation on the user voice; If a preset intention recognition result is recognized, determine that a user voice instruction is received.

9. An instruction processing device, characterized in that, Including: An instruction determination module, which is used to determine whether the user operation instruction is an instruction that can be executed simultaneously with the voice interaction function during the execution of the voice interaction operation; the voice interaction function is used to execute the voice interaction operation; An instruction response module, which is used to, if so, respond to the user operation instruction and execute a target operation corresponding to the user operation instruction; A voice control module, which is used to control the running state of the voice interaction function to switch to a delayed listening state; A voice reception judgment module, which is used to judge whether a user voice instruction is received within a preset delayed listening time after successfully switching to the delayed listening state; A voice processing module, which is used to, if a user voice instruction is received, respond to the user voice instruction and perform a voice interaction operation; if a user voice instruction is not received, control the voice interaction function to execute a function exit operation.

10. An electronic device, characterized in that, Comprising: A memory and a processor; Wherein, the memory is used to store a program; The processor calls the program and is used to execute the instruction processing method according to any one of claims 1-8.

Images