Function execution method, function execution device and electronic equipment

Abstract

The invention discloses a function execution method, a function execution device and electronic equipment, and belongs to the technical field of communication. The function execution method comprises the following steps: receiving touch input and voice input; in response to the touch input and the voice input, executing a function operation corresponding to the voice input based on input information of the touch input; wherein the input information of the touch input comprises at least one of a touch object of the touch input, starting position information and ending position information of the touch input and direction information corresponding to the touch input; the touch object comprises any one of the application icon, the interface content and the application interface.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to a function execution method, a function execution device and an electronic device. Background Art

[0002] With the development of electronic devices, the functions that electronic devices can perform are increasing.

[0003] At present, users can trigger electronic devices to perform corresponding functions by performing touch input on electronic devices, such as tap input, long press input, and sliding input. For example, a user can trigger the mobile phone to open the main interface of a social application by tapping the icon of the social application on the mobile phone desktop. Then, the mobile phone can be triggered to display at least one contact avatar by tapping the contact control on the main interface of the social application. Then, one of the contact avatars is tapped to trigger the mobile phone to display a chat interface between the user and the contact. Finally, enter the chat text in the text input box on the chat interface and click the send control to trigger the mobile phone to send the chat text to the contact and chat with the contact.

[0004] When the user triggers the electronic device to execute the function through touch input, the operation steps of the touch input are usually complicated, which makes the operation convenience of the electronic device poor. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a function execution method, a function execution device and an electronic device, which can improve the convenience of function operation of the electronic device.

[0006] In a first aspect, an embodiment of the present application provides a function execution method, the method comprising:

[0007] Receive touch input and voice input;

[0008] In response to the touch input and the voice input, based on the input information of the touch input, the function operation corresponding to the voice input is executed;

[0009] The input information of the touch input includes at least one of a touch object of the touch input, start position information of the touch input, end position information of the touch input, and direction information corresponding to the touch input;

[0010] The touch object includes any one of the application icon, interface content and application interface.

[0011] In a second aspect, an embodiment of the present application provides a function execution device, the device comprising:

[0012] A receiving module, used for receiving touch input and voice input;

[0013] An execution module, configured to respond to the touch input and the voice input and execute a function operation corresponding to the voice input based on input information of the touch input;

[0014] The input information of the touch input includes at least one of a touch object of the touch input, start position information of the touch input, end position information of the touch input, and direction information corresponding to the touch input;

[0015] The touch object includes any one of the application icon, interface content and application interface.

[0016] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the function execution method described in the first aspect are implemented.

[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the function execution method described in the first aspect are implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the function execution method described in the first aspect.

[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the function execution method as described in the first aspect.

[0020] In the embodiment of the present application, touch input and voice input are received; in response to the touch input and voice input, based on at least one of the touch object of the touch input, the start position information of the touch input, the end position information of the touch input, and the direction information corresponding to the touch input, the function operation corresponding to the voice input is performed. In this way, when the electronic device performs the corresponding function operation, the operation steps of the touch input can be effectively simplified, thereby effectively improving the convenience of operation of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a flowchart of a function execution method provided in an embodiment of the present application;

[0022] Figure 2 It is a flowchart of a function execution method provided in an embodiment of the present application;

[0023] Figure 3It is a flowchart of a function execution method provided in an embodiment of the present application;

[0024] Figure 4 It is a flowchart of a function execution method provided in an embodiment of the present application;

[0025] Figure 5 It is a flowchart of a function execution method provided in an embodiment of the present application;

[0026] Figure 6 It is a flowchart of a function execution method provided in an embodiment of the present application;

[0027] Figure 7 It is a flowchart of a function execution method provided in an embodiment of the present application;

[0028] Figure 8 It is a flowchart of a function execution method provided in an embodiment of the present application;

[0029] Fig. 9A This is a schematic diagram of an interface touch input provided by an embodiment of the present application;

[0030] Fig. 9B This is a schematic diagram of an interface touch input provided by an embodiment of the present application;

[0031] Fig. 9C This is a schematic diagram of an interface touch input provided by an embodiment of the present application;

[0032] Fig.10 It is a structural diagram of a function execution device provided in an embodiment of the present application;

[0033] Fig.11 It is a structural diagram of a function execution device provided in an embodiment of the present application;

[0034] Fig.12 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0035] Fig.13 It is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0037] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0038] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0039] The function execution method, function execution device, electronic device and medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0040] The function execution method, function execution device and electronic device provided in the embodiments of the present application can be applied to the scenario where a user obtains a service by executing a function operation through an electronic device. Through the embodiments of the present application, the electronic device can automatically execute the function operation corresponding to the touch input and voice input based on the user's touch input and voice input.

[0041] The following is an illustrative description of the function execution method provided in the embodiments of the present application by taking some specific scenarios as examples.

[0042] Scenario 1: The user triggers the chat function on the phone

[0043] The user clicks on the icon of a social application and inputs "send a message to friend a" through voice, which triggers the mobile phone to open the chat interface of the social application, and the chat interface is the chat interface between the user and friend a.

[0044] Scenario 2: The user triggers the navigation function of the mobile phone

[0045] The user taps point A and point B on the interface of a map application and inputs "navigation" through voice, which triggers the mobile phone to display the navigation path from point A to point B.

[0046] Scenario 3: User triggers the copy function on the phone

[0047] The user taps points C, D, E and F on the interface of a document application and inputs "copy document content" through voice, triggering the mobile phone to copy the document content in the interface area formed by points C, D, E and F on the interface of the document application.

[0048] Scenario 4: The user triggers the small window function on the phone

[0049] The user swipes down and to the left on the current interface of the phone and inputs "small window display" through voice, triggering the phone to display the current interface as a small window in the lower left corner of the phone screen.

[0050] Scenario 5: The user triggers the drawing function of the mobile phone

[0051] The user drags and inputs on the interface of a painting application and inputs "red" through voice, which triggers the mobile phone to fill the line segment or pattern drawn by the user with red according to the starting position information, ending position information and direction information corresponding to the dragging input.

[0052] It should be noted that the above-mentioned scenarios 1 to 5 are only exemplary examples of some scenarios in which the embodiments of the present application may be applied. In actual implementation, the embodiments of the present application can also be applied to more any possible scenarios, and the embodiments of the present application are not limited here.

[0053] Based on the above-mentioned scenarios applied by the embodiments of the present application, the function execution method provided by the embodiments of the present application can receive touch input and voice input; in response to the touch input and voice input, based on the touch object of the touch input, the starting position information of the touch input, the ending position information, and at least one of the direction information corresponding to the touch input, the function operation corresponding to the voice input is executed. In this solution, the user can trigger the execution of the corresponding function operation through touch input and voice input. In this way, the operation steps of the touch input are simplified, the operation convenience of the electronic device is improved, and the human-computer interaction performance is improved.

[0054] The execution subject of the function execution method provided in the embodiment of the present application may be a function execution device. Exemplarily, the function execution device may be an electronic device, or a functional component or functional entity in the electronic device. The function execution method provided in the embodiment of the present application will be exemplarily described below by taking the execution subject as an electronic device as an example.

[0055] Figure 1 is a flow chart of a function execution method provided in an embodiment of the present application, such as Figure 1 As shown, the function execution method provided in the embodiment of the present application may include the following steps 101 and 102.

[0056] Step 101: An electronic device receives touch input and voice input.

[0057] In some embodiments of the present application, the touch input may be an input by a user in a first interface. The first interface may be any interface including an interactive interface, for example, the first interface may be a desktop interface, an application interface, and the like.

[0058] In some embodiments of the present application, the above-mentioned application interface may be an interface of a first application, and the above-mentioned first application may be any application in an electronic device, which is not limited in the present application.

[0059] In some embodiments of the present application, the first application may include but is not limited to any of the following: navigation applications, social software applications, shopping applications, video applications, photo album applications, music applications, painting applications, document applications, etc. The specific application may be determined according to actual usage requirements and is not limited in the embodiments of the present application.

[0060] In some embodiments of the present application, the above-mentioned touch input can be a touch input performed by a user on the electronic device through a touch device such as a finger or a stylus.

[0061] Optionally, in an embodiment of the present application, the above-mentioned touch input can be a point input, a single-click input, a double-click input, any number of click inputs, a sliding input, a drag input, a pressure recognition input, a long press input, etc. The specific touch input form can be determined according to actual needs and is not limited to this in some embodiments.

[0062] Step 102: The electronic device responds to the touch input and the voice input and performs a function operation corresponding to the voice input based on the input information of the touch input.

[0063] In some embodiments of the present application, the input information of the touch input includes at least one of the touch object of the touch input, the starting position information of the touch input, the ending position information of the touch input, and the direction information corresponding to the touch input;

[0064] The above-mentioned touch object includes any one of an application icon, interface content and an application interface.

[0065] In some embodiments of the present application, when the first interface is a desktop interface, the input information may include an application icon on the desktop interface.

[0066] In some embodiments of the present application, the electronic device may obtain the touch position of the touch input on the desktop interface, and then determine the application icon corresponding to the touch position according to the interface content of the desktop interface.

[0067] Example 1, combined with scenario 1, when the application icon of a social application is displayed at the upper left corner of the desktop interface, if the user performs touch input on the upper left corner of the desktop interface, that is, the touch position of the touch input on the desktop interface is the upper left corner of the desktop interface, then the touch object is the application icon of the social application.

[0068] In some embodiments of the present application, when the first interface is an application interface, the touch object may include any one of interface content and application interface.

[0069] In some embodiments of the present application, the touch input may include at least one touch sub-input. The electronic device may obtain the touch position of each touch sub-input in the at least one touch sub-input on the application interface, and then obtain the interface content, which may be the interface content corresponding to each touch position, or the interface content may be the interface content corresponding to the at least one touch position.

[0070] Example 2. In combination with scenario 2, when the above-mentioned application interface is the application interface of a map application, the above-mentioned touch input may include a user's touch sub-input of point A on the application interface of the map application and a touch sub-input of point B on the application interface of the map application, that is, the touch positions of the two touch sub-inputs on the application interface of the map application are point A and point B. The electronic device can determine the geographical location corresponding to point A and the geographical location corresponding to point B based on the interface content of the application interface of the map application, that is, the interface content corresponding to each of the above-mentioned touch positions is the geographical location corresponding to point A and the geographical location corresponding to point B.

[0071] Example three, in combination with scenario 3, when the above-mentioned application interface is the application interface of a document application, the above-mentioned touch input may include the user's touch sub-input at point C on the application interface of the document application, the touch sub-input at point D on the application interface of the document application, the touch sub-input at point E on the application interface, and the touch sub-input at point F on the application interface of the document application, that is, the touch positions of the four touch sub-inputs on the application interface of the document application are point C, point D, point E and point F. The electronic device can determine the document content within the interface area composed of points C, D, E and F on the application interface of the document application based on the interface content of the application interface of the document application, that is, the interface content corresponding to the above at least one touch position is the document content within the interface area composed of points C, D, E and F on the application interface of the document application.

[0072] Example 4: In combination with scenario 4 or scenario 5, when the touch input is a lower left sliding input or a dragging input to the application interface, the electronic device can determine that the touch object is the application interface.

[0073] In some embodiments of the present application, Figure 1 ,like Figure 2 As shown, the above step 102 can be implemented through the following steps 102a to 102c:

[0074] Step 102a: The electronic device obtains a shortcut command set corresponding to the input information in response to the touch input.

[0075] In some embodiments of the present application, when the touch object includes the application icon, the electronic device can obtain a shortcut command set related to the target application in response to the touch input, and the application icon is the application icon of the target application.

[0076] In some embodiments of the present application, when the touch object includes interface content or an application interface, the electronic device can obtain a shortcut command set corresponding to the first application, and then obtain a shortcut command subset corresponding to the input information from the shortcut command set corresponding to the first application.

[0077] Example 5, combined with Example 1, the above shortcut command set may be a shortcut command set of a social application. The electronic device may obtain a shortcut command set of a social application through a shortcut command interface of the social application. The shortcut command set of the social application may include a shortcut command for sending a message to any contact of the social application, a shortcut command for initiating a video call to any contact of the social application, a shortcut command for initiating a voice call to any contact of the social application, a shortcut command for adding a friend, a shortcut command for sharing a social circle, etc.

[0078] Example six, in combination with Example two, the electronic device can obtain a shortcut command set of the map application through the shortcut command interface of the map application, and then obtain a shortcut command subset corresponding to the geographic location corresponding to point A and the geographic location corresponding to point B from the shortcut command set of the map application. The shortcut command subset corresponding to the geographic location corresponding to point A and the geographic location corresponding to point B may include, for example, shortcut commands for measuring the distance between the geographic location corresponding to point A and the geographic location corresponding to point B, shortcut commands for navigating from the geographic location corresponding to point A to the geographic location corresponding to point B, etc.

[0079] Example seven, in combination with Example three, the electronic device may obtain a shortcut command set of the document application through the shortcut command interface of the document application, and then obtain a shortcut command subset corresponding to the document content in the interface area composed of points C, D, E and F on the application interface of the document application from the shortcut command set of the document application. The shortcut command subset corresponding to the document content in the interface area composed of points C, D, E and F on the application interface of the document application may include, for example, shortcut commands for copying the document content in the interface area composed of points C, D, E and F on the application interface of the document application, shortcut commands for deleting the document content in the interface area composed of points C, D, E and F on the application interface of the document application, shortcut commands for modifying the font of the document content in the interface area composed of points C, D, E and F on the application interface of the document application, shortcut commands for adding an underline under the document content in the interface area composed of points C, D, E and F on the application interface of the document application, etc.

[0080] Example 8. In combination with Example 4, the electronic device may obtain the shortcut command set of the first application through the shortcut command interface of the first application, and then obtain a shortcut command subset corresponding to the application interface of the first application and the direction information of the lower left sliding input from the shortcut command set of the document application. The shortcut command subset corresponding to the application interface of the first application and the direction information of the lower left sliding input may include, for example, a shortcut command for running the application interface of the first application in the background, a shortcut command for displaying the application interface of the first application in a small window in the lower left corner of the screen, a shortcut command for closing the application interface of the first application, a shortcut command for reducing the display brightness of the application interface of the first application, etc.

[0081] Example 9. In combination with Example 5, the electronic device may obtain a shortcut command set of the drawing application through the shortcut command interface of the drawing application, and then obtain a shortcut command subset corresponding to the application interface of the drawing application and the starting position information, ending position information, and direction information of the drag input on the application interface of the drawing application from the shortcut command set of the drawing application. The shortcut command subset corresponding to the application interface of the drawing application and the starting position information, ending position information, and direction information of the drag input on the application interface of the drawing application may include, for example, shortcut commands for erasing the line segments or patterns corresponding to the starting position information, ending position information, and direction information on the application interface of the drawing application, shortcut commands for drawing the line segments or patterns corresponding to the starting position information, ending position information, and direction information on the application interface of the drawing application, shortcut commands for filling the line segments or patterns corresponding to the starting position information, ending position information, and direction information drawn on the application interface of the drawing application with different colors, shortcut commands for changing the display position of the line segments or patterns corresponding to the starting position information, ending position information, and direction information drawn on the application interface of the drawing application, and the like.

[0082] Step 102b: In response to the voice input, the electronic device obtains at least one shortcut command that matches the semantic information from a shortcut command set based on the semantic information corresponding to the voice input.

[0083] In some embodiments of the present application, the electronic device may respond to the voice input by performing a recognition operation on the voice input, obtaining text information corresponding to the voice input, and then performing semantic understanding on the text information to obtain semantic information corresponding to the voice input.

[0084] In some embodiments of the present application, obtaining at least one shortcut command matching the semantic information from the above-mentioned shortcut command set can be understood as: obtaining at least one shortcut command from the above-mentioned shortcut command set whose similarity with the semantic information is greater than or equal to the second threshold.

[0085] Example 10: In combination with scenario 1, the electronic device may obtain at least one shortcut execution from the shortcut command set of the social application, the degree of matching with the above semantic information being greater than or equal to the second threshold.

[0086] Example 11, in combination with scenario 2, the electronic device can obtain at least one shortcut execution whose matching degree with the above semantic information is greater than or equal to the first threshold from the shortcut instruction subset corresponding to the geographic location corresponding to point A and the geographic location corresponding to point B.

[0087] Example 12. In combination with scenario 3, the electronic device can obtain at least one shortcut execution whose matching degree with the above semantic information is greater than or equal to the second threshold from the shortcut command subset corresponding to the document content in the interface area composed of points C, D, E and F on the application interface of the document application.

[0088] Example 13, in combination with scenario 4, the electronic device can obtain at least one shortcut execution whose matching degree with the above semantic information is greater than or equal to the second threshold from the shortcut instruction subset corresponding to the application interface of the first application and the direction information of the left sliding input.

[0089] Example fourteen, in combination with scenario 5, the electronic device can obtain at least one shortcut execution whose matching degree with the above semantic information is greater than or equal to the second threshold from the shortcut command subset corresponding to the application interface of the drawing application and the starting position information, ending position information and direction information of the drag input on the application interface of the drawing application.

[0090] Step 102c: The electronic device executes a functional operation corresponding to the voice input based on a degree of matching between each shortcut instruction in at least one shortcut instruction and the semantic information.

[0091] In this way, the electronic device obtains a shortcut command set corresponding to the input information in response to touch input; in response to voice input, based on the semantic information corresponding to the voice input, obtains at least one shortcut command matching the semantic information from the shortcut command set; based on the degree of matching between each shortcut command in at least one shortcut command and the semantic information, executes the functional operation corresponding to the voice input, so that when the electronic device executes the corresponding functional operation, it can effectively simplify the operation steps of the touch input, thereby effectively improving the operational convenience of the electronic device.

[0092] In some embodiments of the present application, Figure 2 ,like Figure 3 As shown, the above step 102c can be implemented by the following step 102c1 or the following step 102c2:

[0093] Step 102c1: When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is greater than or equal to a first threshold, the electronic device executes the functional operation indicated by the first shortcut instruction.

[0094] In some embodiments of the present application, the first shortcut command is a shortcut command that has the highest matching degree with the semantic information among the at least one shortcut command, and the second shortcut command is any shortcut command among the at least one shortcut command except the first shortcut command.

[0095] In some embodiments of the present application, the difference between the matching degree corresponding to the above-mentioned first shortcut instruction and the matching degree corresponding to the above-mentioned second shortcut instruction is greater than or equal to the above-mentioned first threshold, indicating that the matching degree corresponding to the above-mentioned first shortcut instruction is much greater than the matching degree corresponding to the shortcut instruction matching the above-mentioned semantic information, and the electronic device can directly execute the functional operation indicated by the above-mentioned first shortcut instruction.

[0096] In some embodiments of the present application, the electronic device can implement the functional operation indicated by the above-mentioned first shortcut instruction by executing the above-mentioned first shortcut instruction.

[0097] Example 15, in combination with scenario 1, when the above voice input is "send a message to friend a", the first shortcut command obtained by the electronic device from the shortcut command set of the social application can be a shortcut command for sending a message to friend a who is a contact of the social application.

[0098] Example 16, in combination with scenario 2, when the above voice input is "navigation", the electronic device obtains the first shortcut instruction from the shortcut instruction subset corresponding to the geographic location corresponding to point A and the geographic location corresponding to point B, which can be a shortcut instruction for navigating from the geographic location corresponding to point A to the geographic location corresponding to point B.

[0099] Example seventeen, in combination with scenario 3, when the above-mentioned voice input is "copy", the first shortcut instruction obtained by the electronic device from the shortcut instruction subset corresponding to the document content in the interface area composed of points C, D, E and F on the application interface of the document application may be a shortcut instruction for copying the document content in the interface area composed of points C, D, E and F on the application interface of the document application.

[0100] Example 18, in combination with scenario 4, when the above-mentioned voice input is "small window display", the electronic device obtains the first shortcut command from the shortcut command subset corresponding to the application interface of the first application and the direction information of the lower left sliding input, which can be a shortcut command for displaying the application interface of the first application in a small window in the lower left corner of the screen.

[0101] Example 19. In combination with scenario 5, when the above-mentioned voice input is "red", the electronic device obtains the first shortcut instruction from the shortcut instruction subset corresponding to the application interface of the drawing application and the starting position information, ending position information and direction information of the dragged input on the application interface of the drawing application. The shortcut instruction can be a shortcut instruction for filling the line segment or pattern corresponding to the starting position information, ending position information and direction information on the application interface of the drawing application with red.

[0102] Step 102c2: When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is less than a first threshold, the electronic device executes the functional operation indicated by the third shortcut instruction.

[0103] In some embodiments of the present application, the third shortcut command is a shortcut command selected by the user from the at least one shortcut command.

[0104] In some embodiments of the present application, if the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is less than the first threshold, it means that the matching degree corresponding to the first shortcut instruction is close to the matching degree corresponding to other shortcut instructions matching the semantic information, that is, the matching degrees corresponding to all shortcut instructions in the at least one shortcut instruction are close, then the electronic device may prompt the user to select a shortcut instruction from the at least one shortcut instruction. After determining that the third shortcut instruction is selected in the at least one shortcut instruction, the electronic device may execute the functional operation indicated by the third shortcut instruction.

[0105] In some embodiments of the present application, the electronic device can implement the functional operation indicated by the third shortcut instruction by executing the third shortcut instruction.

[0106] It should be noted that, if it is determined that there is only one shortcut instruction matching the above semantic information in the above shortcut instruction set, the electronic device may execute the functional operation corresponding to the one shortcut instruction matching the above semantic information.

[0107] In this way, the electronic device can effectively improve the accuracy of the electronic device's execution of the operation function by executing the function operation indicated by the first shortcut instruction when the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is greater than or equal to the first threshold value; the electronic device can effectively improve the accuracy of the electronic device's execution of the operation function by executing the function operation indicated by the third shortcut instruction when the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is less than the first threshold value, so that the electronic device can execute the corresponding function operation according to the user's choice, thereby improving the flexibility of the electronic device's operation function.

[0108] In the function execution method provided in the embodiment of the present application, by receiving touch input and voice input; responding to the touch input and voice input, based on at least one of the touch object of the touch input, the start position information of the touch input, the end position information of the touch input, and the direction information corresponding to the touch input, the function operation corresponding to the voice input is executed. In this way, when the electronic device executes the corresponding function operation, the operation steps of the touch input can be effectively simplified, thereby effectively improving the convenience of operation of the electronic device.

[0109] In some embodiments of the present application, Figure 3 ,like Figure 4 As shown, before the above step 102c2, the function execution method provided in the embodiment of the present application may further include the following step 103, and the above step 102c2 may be implemented by the following step A:

[0110] Step 103: The electronic device displays at least one instruction mark.

[0111] In some embodiments of the present application, each of the above-mentioned instruction identifiers corresponds to a shortcut instruction among the above-mentioned at least one shortcut instruction.

[0112] In some embodiments of the present application, each of the above-mentioned instruction identifiers may be an instruction identifier of a shortcut instruction among the above-mentioned at least one shortcut instruction.

[0113] In some embodiments of the present application, the above-mentioned instruction identifier can be a static identifier such as text, picture, symbol, etc., or a dynamic identifier such as an animated picture or video, etc. The specific instruction identifier form can be determined according to actual needs and is not limited to this in some embodiments.

[0114] In some embodiments of the present application, the electronic device may display the at least one instruction identifier on a screen component.

[0115] In some embodiments of the present application, the screen component may be a control in the electronic device that is not dependent on a certain application. In other words, the screen component may be displayed in any interface of the electronic device.

[0116] In some embodiments of the present application, the above-mentioned screen component may also be an atomic island.

[0117] In some embodiments of the present application, the above-mentioned atomic island is also called an interactive component, which is an interactive area similar to an "island" formed around the front camera. This area can also be understood as an interactive area in the screen corresponding to the front camera of the electronic device, and can also be called the atomic island area. The atomic island can include various status information, such as time, network status, battery power, etc., and can also display some simple notification messages, such as text messages, email notifications, etc. The atomic island is a brand-new status bar embedded interactive module, which can dynamically display electronic equipment such as mobile phone status information and application information running in the background, can interact by clicking, long pressing, and sliding, and can display a variety of information, such as including music playback, recording, Bluetooth headset connection, timer, ringtone, taxi, flight mode, etc., and can also call out a floating menu for simple operations, such as switching songs, pausing timers, etc.

[0118] In some embodiments of the present application, the shape of the screen assembly can be any possible shape such as a circle, a rectangle, a triangle, a rhombus, a ring or a polygon, etc. The specific shape can be determined according to actual use requirements and is not limited in the embodiments of the present application.

[0119] In some embodiments of the present application, the above-mentioned screen component can be fixedly displayed at a certain position on the screen.

[0120] Exemplarily, the screen component can be fixedly displayed in a preset position on the screen of the electronic device. For example, the preset position includes at least one of the following: a status bar, a notification bar, a task bar, and a virtual navigation bar.

[0121] In some embodiments of the present application, the above-mentioned screen component may be a floating control.

[0122] Exemplarily, the screen component may be displayed in a floating manner at any position on the screen. When the user drags the screen component, the screen component may move on the screen along with the dragging operation of the user.

[0123] It should be noted that, when the user wants to operate the screen component later, the screen component can be controlled to move through specific input.

[0124] In some embodiments of the present application, the above-mentioned screen component can also be displayed in a superimposed manner at the first position with a preset transparency.

[0125] For example, assuming that the preset transparency is recorded as T, the value range of T can be 0% <T<100%。

[0126] In some embodiments of the present application, the background color of the screen component may also change. For example, if the content of the first application program of the first application program changes, the background color of the screen component may also change accordingly.

[0127] In some embodiments of the present application, the above-mentioned screen component can also be displayed at high brightness or low brightness to remind the user of the specific display position of the screen component.

[0128] In actual implementation, the above screen component can be displayed in any possible form at a preset position. This embodiment of the present application does not specifically limit it. For example, the screen component can be displayed in a suspended state bar on the screen.

[0129] Step A: If the electronic device receives an input of a command identifier of a third shortcut command within a first time period, the electronic device executes a functional operation indicated by the third shortcut command.

[0130] In some embodiments of the present application, the electronic device may start a timer while displaying the at least one instruction identifier. When the timer duration is less than the first duration, if the electronic device receives input of the instruction identifier of the third shortcut instruction, the electronic device may execute the functional operation indicated by the third shortcut instruction.

[0131] In some embodiments of the present application, the input of the command identifier of the third shortcut command includes but is not limited to: the user touches the command identifier of the third shortcut command through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input. The specific input can be determined according to actual use requirements and is not limited in the embodiments of the present invention.

[0132] In some embodiments of the present application, the above-mentioned specific gesture can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture.

[0133] In some embodiments of the present application, the click input may be a single click input, a double click input, or any number of click inputs, and may also be a long press input or a short press input.

[0134] In some embodiments of the present application, the input of the instruction identifier of the third shortcut instruction is used to trigger the electronic device to run the first application in the background.

[0135] In this way, the electronic device displays at least one instruction identifier; if an input of an instruction identifier for a third shortcut instruction is received within the first time period, the functional operation indicated by the third shortcut instruction is executed, so that the electronic device can promptly execute the corresponding functional operation according to the user's selection, thereby improving the efficiency and flexibility of the electronic device's operating functions.

[0136] In some embodiments of the present application, Figure 4 ,like Figure 5 As shown, the function execution method provided in the embodiment of the present application may also include the following step 104:

[0137] Step 104: If the electronic device does not receive input of at least one instruction identifier within a first period of time, the electronic device displays a first prompt message.

[0138] In some embodiments of the present application, the first prompt information is used to prompt to re-perform at least one of touch input and voice input.

[0139] In some embodiments of the present application, if the timing duration of the above-mentioned timer reaches the above-mentioned first duration, and if the electronic device does not receive input of at least one instruction identifier within the first duration, the electronic device can update the above-mentioned at least one instruction identifier displayed in the above-mentioned screen component to the above-mentioned first prompt information.

[0140] In some embodiments of the present application, if the timing duration of the above-mentioned timer reaches the above-mentioned first duration, if the electronic device has not received any input of at least one instruction identifier within the first duration, the electronic device may no longer display the above-mentioned screen component, but display an information prompt pop-up window, and the above-mentioned information prompt pop-up window includes the above-mentioned first prompt information.

[0141] In this way, the electronic device can promptly prompt the user to re-perform at least one of touch input and voice input by displaying a first prompt message when no input to at least one instruction identifier is received within a first time period, thereby allowing the electronic device to perform corresponding functional operations based on the user's re-performing at least one of touch input and voice input, thereby improving the flexibility of the electronic device in performing functional operations.

[0142] In some embodiments of the present application, Figure 2 ,like Figure 6 As shown, the function execution method provided in the embodiment of the present application may also include the following step 105:

[0143] Step 105: If there is no shortcut command matching the voice information in the shortcut command set, the electronic device displays a first prompt message.

[0144] In some embodiments of the present application, there is no shortcut command matching the voice information in the shortcut command set, which can be understood as the matching degree between any shortcut command in the shortcut command set and the voice information is less than the second threshold.

[0145] In some embodiments of the present application, when the electronic device determines that there is no shortcut command matching the voice information in the shortcut command set, the electronic device displays the first prompt information in the screen component.

[0146] In this way, when the electronic device determines that there is no shortcut command matching the voice information in the shortcut command set, the electronic device displays a first prompt message, which can prompt the user to re-perform at least one of the touch input and voice input, so that the electronic device performs a corresponding functional operation based on the user's re-performing at least one of the touch input and voice input, thereby improving the flexibility of the electronic device in performing functional operations.

[0147] Figure 7 This is a flow chart of the function execution method provided in an embodiment of the present application. Taking the electronic device as a mobile phone and the touch input as a single tap input as an example, the method may include the following steps 201 to 209.

[0148] Step 201: The mobile phone receives a user's touch input and voice input.

[0149] For example, Fig. 9A As shown, the touch input may be a touch input by the user on the screen, and the voice input may be a command (such as "send a message to friend a") input by the user through voice.

[0150] Step 202: The mobile phone obtains application information of the touch point and stores it in a semantic set.

[0151] For example, the mobile phone can identify the application corresponding to the touch point based on the position information of the touch point on the desktop and the UI state of the desktop during the touch, create a "semantic collection", and store the application information in the semantic collection.

[0152] Step 203: The mobile phone converts the speech corresponding to the speech input into text by means of speech recognition.

[0153] Step 204: The mobile phone breaks down the converted text into semantics, stores the semantics into a "semantic set", and retrieves at least one matching shortcut command according to the semantic set.

[0154] For example, the mobile phone may further perform semantic analysis on the converted text, extract key semantics of the user's command (such as "send a message", "friend a"), and store it in a semantic set.

[0155] Step 205 : If the mobile phone determines that the matching degree corresponding to a certain shortcut command is higher than the threshold and much higher than other shortcut commands, step 209 is executed.

[0156] Step 206 : If the mobile phone determines that two or more shortcut instructions are higher than the threshold or the matching degrees of the shortcut instructions with the highest matching degrees are close, step 207 is executed.

[0157] Step 207: The mobile phone displays two or more shortcut commands that are higher than the threshold or several shortcut commands with the highest matching degree.

[0158] Step 208 : The mobile phone receives a selection operation of the user on a quick execution of at least one displayed quick instruction, and executes step 209 .

[0159] For example, the mobile phone can retrieve the shortcut command interface provided by the application according to the semantics in the semantic set, and set the matching degree. If the matching degree of a certain command is higher than the threshold and much higher than other options, the command is directly executed; if more than two commands are higher than the threshold or the matching degrees of the highest matching commands are close, a selection box is provided to allow the user to select the command to be executed by touch; if there is no option that reaches the threshold, or the user does not adopt the alternative command, the user is prompted to re-enter at least one of touch input and voice input.

[0160] Step 209: The mobile phone executes the corresponding shortcut command.

[0161] Exemplarily, the mobile phone may execute shortcut commands whose matching degree is higher than a threshold and much higher than other shortcut commands, or shortcut commands selected by the user.

[0162] The function execution method provided in the embodiment of the present application can simplify the interaction of multi-level complex functions applied on a mobile phone, improve the efficiency of human-computer interaction, and reduce learning costs.

[0163] Figure 8 It is a flow chart of the function execution method provided in an embodiment of the present application. Taking the electronic device as a mobile phone and the touch input including multiple touch sub-inputs as an example, the method may include the following steps 301 to 305.

[0164] Step 301: The mobile phone receives the user's touch input and voice input.

[0165] For example, Fig. 9B As shown, the touch input may be a user clicking multiple points on the screen at the same time (such as a click input of two touch points on a map application interface), and the voice input may be "cycling navigation".

[0166] Step 302: The mobile phone obtains input information of touch input and stores it into a semantic set.

[0167] For example, the mobile phone can store the content on the touch points and the association between the touch points as input information into the "semantic set" according to the UI content on the screen interface. (such as the geographical location represented by the touch points, the distance between the geographical locations, etc.)

[0168] Step 303: The mobile phone obtains semantic information corresponding to the voice input and stores it in a semantic set, and retrieves at least one matching shortcut instruction according to the semantic set.

[0169] It should be noted that the implementation process of the above step 303 can refer to the above step 203 and the above step 204, and this embodiment will not be repeated here.

[0170] Step 304: The mobile phone matches application-specific shortcut instructions with the semantic set and gives feedback to the user.

[0171] It should be noted that the implementation process of the above step 304 can refer to the above steps 205 to 208, and this embodiment will not be repeated here.

[0172] Step 305: The mobile phone executes the corresponding shortcut command.

[0173] It should be noted that the implementation process of the above step 305 can refer to the above step 209, and this embodiment will not be repeated here.

[0174] The function execution method provided in the embodiment of the present application can, on the one hand, simplify the interaction of multi-level complex functions of applications on mobile phones, improve the efficiency of human-computer interaction, and reduce learning costs. On the other hand, it can also perform more sophisticated command input in scenarios requiring multi-touch interaction within the application.

[0175] In some embodiments of the present application, the touch input can also be a drag input or a slide input, which provides more abundant starting position information, ending position and direction information for determining the shortcut command to be executed.

[0176] For example Fig. 9C As shown in the figure, the user slides the screen in a certain direction (such as from lower left to upper right) in an application and simultaneously inputs "small window" by voice. The mobile phone can store the semantics of "from lower left to upper right" and "small window" in the "command semantic set", and then quickly execute the shortcut command to switch the application to a small window and display it in the upper right corner of the screen.

[0177] For another example, when a user drags and inputs "red" in a drawing application and simultaneously inputs "red" by voice, the phone can execute a shortcut command to fill the line segment or pattern drawn by the user corresponding to the starting position information, ending position information, and direction information of the dragging input with red.

[0178] The examples of the present invention can provide more accurate input for instructions requiring direction information or trajectory information, thereby improving the efficiency of human-computer interaction.

[0179] It should be noted that the above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or any two or more of them can be executed in combination with each other. The specific implementation method can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0180] The function execution method provided in the embodiment of the present application can be executed by a function execution device. In the embodiment of the present application, the function execution device provided in the embodiment of the present application is described by taking the function execution method executed by the function execution device as an example.

[0181] Fig.10 It is a structural diagram of a function execution device 100 provided in an embodiment of the present application. The function execution device 1000 includes: a receiving module 1001 and an execution module 1002.

[0182] The receiving module 1001 is used to receive touch input and voice input;

[0183] an execution module, configured to respond to the touch input and the voice input and execute a function operation corresponding to the voice input based on input information of the touch input;

[0184] The input information of the touch input includes at least one of a touch object of the touch input, start position information of the touch input, end position information of the touch input, and direction information corresponding to the touch input;

[0185] The touch object includes any one of the application icon, interface content and application interface.

[0186] In some embodiments of the present application, the execution module 1002 is specifically used to:

[0187] In response to the touch input, obtaining a shortcut command set corresponding to the input information;

[0188] In response to the voice input, based on the semantic information corresponding to the voice input, acquiring at least one shortcut instruction matching the semantic information from the shortcut instruction set;

[0189] Based on the matching degree between each shortcut instruction in the at least one shortcut instruction and the semantic information, a functional operation corresponding to the voice input is executed.

[0190] In some embodiments of the present application, the execution module 1002 is specifically used to:

[0191] When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is greater than or equal to the first threshold, executing the function operation indicated by the first shortcut instruction;

[0192] or,

[0193] When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is less than a first threshold, executing the function operation indicated by the third shortcut instruction, where the third shortcut instruction is a shortcut instruction selected by the user from the at least one shortcut instruction;

[0194] The first shortcut command is a shortcut command with the highest matching degree with the semantic information among the at least one shortcut command, and the second shortcut command is any shortcut command among the at least one shortcut command except the first shortcut command.

[0195] In some embodiments of the present application, Fig.10 ,like Fig.11 As shown, the device 1000 also includes: a display module 1003, which is used to display at least one instruction identifier before executing the functional operation indicated by the third shortcut instruction, and each instruction identifier corresponds to a shortcut instruction in the at least one shortcut instruction; the execution module 1002 is specifically used to: if an input of the instruction identifier of the third shortcut instruction is received within the first time period, then the functional operation indicated by the third shortcut instruction is executed.

[0196] In some embodiments of the present application, the display module 1003 is further used for:

[0197] If no input of the at least one instruction identifier is received within the first time period, a first prompt message is displayed, where the first prompt message is used to prompt to re-perform at least one of touch input and voice input.

[0198] In some embodiments of the present application, the display module 1003 is also used to display a first prompt message if there is no shortcut command matching the voice information in the shortcut command set, and the first prompt message is used to prompt to re-perform at least one of the touch input and the voice input.

[0199] In the function execution device provided in the embodiment of the present application, by receiving touch input and voice input; responding to the touch input and the voice input, based on the touch object of the touch input, the starting position information of the touch input, the ending position information of the touch input, and at least one of the direction information corresponding to the touch input, the function operation corresponding to the voice input is executed. In this way, when the function execution device executes the corresponding function operation, it can effectively simplify the operation steps of the touch input, thereby effectively improving the operation convenience of the function execution device.

[0200] The function execution device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or a device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device, an augmented reality / virtual reality device, a robot, a wearable device, a super mobile personal computer, a netbook or a personal digital assistant, etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0201] The function execution device in the embodiment of the present application may be a device with a functional operating system. The functional operating system may be an Android functional operating system, an iOS functional operating system, or other possible functional operating systems, which are not specifically limited in the embodiment of the present application.

[0202] The function execution device provided in the embodiment of the present application can implement each process implemented by each embodiment of the above-mentioned function execution method. To avoid repetition, it will not be repeated here.

[0203] Alternatively, if Fig.12 As shown, an embodiment of the present application also provides an electronic device 1200, including a processor 1201 and a memory 1202, wherein the memory 1202 stores programs or instructions that can be executed on the processor 1201, and when the program or instructions are executed by the processor 1201, the various steps of the above-mentioned function execution method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

[0204] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0205] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0206] The electronic device 1300 includes but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, and a processor 1310 and other components.

[0207] Those skilled in the art will appreciate that the electronic device 1300 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1310 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0208] The input unit 1304 is used to receive touch input and voice input;

[0209] The processor 1310 is configured to respond to the touch input and the voice input and execute a function operation corresponding to the voice input based on input information of the touch input;

[0210] The input information of the touch input includes at least one of a touch object of the touch input, start position information of the touch input, end position information of the touch input, and direction information corresponding to the touch input;

[0211] The touch object includes any one of the application icon, interface content and application interface.

[0212] In some embodiments of the present application, the processor 1310 is specifically configured to:

[0213] In response to the touch input, obtaining a shortcut command set corresponding to the input information;

[0214] In response to the voice input, based on the semantic information corresponding to the voice input, acquiring at least one shortcut instruction matching the semantic information from the shortcut instruction set;

[0215] Based on the matching degree between each shortcut instruction in the at least one shortcut instruction and the semantic information, a functional operation corresponding to the voice input is executed.

[0216] In this way, the electronic device obtains a shortcut command set corresponding to the input information in response to touch input; in response to voice input, based on the semantic information corresponding to the voice input, obtains at least one shortcut command matching the semantic information from the shortcut command set; based on the degree of matching between each shortcut command in at least one shortcut command and the semantic information, executes the functional operation corresponding to the voice input, so that when the electronic device executes the corresponding functional operation, it can effectively simplify the operation steps of the touch input, thereby effectively improving the operational convenience of the electronic device.

[0217] In some embodiments of the present application, the processor 1310 is specifically configured to:

[0218] When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is greater than or equal to the first threshold, executing the function operation indicated by the first shortcut instruction;

[0219] or,

[0220] When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is less than a first threshold, executing the function operation indicated by the third shortcut instruction, where the third shortcut instruction is a shortcut instruction selected by the user from the at least one shortcut instruction;

[0221] The first shortcut command is a shortcut command with the highest matching degree with the semantic information among the at least one shortcut command, and the second shortcut command is any shortcut command among the at least one shortcut command except the first shortcut command.

[0222] In this way, the electronic device can effectively improve the accuracy of the electronic device's execution of the operation function by executing the function operation indicated by the first shortcut instruction when the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is greater than or equal to the first threshold value; the electronic device can effectively improve the accuracy of the electronic device's execution of the operation function by executing the function operation indicated by the third shortcut instruction when the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is less than the first threshold value, so that the electronic device can execute the corresponding function operation according to the user's choice, thereby improving the flexibility of the electronic device's operation function.

[0223] In some embodiments of the present application, the display unit 1306 is used to display at least one instruction identifier before executing the function operation indicated by the third shortcut instruction, each instruction identifier corresponding to one of the at least one shortcut instructions;

[0224] The processor 1310 is specifically configured to:

[0225] If an input of the instruction identifier of the third shortcut instruction is received within the first time period, the functional operation indicated by the third shortcut instruction is executed.

[0226] In this way, the electronic device displays at least one instruction identifier; if an input of an instruction identifier for a third shortcut instruction is received within the first time period, the functional operation indicated by the third shortcut instruction is executed, so that the electronic device can promptly execute the corresponding functional operation according to the user's selection, thereby improving the efficiency and flexibility of the electronic device's operating functions.

[0227] In some embodiments of the present application, the display unit 1306 is further configured to:

[0228] If no input of the at least one instruction identifier is received within the first time period, a first prompt message is displayed, where the first prompt message is used to prompt to re-perform at least one of touch input and voice input.

[0229] In this way, the electronic device can promptly prompt the user to re-perform at least one of touch input and voice input by displaying a first prompt message when no input to at least one instruction identifier is received within a first time period, thereby allowing the electronic device to perform corresponding functional operations based on the user's re-performing at least one of touch input and voice input, thereby improving the flexibility of the electronic device in performing functional operations.

[0230] In some embodiments of the present application, the display unit 1306 is further configured to:

[0231] If there is no shortcut command matching the voice information in the shortcut command set, a first prompt message is displayed, where the first prompt message is used to prompt to re-perform at least one of touch input and voice input.

[0232] In this way, when the electronic device determines that there is no shortcut command matching the voice information in the shortcut command set, the electronic device displays a first prompt message, which can prompt the user to re-perform at least one of the touch input and voice input, so that the electronic device performs a corresponding functional operation based on the user's re-performing at least one of the touch input and voice input, thereby improving the flexibility of the electronic device in performing functional operations.

[0233] In the electronic device provided in the embodiment of the present application, by receiving touch input and voice input; responding to the touch input and the voice input, based on at least one of the touch object of the touch input, the start position information of the touch input, the end position information of the touch input, and the direction information corresponding to the touch input, the function operation corresponding to the voice input is performed. In this way, when the electronic device performs the corresponding function operation, the operation steps of the touch input can be effectively simplified, thereby effectively improving the convenience of operation of the electronic device.

[0234] It should be understood that in the embodiment of the present application, the input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and a microphone 13042, and the graphics processor 13041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1307 includes a touch panel 13071 and at least one of other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 may include two parts: a touch detection device and a touch controller. Other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a function joystick, which will not be repeated here.

[0235] The memory 1309 can be used to store software programs and various data. The memory 1309 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store a functional operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1309 may include a volatile memory or a non-volatile memory, or the memory 1309 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1309 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0236] The processor 1310 may include one or more processing units; optionally, the processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly processes functional operations involving a functional operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1310.

[0237] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned function execution method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0238] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0239] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned function execution method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0240] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0241] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned function execution method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0242] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0243] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the function execution method described in each embodiment of the present application.

[0244] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A function execution method, characterized in that: The method comprises: Receive touch input and voice input; In response to the touch input and the voice input, based on input information of the touch input, execute a function operation corresponding to the voice input; The input information of the touch input includes at least one of a touch object of the touch input, start position information of the touch input, end position information of the touch input, and direction information corresponding to the touch input; The touch object includes any one of an application icon, interface content, and an application interface.

2. The method according to claim 1, characterized in that The step of responding to the touch input and the voice input and executing a function operation corresponding to the voice input based on input information of the touch input includes: In response to the touch input, obtaining a shortcut command set corresponding to the input information; In response to the voice input, based on the semantic information corresponding to the voice input, acquiring at least one shortcut instruction matching the semantic information from the shortcut instruction set; Based on the matching degree between each shortcut instruction in the at least one shortcut instruction and the semantic information, a functional operation corresponding to the voice input is executed.

3. The method according to claim 2, characterized in that The performing the function operation corresponding to the voice input based on the matching degree between each shortcut instruction in the at least one shortcut instruction and the semantic information includes: When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is greater than or equal to the first threshold, executing the function operation indicated by the first shortcut instruction; or, When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is less than a first threshold, executing the function operation indicated by the third shortcut instruction, where the third shortcut instruction is a shortcut instruction selected by the user from the at least one shortcut instruction; The first shortcut command is a shortcut command with the highest matching degree with the semantic information among the at least one shortcut command, and the second shortcut command is any shortcut command among the at least one shortcut command except the first shortcut command.

4. The method according to claim 3, characterized in that: Before executing the functional operation indicated by the third shortcut instruction, the method further includes: Displaying at least one instruction identifier, each instruction identifier corresponding to a shortcut instruction of the at least one shortcut instruction; The executing the function operation indicated by the third shortcut command includes: If an input of the instruction identifier of the third shortcut instruction is received within the first time period, the functional operation indicated by the third shortcut instruction is executed.

5. The method according to claim 4, characterized in that The method further comprises: If no input of the at least one instruction identifier is received within the first time period, a first prompt message is displayed, where the first prompt message is used to prompt to re-perform at least one of touch input and voice input.

6. A function execution device, characterized in that: The device comprises: A receiving module, used for receiving touch input and voice input; an execution module, configured to respond to the touch input and the voice input and execute a function operation corresponding to the voice input based on input information of the touch input; The input information of the touch input includes at least one of a touch object of the touch input, start position information of the touch input, end position information of the touch input, and direction information corresponding to the touch input; The touch object includes any one of an application icon, interface content, and an application interface.

7. The device according to claim 6, characterized in that The execution module is specifically used for: In response to the touch input, obtaining a shortcut command set corresponding to the input information; In response to the voice input, based on the semantic information corresponding to the voice input, acquiring at least one shortcut instruction matching the semantic information from the shortcut instruction set; Based on the matching degree between each shortcut instruction in the at least one shortcut instruction and the semantic information, a functional operation corresponding to the voice input is executed.

8. The device according to claim 7, characterized in that The execution module is specifically used for: When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is greater than or equal to the first threshold, executing the function operation indicated by the first shortcut instruction; or, When the difference between the matching degree corresponding to the first shortcut instruction and the matching degree corresponding to the second shortcut instruction is less than a first threshold, executing the function operation indicated by the third shortcut instruction, where the third shortcut instruction is a shortcut instruction selected by the user from the at least one shortcut instruction; The first shortcut command is a shortcut command with the highest matching degree with the semantic information among the at least one shortcut command, and the second shortcut command is any shortcut command among the at least one shortcut command except the first shortcut command.

9. The device according to claim 8, characterized in that The device also includes: A display module, configured to display at least one instruction identifier before executing the function operation indicated by the third shortcut instruction, each instruction identifier corresponding to one of the at least one shortcut instruction; The execution module is specifically used for: If an input of the instruction identifier of the third shortcut instruction is received within the first time period, the functional operation indicated by the third shortcut instruction is executed.

10. The device according to claim 9, characterized in that The display module is also used for: If no input of the at least one instruction identifier is received within the first time period, a first prompt message is displayed, where the first prompt message is used to prompt to re-perform at least one of touch input and voice input.

11. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the function execution method according to any one of claims 1 to 5 are implemented.

Images