Voice control method and electronic device

Abstract

The invention provides a voice control method and an electronic device. The method is suitable for the electronic device comprising a touch screen and a voice receiving device and comprises the following steps. Recording historical touch data of a plurality of historical touch operations applied to the operation interface; determining a plurality of habitual touch areas on the operation interface according to historical touch data of the operation interface; when an operation interface is displayed through the touch screen, a plurality of area marks of a plurality of habitual touch areas are displayed on the operation interface. A voice instruction is received through a voice receiving device. And determining an input operation according to the first area mark in the voice instruction, and executing the input operation on the operation interface. Therefore, a user can control the electronic device through voice, and the operation flexibility is greatly improved.

Description

Technical Field

[0001] The invention relates to a voice control method and an electronic device. Background Art

[0002] In today's society, modern people's dependence on consumer electronic devices is gradually increasing. In order to achieve the purpose of more convenience, lighter volume and more humanization, many products have changed from traditional keyboards or mice to touch screens as input devices. In recent years, touch-controlled electronic products have been deeply loved by consumers due to their easy operation and high intuitiveness, and have gradually become the mainstream trend in the market. With the increasing number of functions of touch-controlled electronic products, the touch operation method of simply touching the screen directly has gradually failed to meet the user's operational needs. Or, in some operating scenarios, the user just can't touch the touch screen with his hands or other touch objects, so it is difficult to issue control instructions to these touch-controlled electronic products. At present, although voice control functions have gradually been widely equipped on some electronic products, these voice functions generally only support predefined and quite limited operations, and cannot allow users to control them by voice at will. Summary of the invention

[0003] The present invention relates to a voice control method and an electronic device, which can be used to solve the above technical problems.

[0004] An embodiment of the present invention provides a voice control method, which is applicable to an electronic device including a touch screen and a voice receiving device. The method includes the following steps. Recording historical touch data of multiple historical touch operations applied to an operation interface. Determining multiple habitual touch areas on the operation interface based on the historical touch data of the operation interface. When the operation interface is displayed through the touch screen, multiple area marks of the multiple habitual touch areas are displayed on the operation interface. Receive a voice command through a voice receiving device. Determine an input operation based on a first area mark in the voice command, and execute the input operation on the operation interface.

[0005] An embodiment of the present invention provides an electronic device, which includes a voice receiving device, a touch screen, a storage device, and a processor. The storage device records multiple modules. The processor is coupled to the voice receiving device, the touch screen, and the storage device, and is configured to perform the following steps. Record historical touch data of multiple historical touch operations applied to an operation interface. Determine multiple habitual touch areas on the operation interface based on the historical touch data of the operation interface. When the operation interface is displayed through the touch screen, multiple area marks of multiple habitual touch areas are displayed on the operation interface. Receive a voice command through the voice receiving device. Determine an input operation based on the first area mark in the voice command, and execute the input operation on the operation interface.

[0006] Based on the above, in an embodiment of the present invention, historical touch data of multiple historical touch operations applied to the operation interface are continuously recorded, and multiple customary touch areas of this operation interface can be determined based on the historical touch data. Multiple area marks of these customary touch areas can be displayed on the operation interface. By speaking a voice command including a first area mark, the user can control the electronic device to perform an input operation corresponding to the first area mark. Based on this, the user can control the electronic device to perform a variety of input operations through voice control, greatly improving convenience and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a block diagram of an electronic device according to an embodiment of the present invention;

[0008] Figure 2 is a flow chart of a voice control method according to an embodiment of the present invention;

[0009] Figure 3A is a schematic diagram of historical touch data and habitual touch areas of an operation interface according to an embodiment of the present invention;

[0010] Figure 3B is a schematic diagram of historical touch data and habitual touch areas of an operation interface according to an embodiment of the present invention;

[0011] Figure 4 is a flow chart of determining a custom touch area according to an embodiment of the present invention;

[0012] Figure 5 is a schematic diagram of determining a custom touch area according to an embodiment of the present invention;

[0013] Figure 6 is a flow chart of displaying multiple area marks according to an embodiment of the present invention;

[0014] Figure 7 is a schematic diagram of multiple area marks on an operation interface according to an embodiment of the present invention;

[0015] Figure 8 is a flow chart of displaying multiple area marks according to an embodiment of the present invention;

[0016] Fig. 9 FIG. 4 is a schematic diagram of multiple area marks on an operation interface according to an embodiment of the present invention.

[0017] Description of Reference Numerals

[0018] 100: electronic device;

[0019] 110: touch screen;

[0020] 120: voice receiving device;

[0021] 130: storage device;

[0022] 140: processor;

[0023] UI_1, UI_2, UI_3: operation interface;

[0024] T1, T2, T3: touch points;

[0025] Z1, Z2, Z3: customary touch areas;

[0026] G1, G2, G3, G4: unit grid;

[0027] M1: Exclusive number mark;

[0028] MH1: first coordinate component mark;

[0029] MV1: second coordinate component mark;

[0030] S210~S250, S402~S406, S602~S604, S802~S804: steps. DETAILED DESCRIPTION

[0031] Reference will now be made in detail to exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used in the drawings and the description to refer to the same or like parts.

[0032] Figure 1 is a block diagram of an electronic device according to an embodiment of the present invention. Figure 1 The electronic device 100 can be implemented as an electronic product with a touch function, such as a laptop, a tablet PC, a personal digital assistant (PDA), a smart phone, an e-book, a game console, or a smart wearable device, etc., and the present disclosure is not limited thereto. The electronic device 100 includes a touch screen 110, a voice receiving device 120, a storage device 130, and a processor 140, and their functions are described as follows.

[0033] The touch screen 110 is a display device that integrates a touch detection component and can provide display and input functions at the same time. This display device is, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, a field emission display (FED) or other types of displays, but the present invention is not limited thereto. The touch screen 110 can be used to display the operation interface of an application or an operating system. The touch detection component is disposed on the display device, and these sensing components are arranged in rows and columns and are configured to receive touch operations. The touch operation includes touching the touch screen 110 with a finger, palm, body part or other object. The touch detection component can be, for example, a capacitive touch detection component, a surface acoustic wave touch detection component, an electromagnetic touch detection component, a near-field imaging touch detection component, and the like, but the present disclosure is not limited thereto.

[0034] The voice receiving device 120 is used to receive voice commands, and may be various types of microphones, which are not limited in the present disclosure.

[0035] The storage device 130 is used to store data such as files, images, instructions, program codes, software modules, etc. It can be, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk or other similar devices, integrated circuits or combinations thereof.

[0036] The processor 140 is coupled to the touch screen 110, the voice receiving device 120 and the storage device 130, and is, for example, a central processing unit (CPU), an application processor (AP), or other programmable general-purpose or special-purpose microprocessors, digital signal processors (DSPs) or other similar devices, integrated circuits and combinations thereof. The processor 140 can access and execute instructions, software modules or program codes recorded in the storage device 130 to implement the voice control method in the embodiment of the present invention.

[0037] Figure 2 is a flow chart of a voice control method according to an embodiment of the present invention, and Figure 2 The method flow can be applied Figure 1 Please also refer to the electronic device 100. Figure 1 and Figure 2, the following is matched Figure 1 The various components of the electronic device 100 are used to illustrate the steps of the voice control method of this embodiment.

[0038] In step S210, the processor 140 records the historical touch data of multiple historical touch operations applied to the operation interface. In some embodiments, the operation interface includes a desktop operation interface or an application program interface of an application. The desktop operation interface is an operation interface of an operating system. The above-mentioned application is, for example, a game program, a browser program, a multimedia player program, an online shopping program, or a social program, etc.

[0039] In some embodiments, when the touch screen 110 displays the operation interface, the touch screen 110 detects the touch operation applied to the operation interface. When the touch screen 110 detects the touch operation applied to the operation interface, the touch screen 110 may report one or more touch points of the touch operation to the processor 140, so that the processor 140 may obtain the position and operation action of the touch operation according to these touch points. The processor 140 may record the position and operation action of the detected historical touch operation as the historical touch data of the operation interface. In other words, the historical touch data may include the position and operation action of the historical touch operation.

[0040] In some embodiments, the position of the touch operation recorded by the processor 140 may include the position of the touch start point of the touch operation or the positions of multiple touch points of the touch operation. The operation action may include dragging, clicking, multi-clicking, sliding or other actions.

[0041] It should be noted that different operation interfaces have different interface graphic configurations, and different users have different habitual touch modes. The processor 140 can record the historical touch data of a specific user on a specific operation interface, so the processor 140 can obtain the historical touch data of different operation interfaces.

[0042] For example, Figure 3A is a schematic diagram of the historical touch data and the habitual touch area of ​​the operation interface according to an embodiment of the present invention. Figure 3A In some embodiments, the operation interface UI_1 may be a desktop operation interface of a smart phone. The processor 140 may record the historical touch data of the historical touch operations applied to the operation interface UI_1 displayed on the touch screen 110. The processor 140 may record the touch points (e.g., touch points T1 and T2) of these historical touch operations to the historical touch data of the operation interface UI_1. Figure 3A As shown, the touch points of these historical touch operations are mostly concentrated on the application icons in the operation interface UI_1.

[0043] For example, Figure 3Bis a schematic diagram of the historical touch data and the habitual touch area of ​​the operation interface according to an embodiment of the present invention. Figure 3B In some embodiments, the operation interface UI_2 may be a game operation interface. The processor 140 may record the historical touch data of the historical touch operations applied to the operation interface UI_2 displayed on the touch screen 110. The processor 140 may record the touch points (e.g., touch point T3) of these historical touch operations to the historical touch data of the operation interface UI_2. Figure 3B As shown, the touch points of these historical touch operations are mostly concentrated on the virtual control buttons in the operation interface UI_2. Figure 3A and Figure 3B It can be seen that the historical touch data of the operation interface UI_1 is different from the historical touch data of the operation interface UI_2.

[0044] Next, in step S220, the processor 140 determines a plurality of habitual touch regions on the operation interface according to the historical touch data of the operation interface. Specifically, by analyzing the distribution of the touch points in the historical touch data of the operation interface, the processor 140 can determine a plurality of habitual touch regions on the operation interface where the user has frequently issued touch operations in the past.

[0045] In some embodiments, the operation interface may include a first operation interface and a second operation interface. Figure 3A and Figure 3B The operation interface UI_1 and the operation interface UI_2 are shown. Alternatively, the first operation interface and the second operation interface may be application interfaces of different applications. The processor 140 may determine a plurality of first habitual touch areas on the first operation interface based on the historical touch data of the first operation interface. Furthermore, the processor 140 may determine a plurality of second habitual touch areas on the second operation interface based on the historical touch data of the second operation interface. The plurality of first habitual touch areas are at least partially different from the plurality of second habitual touch areas. For example, Figure 3A In the example of , the processor 140 can determine a plurality of first habitual touch areas (eg, habitual touch areas Z1 and Z2) on the operation interface UI_1 according to the historical touch data of the operation interface UI_1. Figure 3B In the example of , the processor 140 can determine multiple second habitual touch areas (e.g., habitual touch area Z3) on the operation interface UI_2 according to the historical touch data of the operation interface UI_2. Since the historical touch data of the operation interface UI_1 is different from the historical touch data of the operation interface UI_2, the positions of the multiple first habitual touch areas of the operation interface UI_1 are different from the multiple second habitual touch areas of the operation interface UI_2.

[0046] Please refer to Figure 4, which is a flow chart of determining a custom touch area according to an embodiment of the present invention. In some embodiments, step S220 may be implemented as follows: Figure 4 Steps S402 to S406.

[0047] In step S402, the processor 140 divides the operation interface into a plurality of unit grids. Figure 5 The operation interface UI_3 displayed on the touch screen 110 can be further divided into multiple unit grids (such as unit grids G1 to G4), but the division method and the number of divisions are only examples. Those skilled in the art can make appropriate changes based on actual needs and are not limited to the above description.

[0048] In step S404, the processor 140 counts the touch parameters of each unit grid according to the historical touch data of the operation interface. In different embodiments, the touch parameters of each unit grid include the number of touches, the touch frequency, or the touch density. According to the number of touch points in each unit grid, the processor 140 can calculate the number of touches of each unit grid. According to the number of touch points in each unit grid within a time period, the processor 140 can calculate the touch frequency of each unit grid. According to the number of touch points and the grid area of ​​each unit grid, the processor 140 can calculate the touch density of each unit grid.

[0049] In step S406, by comparing the touch parameters of each unit grid with the threshold value, the processor 140 identifies part of the unit grids as multiple habitual touch areas. The processor 140 determines whether the touch parameters of each unit grid are greater than the threshold value, and this threshold value can be set according to actual needs. When the touch parameter of a unit grid is greater than the threshold value, the processor 140 can identify the unit grid as a habitual touch area. Otherwise, when the touch parameter of a unit grid is not greater than the threshold value, the processor 140 can exclude the unit grid as a habitual touch area. Figure 5 As shown, since the touch parameters of the unit grids G1 and G2 are greater than the threshold value, the processor 140 can identify the unit grids G1 and G2 as two habitual touch areas respectively.

[0050] In some embodiments, these unit grids include a plurality of adjacent first unit grids. The processor 140 may merge the plurality of adjacent first unit grids into one of the plurality of habitual touch areas. Specifically, when the processor 140 determines that the touch parameters of the plurality of adjacent first unit grids are greater than a threshold value, the processor 140 may merge the plurality of adjacent first unit grids into one habitual touch area. In other words, the area of ​​these habitual touch areas may be the same or different from each other. Figure 5As shown, since the touch parameters of the adjacent unit grids G3 and G4 are greater than the threshold value, the processor 140 may identify the unit grids G3 and G4 as a single habitual touch area.

[0051] Afterwards, in step S230, when the operation interface is displayed through the touch screen 110, the processor 140 displays multiple area marks of multiple habitual touch areas on the operation interface. The area mark may include text, numbers, symbols, patterns or a combination thereof. It should be emphasized that, referring to the above, it can be seen that the unit grid whose touch parameter is less than the threshold value will not be identified as the habitual touch area, and the unit grid whose touch parameter is less than the threshold value will not be marked with an area mark. In this way, the screen of the operation interface presenting multiple area marks can be made more concise and easy to read.

[0052] In addition, in some embodiments, these area marks may be dedicated number marks of these customary touch areas. Alternatively, in some implementations, these area marks may be coordinate component marks in different coordinate directions.

[0053] Please refer to Figure 6 , which is a flow chart of displaying multiple area marks according to an embodiment of the present invention. In some embodiments, step S230 may be implemented as follows: Figure 6 Step S602 to step S604.

[0054] In step S602, the processor 140 generates a unique number mark for each habitual touch area. In detail, in some implementations, the habitual touch area can correspond one-to-one to the unique number mark. These unique number marks can be multiple digital numbers. In step S604, the processor 140 displays multiple unique number marks of the multiple habitual touch areas on the operation interface. In different embodiments, the processor 140 can display the unique number mark in the corresponding habitual touch area or next to the corresponding habitual touch area.

[0055] For example, see Figure 7 , which is a schematic diagram of multiple area marks on an operation interface according to an embodiment of the present invention. The processor 140 can determine 11 habitual operation areas based on the historical touch data of the operation interface UI_1, and assign exclusive number marks 'number 1' to 'number 11' to these 11 habitual operation areas. For example, the processor 140 can determine the exclusive number mark M1 of the habitual operation area Z2 to be 'number 7'. Figure 7 In this example, exclusive number labels 'No. 1' to 'No. 11' may be displayed in each custom operation area.

[0056] Please refer to Figure 8 , which is a flow chart of displaying multiple area marks according to an embodiment of the present invention. In some embodiments, step S230 may be implemented as follows: Figure 8 Step S802 to step S804.

[0057] In step S802, the processor 140 generates a plurality of first coordinate component marks in the first direction and a plurality of second coordinate component marks in the second direction according to the distribution positions of the plurality of habitual touch areas. Specifically, in some implementations, each habitual touch area may correspond to one of the plurality of first coordinate component marks and one of the plurality of second coordinate component marks. These first coordinate components may be horizontal coordinate components in the horizontal direction, respectively. These first coordinate components may be vertical coordinate components in the vertical direction, respectively. In addition, the processor 140 may determine the marking grid area including these habitual touch areas according to the distribution positions of the plurality of habitual touch areas, and divide the marking grid area into a plurality of marking grids. Afterwards, the processor 140 may mark a plurality of horizontal coordinate components along the horizontal direction of the marking grid, and mark a plurality of vertical coordinate components along the vertical direction of the marking grid. In other words, the processor 140 does not divide the entire operation interface into marking grids, but divides part of the operation interface into marking grids. Afterwards, in step S804, the processor 140 displays the plurality of first coordinate component marks and the plurality of second coordinate component marks on the operation interface. In some embodiments, in order to facilitate user identification, the processor 140 may simultaneously display the marking grid, the plurality of first coordinate component marks, and the plurality of second coordinate components on the operation interface.

[0058] For example, see Fig. 9 , which is a schematic diagram of multiple area markings on an operation interface according to an embodiment of the present invention. The processor 140 can determine multiple habitual operation areas based on the historical touch data of the operation interface UI_1, and determine the marking grid areas 91 and 92 that include these habitual operation areas. The processor 140 divides the marking grid areas 91 and 92 into multiple marking grids. For example, the processor 140 divides the marking grid area 91 into 5*3 marking grids, and divides the marking grid area 92 into 11*6 marking grids. Afterwards, the processor 140 can determine the horizontal coordinate components (i.e., horizontal coordinate components '1' to '5') and vertical coordinate components (i.e., vertical coordinate components '1' to '3') of the multiple marking grids of the marking grid area 91. Similarly, the processor 140 can determine the horizontal coordinate components (i.e., horizontal coordinate components '6' to '16') and vertical coordinate components (i.e., vertical coordinate components '4' to '9') of the multiple marking grids of the marking grid area 92. For example, the processor 140 may determine the vertical coordinate component MV1 to be '16' and the horizontal coordinate component MH1 to be '16'. Then, the processor 140 may display the horizontal coordinate components '1' to '16' and the vertical coordinate components '1' to '9' on the operation interface UI_1 via the touch screen 110 .

[0059] In step S240, the processor 140 receives a voice command through the voice receiving device 120. In step S250, the processor 140 determines an input operation according to the first area mark in the voice command, and performs the input operation on the operation interface. The first area mark is an area mark displayed on the operation interface. The processor 140 can perform voice recognition processing on the voice command to obtain the first area mark spoken by the user. Therefore, the processor 140 can decide to perform an input operation in the habitual touch area corresponding to the first area mark according to the first area mark. For example, the processor 140 can perform an input operation to start the application corresponding to the habitual touch area. Alternatively, the processor 140 can perform an input operation to drag the interface object from the first position to the second position. Alternatively, the processor 140 can perform an input operation to slide the browsing page. Alternatively, the processor 140 can perform an input operation to issue a game control instruction.

[0060] In some embodiments, the processor 140 may perform voice recognition processing on the voice command to obtain the first area mark and the operation action of the input operation. The input operation includes a click operation, a slide operation, or a drag operation. Figure 7 For example, when a user wants to open an application, the user refers to the multiple exclusive number labels on the operation interface and speaks the voice command "click number 7". Correspondingly, the processor 140 can perform voice recognition processing on the voice command "click number 7" to obtain the first area mark as "number 7" and the operation action of the input operation as "click". Then, the processor 140 can start the target application according to the input operation. Or, Fig. 9 For example, when a user wants to open an application, the user can speak a voice command "click the horizontal coordinate 16 and the vertical coordinate 4". Correspondingly, the processor 140 can perform voice recognition processing on the voice command "click the horizontal coordinate 16 and the vertical coordinate 4" to obtain the first coordinate component as "16" and the second coordinate component as "4", and obtain the operation action of the input operation as "click". Therefore, the processor 140 can start the target application corresponding to the first coordinate component "16" and the second coordinate component "4" according to the input operation.

[0061] In summary, in an embodiment of the present invention, multiple habitual touch areas of the operation interface can be determined based on historical touch data. Multiple area marks of these habitual touch areas can be displayed on the operation interface. By speaking a voice command including a first area mark, the user can control the electronic device to perform an input operation corresponding to the first area mark. Based on this, the user can control the electronic device to perform a variety of input operations through voice control, greatly improving convenience and user experience. In addition, habitual touch areas can be marked instead of the entire operation interface, which can make these area marks easier to read and the screen simpler.

[0062] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A voice control method, applicable to an electronic device including a touch screen and a voice receiving device, characterized in that: The method comprises: Recording historical touch data of multiple historical touch operations applied to the operation interface; Determining a plurality of habitual touch areas on the operation interface according to the historical touch data of the operation interface; When the operation interface is displayed through the touch screen, a plurality of area marks of the plurality of habitual touch areas are displayed on the operation interface; receiving a voice command through a voice receiving device; and An input operation is determined according to the first area mark in the voice command, and the input operation is executed on the operation interface.

2. The voice control method according to claim 1, characterized in that: The operation interface includes a desktop operation interface or an application program interface of an application program.

3. The voice control method according to claim 1, characterized in that: The operation interface includes a first operation interface and a second operation interface. The step of determining a plurality of habitual touch areas on the operation interface according to the historical touch data of the operation interface includes: Determining a plurality of first habitual touch areas on the first operation interface according to the historical touch data of the first operation interface; and A plurality of second habitual touch areas on the second operation interface are determined according to the historical touch data of the second operation interface, wherein the plurality of first habitual touch areas are at least partially different from the plurality of second habitual touch areas.

4. The voice control method according to claim 1, characterized in that: When the operation interface is displayed through the touch screen, the step of displaying the plurality of area marks of the plurality of habitual touch areas on the operation interface includes: Generating exclusive number labels for each of the plurality of habitual touch control areas; and The multiple exclusive number marks of the multiple customary touch areas are respectively displayed on the operation interface.

5. The voice control method according to claim 1, characterized in that: When the operation interface is displayed through the touch screen, the step of displaying the plurality of area marks of the plurality of habitual touch areas on the operation interface according to the positions of the plurality of habitual touch areas comprises: generating a plurality of first coordinate component marks in a first direction and a plurality of second coordinate component marks in a second direction according to the distribution positions of the plurality of habitual touch areas; and The plurality of first coordinate component marks and the plurality of second coordinate component marks are displayed on the operation interface.

6. The voice control method according to claim 1, characterized in that: The step of determining the plurality of habitual touch areas on the operation interface according to the historical touch data of the operation interface comprises: Dividing the operation interface into a plurality of unit grids; According to the historical touch data of the operation interface, counting the touch parameters of each of the plurality of unit grids; and By comparing the touch parameter of each of the plurality of unit grids with a threshold value, a portion of the plurality of unit grids is identified as the plurality of habitual touch areas.

7. The voice control method according to claim 6, characterized in that: The unit grid includes a plurality of adjacent first unit grids, and the step of identifying part of the plurality of unit grids as the plurality of habitual touch areas by comparing the touch parameters of each of the plurality of unit grids with a threshold value further includes: The adjacent first unit grids are merged into one of the habitual touch areas.

8. The voice control method according to claim 6, characterized in that: The touch parameter of each of the unit grids includes a touch count, a touch frequency, or a touch density.

9. The voice control method according to claim 1, characterized in that: The method further comprises: The voice command is subjected to voice recognition processing to obtain the first area mark and the operation action of the input operation.

10. The voice control method according to claim 1, characterized in that: The input operation includes a click operation, a slide operation or a drag operation.

11. An electronic device, characterized in that: include: Voice receiving device; Touch screen; A storage device records a plurality of modules; as well as A processor is coupled to the voice receiving device, the touch screen and the storage device, and is configured to: Recording historical touch data of multiple historical touch operations applied to the operation interface; Determining a plurality of habitual touch areas on the operation interface according to the historical touch data of the operation interface; When the operation interface is displayed through the touch screen, a plurality of area marks of the plurality of habitual touch areas are displayed on the operation interface; receiving a voice command through a voice receiving device; as well as An input operation is determined according to the first area mark in the voice instruction to execute a target function of the operation based on the operation interface.

12. The electronic device according to claim 11, characterized in that: The operation interface includes a desktop operation interface or an application program interface of an application program.

13. The electronic device according to claim 11, characterized in that: The operation interface includes a first operation interface and a second operation interface, and the processor is configured to: Determining a plurality of first habitual touch areas on the first operation interface according to the historical touch data of the first operation interface; as well as A plurality of second habitual touch areas on the second operation interface are determined according to the historical touch data of the second operation interface, wherein the plurality of first habitual touch areas are at least partially different from the plurality of second habitual touch areas.

14. The electronic device according to claim 11, characterized in that: The processor is configured to: Generating exclusive number labels for each of the plurality of habitual touch control areas; and The multiple exclusive number marks of the multiple customary touch areas are respectively displayed on the operation interface.

15. The electronic device according to claim 11, characterized in that: The processor is configured to: Generating a plurality of first coordinate component marks in a first direction and a plurality of second coordinate component marks in a second direction according to the distribution positions of the plurality of habitual touch areas; as well as The plurality of first coordinate component marks and the plurality of second coordinate component marks are displayed on the operation interface.

16. The electronic device according to claim 11, characterized in that: The processor is configured to: Dividing the operation interface into a plurality of unit grids; According to the historical touch data of the operation interface, counting touch parameters of each of the plurality of unit grids; as well as By comparing the touch parameter of each of the plurality of unit grids with a threshold value, a portion of the plurality of unit grids is identified as the plurality of habitual touch areas.

17. The electronic device according to claim 16, characterized in that: The plurality of unit grids include a plurality of adjacent first unit grids, and the processor is configured to: The adjacent first unit grids are merged into one of the habitual touch areas.

18. The electronic device according to claim 16, characterized in that: The touch parameter of each of the unit grids includes a touch count, a touch frequency, or a touch density.

19. The electronic device according to claim 11, characterized in that: The processor is configured to: The voice command is subjected to voice recognition processing to obtain the first area mark and the operation action of the input operation.

20. The electronic device according to claim 11, characterized in that The input operation includes a click operation, a slide operation or a drag operation.

Images