Method and system for controlling interface of electronic equipment based on touchpad and electronic equipment
By using a one-finger sliding operation on the touchpad and obtaining point information, the electronic device adaptively changes the display interface, solving the problem that the two-finger sliding operation and the one-finger operating habit in the prior art is inconsistent with the one-finger operating habit, and improving the user experience.
Patent Information
- Application Number
- CN202311135333.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-08-29
- Filing Date
- 2023-09-01
- Publication Date
- 2025-02-28
AI Technical Summary
In the prior art, users can only use two-finger sliding operations on the touchpad, resulting in user habits that are inconsistent with one-finger sliding operations, increasing user learning costs and reducing user experience.
By using a user to slide on the edge of the touchpad with one finger, the electronic device obtains the landing point information when the user slides with one finger, and determines whether the user's operation meets the requirements based on the information. When the requirements are met, the display interface is adaptively changed in response to the user's operation.
It realizes interface interaction that is consistent with the user's one-finger operating habits, improving user experience and operational friendliness.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a method, system and electronic device for controlling an electronic device interface based on a touch panel. Background Art
[0002] Currently, electronic devices such as tablet computers, laptop computers, personal digital assistants (PDAs) used by users may be equipped with touch pads (also called touch panels), which can replace the functions of a mouse. Users can use their fingers or a stylus to operate on the touch panel to control the electronic device.
[0003] At present, in the scenario where the user uses a finger to slide on the touchpad, the user can only use two fingers (two fingers) to slide on the touchpad. In response to the user's two-finger sliding operation on the touchpad, the display interface of the electronic device will change adaptively. For example, the electronic device display screen can scroll up and down the list, switch the page displayed on the desktop, etc. However, the user's two-finger sliding operation on the touchpad is inconsistent with the current user's habit of single-finger sliding operation on electronic devices with touch screens, which increases the user's learning cost, is not user-friendly, and reduces the user experience. Summary of the invention
[0004] The present application provides a method, system and electronic device for controlling the interface of an electronic device based on a touchpad. When a user slides a single finger on the edge of a touchpad, the electronic device obtains the point information of the landing point when the user slides a single finger on the touchpad, and determines whether the user's operation of the touchpad meets the requirements based on the point information. If the requirements are met, the current display interface of the electronic device will change adaptively in response to the user's operation on the edge of the touchpad. This is consistent with the user's single-finger operation habits on electronic devices with touch screens, is user-friendly, and improves the user experience.
[0005] In a first aspect, a method for controlling an electronic device interface based on a touchpad is provided, and the method is applied to an electronic device that supports touchpad control, and the method includes: in response to receiving a single-finger sliding operation of a user on the touchpad through the touchpad, determining point information generated by the single-finger sliding operation; according to the point information and a currently displayed first interface, executing an interactive function, and the interactive function includes: returning to the currently displayed application interface, displaying a side taskbar, switching the currently displayed application, or changing the size of the displayed application window.
[0006] The first aspect provides a method for controlling the interface of an electronic device based on a touchpad. The user uses a single finger to slide on the edge of the touchpad, and the electronic device obtains the point reporting information of the landing point when the user's single finger slides on the touchpad, and determines whether the user's single-finger operation on the touchpad meets the requirements based on the point reporting information. If the requirements are met, the electronic device performs an interactive function in response to the user's operation on the edge of the touchpad. For example, the application interface (first interface) currently displayed on the electronic device returns to or displays the application control center, adjusts the size of the display window in the electronic device display, calls up the side task bar of the electronic device display, the multitasking center, switches the application currently running on the electronic device, etc. It is consistent with the user's single-finger operation habits on electronic devices with touch screens, is user-friendly, and improves the user experience.
[0007] Exemplarily, the single-finger sliding operation is: a single-finger sliding operation from the edge of the touchpad or from outside the edge of the touchpad to the center of the touchpad.
[0008] Exemplarily, the point reporting information includes information of the trajectory point of the user's single-finger sliding operation.
[0009] Exemplarily, after the user slides on the touchpad with a single finger, the sensor on the touchpad can obtain the reporting point information of the user's single finger sliding on the touchpad, and periodically send the reporting point information to the electronic device. The reporting point information includes the position coordinates and time (moment) corresponding to multiple reporting points. In other words, the sliding trajectory when the user slides on the touchpad with a single finger can be represented by the reporting point information. The reporting points included in the reporting point information can be a reporting point sequence. Different reporting points correspond to different positions, and different reporting points correspond to different times (or timestamps). Multiple reporting points in the reporting point sequence are arranged in chronological order from early to late.
[0010] Exemplarily, the electronic device and the touch panel may be communicatively connected via wired or wireless means.
[0011] Exemplarily, the electronic device can pre-set the touch area of the touchpad, and can set the effective area (or also called edge gesture hot zone) for the user's single finger operation in the touch area. Only when the user performs a single-finger sliding operation on the touchpad that meets the preset conditions within the preset edge gesture hot zone, the electronic device can respond to the user's sliding operation on the touchpad and perform the interactive function. After determining each edge gesture area, the conditions that the user needs to meet for single-finger sliding in each area and the corresponding functions of the electronic device when the conditions are met can be pre-defined. The corresponding functions of the electronic device can be understood as: changes in the display interface of the electronic device when the user's single-finger sliding meets the conditions in different areas. The corresponding functions when the user slides a single finger in different areas are different.
[0012] In a possible implementation of the first aspect, the reporting point information includes information of each reporting point in a reporting point sequence, and the reporting point information includes: attribute parameters of each reporting point, the position of the first reporting point in the reporting point sequence, the distance between two adjacent reporting points in the reporting point sequence, the speed of the reporting points in the reporting point sequence, the time interval between each reporting point in other reporting points and the first reporting point, the distance between each reporting point in other reporting points and the first reporting point, or at least one of the angles between a line connecting each reporting point in other reporting points and the first reporting point and a horizontal line or a vertical line, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0013] In a possible implementation of the first aspect, executing the interactive function according to the point reporting information and the currently displayed first interface includes: determining whether the point reporting information satisfies the conditions for triggering the interactive function; and executing the interactive function if the conditions for triggering the interactive function are met. In this implementation, it is possible to more accurately determine whether the user's sliding operation on the touchpad satisfies the preset conditions (i.e., whether the conditions for triggering the interactive function are met), thereby improving the accuracy of judging the user's sliding operation, effectively preventing the display screen from enabling the corresponding function (i.e., executing the interactive function) according to the user's single-finger sliding operation due to the user's accidental touch operation, avoiding the user's accidental triggering behavior, and improving the accuracy of identifying the user's intention.
[0014] In a possible implementation of the first aspect, the reporting point information includes information of each reporting point in a reporting point sequence, and determining whether the reporting point information meets the conditions for triggering an interactive function includes: determining, based on the reporting point information, that the position of the first reporting point in the reporting point sequence is in the edge area of the touchpad, and that each of the other reporting points moves toward the center of the touchpad in sequence, then determining that the reporting point information meets the conditions for triggering an interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point. In this implementation, the electronic device can determine that the user is performing a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction, and that the user's operation needs to trigger or execute an interactive function, thereby executing the interactive function. This avoids the user's false triggering behavior and improves the accuracy of identifying the user's intent.
[0015] In a possible implementation of the first aspect, the reporting point information includes information of each reporting point in a reporting point sequence, and determining whether the reporting point information meets the conditions for triggering an interactive function includes: determining according to the reporting point information: each reporting point in the reporting point sequence is a single-finger reporting point, the time interval between each reporting point and the first reporting point in other reporting points is less than or equal to a threshold value (referred to as the first threshold value), and the distance between two adjacent reporting points in other reporting points is greater than or equal to a threshold value (referred to as the second threshold value), then determining that the reporting point information meets the conditions for triggering an interactive function, and the other reporting points are the reporting points in the reporting point sequence other than the first reporting point. In this implementation, it is possible to more accurately determine whether the user's sliding operation on the touchpad meets the preset conditions (i.e., whether it meets the conditions for triggering an interactive function), thereby improving the accuracy of judging the user's sliding operation, effectively preventing the display screen from enabling the corresponding function according to the user's single-finger sliding operation due to the user's accidental touch operation, avoiding the user's accidental triggering behavior, and improving the accuracy of identifying the user's intention.
[0016] Exemplarily, the value of the first threshold can be 200ms, and the value of the second threshold can be 15 pixels. In this implementation, the single-finger sliding operation of the user corresponding to these thresholds is more in line with the user's operating habits, thereby improving the accuracy and success rate of judging the user's single-finger sliding operation.
[0017] In a possible implementation of the first aspect, the reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information meets the conditions for triggering the interactive function includes: determining according to the reporting point information: the point speed of each reporting point in other reporting points is greater than 0, the distance between each reporting point in other reporting points and the first reporting point is greater than or equal to a threshold value (called the third threshold value), and the angle between the line connecting each reporting point in other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold value (called the fourth threshold value), then determining that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point. In this implementation, it can be relatively accurately determined whether the user's sliding operation on the touchpad meets the preset conditions (that is, whether it meets the conditions for triggering the interactive function), which improves the accuracy of judging the user's sliding operation, effectively prevents the user's accidental touch operation from triggering the display screen to enable the corresponding function according to the user's single-finger sliding operation, avoids the user's accidental triggering behavior, and improves the accuracy of identifying the user's intention.
[0018] For example, the third threshold value may be 50 pixels, and the fourth threshold value may be 75 degrees. In this implementation, the user's single-finger sliding operation corresponding to these thresholds is more in line with the user's operating habits, thereby improving the accuracy and success rate of judging the user's single-finger sliding operation.
[0019] In a possible implementation of the first aspect, the reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information meets the conditions for triggering the interactive function includes: determining according to the reporting point information: the point speed of some of the other reporting points is greater than 0, the distance between each of the other reporting points and the first reporting point is greater than or equal to the threshold, the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to the threshold, and within a preset time length, there are multiple reporting points in the other reporting points with the same position, then determining that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point. In this implementation, it can be relatively accurately determined whether the user's sliding operation on the touchpad meets the preset conditions (i.e., whether it meets the conditions for triggering the interactive function), improving the accuracy of judging the user's sliding operation, effectively preventing the display screen from enabling the corresponding function according to the user's single-finger sliding operation due to the user's accidental touch operation, avoiding the user's accidental triggering behavior, and improving the accuracy of identifying the user's intention.
[0020] Exemplarily, the preset time length may be 250 ms.
[0021] Exemplarily, when the following conditions are met, it is determined that the reporting point information meets the condition for triggering the interactive function, that is, the user performs a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction:
[0022] Each point in the reporting sequence is reported by a single finger;
[0023] The first reported point in the reporting sequence is within the preset edge gesture hotspot of the touchpad:
[0024] The time interval between each of the other reporting points and the first reporting point is less than or equal to a preset threshold;
[0025] The point speed of each reported point in other reported points is greater than 0;
[0026] The distance between two adjacent reporting points in other reporting points is greater than or equal to the threshold;
[0027] The distance between each of the other reported points and the first reported point is greater than or equal to the threshold;
[0028] The angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to the threshold.
[0029] Exemplarily, when the following conditions are met, it is determined that the reporting point information meets the condition for triggering the interactive function, that is, the user performs a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction:
[0030] Each point in the reporting sequence is reported by a single finger;
[0031] The first reported point in the reporting sequence is within the preset edge gesture hotspot of the touchpad:
[0032] The time interval between each of the other reporting points and the first reporting point is less than or equal to the threshold;
[0033] The point speed of some of the other reported points is greater than 0;
[0034] The distance between two adjacent reporting points in other reporting points is greater than or equal to the threshold;
[0035] The distance between each of the other reported points and the first reported point is greater than or equal to the threshold;
[0036] The angle between the line connecting each of the other reported points and the first reported point and the horizontal line or the vertical line is less than or equal to the threshold value;
[0037] Within the preset time length, there are multiple reporting points with the same position among other reporting points.
[0038] In a possible implementation of the first aspect, the method further includes: determining, based on the attribute parameters of each reported point in the reported point sequence, whether each reported point in the reported point sequence is a single-finger reported point or a palm reported point. In this implementation, invalid reported points can be simply and quickly excluded, that is, the user's mis-touch operation can be excluded, effectively preventing the display screen from enabling the corresponding function according to the user's single-finger sliding operation due to the user's mis-touch operation, avoiding the user's mis-triggering behavior, and improving the accuracy of user intention recognition.
[0039] For example, the attribute parameter (type) of each reporting point can be expressed as "TOOL_TYPE". If "TOOL_TYPE = PALM", it is determined that the reporting point is a large-area palm reporting point, which does not meet the requirements. If "TOOL_TYPE = FINGER", it is determined that the reporting point is a single-finger reporting point, which meets the requirements.
[0040] In a possible implementation of the first aspect, the method further includes: during the execution of the interactive function, the cursor on the display screen of the electronic device does not move. Locking the cursor can be understood as: the cursor on the screen of the electronic device is stationary or does not move, which can also be called a locked cursor. That is to say, even if the user continues to slide on the touchpad with a single finger, the cursor on the electronic device will not move as the user's finger slides on the touchpad. In this implementation, on the one hand, the user's visual experience can be improved. On the other hand, it can avoid changes in the display interface of the electronic device caused by the movement of the cursor when the user slides on the touchpad.
[0041] In a possible implementation of the first aspect, when the conditions for triggering the interactive function are not met, the method further includes: when the number of reported points in the reported point sequence is less than a threshold, supplementing the reported point sequence to obtain an updated reported point sequence; and moving the cursor on the display screen of the electronic device according to the updated reported point sequence. In this implementation, when it is determined that the user is not performing a single-finger sliding operation from the edge of the touchpad or from the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction, the electronic device can determine that the user operation does not have the intention to trigger the execution of the interactive function, and the electronic device can supplement the reported point sequence. By supplementing the reported point sequence, the number of reported points in the reported point sequence can be increased, so that when the user slides on the touchpad with a single finger, the cursor on the display screen of the electronic device moves more smoothly with the user's sliding, avoiding the phenomenon of cursor jumping, and improving the user experience.
[0042] In a possible implementation of the first aspect, the point supplementation of the reporting point sequence includes: determining the position of the supplementary point inserted between the two adjacent reporting points according to the distance between the two adjacent reporting points in the reporting point sequence, the time corresponding to the two adjacent reporting points, and the speed of the two adjacent reporting points; inserting the supplementary point between the two adjacent reporting points according to the position of the supplementary point inserted between the two adjacent reporting points. In this implementation, the coordinates of the supplementary point can be quickly determined by using the interpolation point supplementation method, so that the position of the supplementary point is more accurate, and the accuracy and efficiency of the supplementary point are improved.
[0043] Exemplarily, the edge area of the touchpad includes one or more preset areas, and different areas correspond to different interactive functions.
[0044] In a second aspect, a system for controlling the display interface of an electronic device based on a touchpad is provided. The system is installed in the electronic device and is communicatively connected to the touchpad of the electronic device. The system is used to perform the following steps: in response to receiving a single-finger sliding operation of a user on the touchpad through the touchpad, determining the point information generated by the single-finger sliding operation; based on the point information and the currently displayed first interface, executing an interactive function, the interactive function including any one of returning to the currently displayed application interface, displaying a side taskbar, switching the currently displayed application, or changing the size of the displayed application window.
[0045] The second aspect provides a system for controlling the display interface of an electronic device based on a touchpad. By obtaining the point reporting information of the landing point when a user slides a single finger on the touchpad, it is determined whether the user's operation of the touchpad meets the requirements based on the point reporting information. If the requirements are met, the electronic device performs an interactive function in response to the user's operation on the edge of the touchpad. For example, the application interface (first interface) currently displayed on the electronic device returns to or displays the application control center, adjusts the size of the display window in the electronic device display, calls up the side task bar of the electronic device display, the multitasking center, switches the application currently running on the electronic device, etc. It is consistent with the user's single-finger operation habits on electronic devices with touch screens, is user-friendly, and improves the user experience.
[0046] In a possible implementation manner of the second aspect, the single-finger sliding operation is: a single-finger sliding operation from an edge of the touchpad or from outside the edge of the touchpad to a center of the touchpad.
[0047] In a possible implementation of the second aspect, the reporting point information includes information of each reporting point in a reporting point sequence, and the reporting point information includes: attribute parameters of each reporting point, the position of the first reporting point in the reporting point sequence, the distance between two adjacent reporting points in the reporting point sequence, the speed of the reporting points in the reporting point sequence, the time interval between each reporting point in other reporting points and the first reporting point, the distance between each reporting point in other reporting points and the first reporting point, or at least one of the angles between a line connecting each reporting point in other reporting points and the first reporting point and a horizontal line or a vertical line, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0048] In a possible implementation of the second aspect, an interactive function is executed based on the point reporting information and the currently displayed first interface, including: determining whether the point reporting information meets the conditions for triggering the interactive function; and executing the interactive function if the conditions for triggering the interactive function are met.
[0049] In a possible implementation of the second aspect, the reporting point information includes information of each reporting point in a reporting point sequence, and determining whether the reporting point information meets the conditions for triggering an interactive function includes: determining, based on the reporting point information, that the position of the first reporting point in the reporting point sequence is in the edge area of the touch pad, and each of the other reporting points moves toward the center of the touch pad in turn, then determining that the reporting point information meets the conditions for triggering an interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0050] In a possible implementation of the second aspect, the reporting point information includes information of each reporting point in a reporting point sequence, and determining whether the reporting point information meets the conditions for triggering an interactive function includes: determining according to the reporting point information: each reporting point in the reporting point sequence is a single-finger reporting point, the time interval between each of the other reporting points and the first reporting point is less than or equal to a threshold, and the distance between two adjacent reporting points in the other reporting points is greater than or equal to a threshold, then determining that the reporting point information meets the conditions for triggering an interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0051] In a possible implementation of the second aspect, the reporting point information includes information of each reporting point in a reporting point sequence, and determining whether the reporting point information meets the conditions for triggering an interactive function includes: determining according to the reporting point information: the point speed of each reporting point in other reporting points is greater than 0, the distance between each reporting point in other reporting points and the first reporting point is greater than or equal to a threshold, and the angle between the line connecting each reporting point in other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold, then determining that the reporting point information meets the conditions for triggering an interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0052] In a possible implementation of the second aspect, the reporting point information includes information of each reporting point in a reporting point sequence, and determining whether the reporting point information meets the conditions for triggering an interactive function includes: determining according to the reporting point information: the point speed of some of the other reporting points is greater than 0, the distance between each of the other reporting points and the first reporting point is greater than or equal to a threshold, the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold, and within a preset time length, there are multiple reporting points in the other reporting points with the same position, then it is determined that the reporting point information meets the conditions for triggering an interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0053] In a possible implementation of the second aspect, the system is further configured to perform the following steps: during the execution of the interactive function, a cursor on the display screen of the electronic device does not move.
[0054] In a possible implementation of the second aspect, when the conditions for triggering the interactive function are not met, the system is also used to execute the following steps: when the number of reported points in the reported point sequence is less than a threshold, supplement the reported point sequence to obtain an updated reported point sequence; and move the cursor on the display screen of the electronic device according to the updated reported point sequence.
[0055] In a possible implementation of the second aspect, supplementing the point reporting sequence includes:
[0056] The position of the supplementary point inserted between the two adjacent reporting points is determined according to the distance between the two adjacent reporting points in the reporting point sequence, the time corresponding to the two adjacent reporting points, and the speed of the two adjacent reporting points; and the supplementary point is inserted between the two adjacent reporting points according to the position of the supplementary point inserted between the two adjacent reporting points.
[0057] In a possible implementation manner of the second aspect, the edge area of the touch panel includes one or more preset areas, and different areas correspond to different interactive functions.
[0058] For the beneficial effects corresponding to various possible implementations of the second aspect, reference may be made to the description of the beneficial effects corresponding to various possible implementations of the first aspect described above.
[0059] In a third aspect, a system for controlling the display interface of an electronic device based on a touchpad is provided, wherein the system includes a touchpad and an electronic device, wherein the electronic device and the touchpad are communicatively connected, and the electronic device has a display screen. In the system, the touchpad is used to: receive a single-finger sliding operation of a user on the touchpad; the touchpad is also used to: send point information generated by the single-finger sliding operation to the electronic device; and the electronic device is used to execute each step in the above first aspect or any possible implementation of the first aspect.
[0060] In a fourth aspect, a communication device is provided, which includes a unit for executing each step in the above first aspect or any possible implementation of the first aspect. For example, the communication device includes a transceiver unit (also referred to as an interface module) and a processing unit (also referred to as a processing module). The processing unit is used to control the transceiver unit to perform signal transmission and reception. The transceiver unit is used to receive the point information generated by the single-finger sliding operation of the user on the touch pad in response to receiving the point information generated by the single-finger sliding operation on the touch pad through the touch pad; the processing unit performs an interactive function according to the point information and the currently displayed first interface, and the interactive function includes: returning to the currently displayed application interface, displaying a side taskbar, switching the currently displayed application, or changing the size of the displayed application window, wherein the communication device can control the display screen to display the interface.
[0061] In a fifth aspect, a communication device is provided, which includes at least one processor and a memory, the processor and the memory are coupled, the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, each step in the above first aspect or any possible implementation of the first aspect is performed.
[0062] In a sixth aspect, a communication device is provided, which includes at least one processor and an interface circuit, and the at least one processor is used to execute: each step in the above first aspect or any possible implementation method of the first aspect.
[0063] In a seventh aspect, an electronic device is provided, which includes any communication device provided in the fourth aspect, the fifth aspect or the sixth aspect.
[0064] In an eighth aspect, an electronic device is provided, which supports touch panel control and is used to execute the method in the above first aspect or any possible implementation of the first aspect.
[0065] Exemplarily, the electronic device may be any one of a tablet computer, a PC, a large-screen device, a smart TV, etc.
[0066] In a ninth aspect, a computer program product is provided, which includes a computer program, and when the computer program is executed by a processor, it is used to execute each step in the above first aspect or any possible implementation of the first aspect.
[0067] In a tenth aspect, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed, it is used for each step in the above first aspect or any possible implementation of the first aspect.
[0068] In an eleventh aspect, a chip is provided, comprising: a processor for calling and running a computer program from a memory, so that a communication device equipped with the chip executes each step in the above first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0069] Figure 1 is a schematic diagram of an example of a laptop computer equipped with a touchpad.
[0070] Figure 2 It is a schematic diagram of the hardware structure of an example of an electronic device provided in this application.
[0071] Figure 3 This is a schematic diagram of the software architecture of an electronic device provided in this application.
[0072] Figure 4This is a schematic diagram of an example of the distribution of edge gesture hot zones of a touch panel provided in this application.
[0073] Figure 5 This is another example of the schematic diagram of the edge gesture hot zone distribution of a touch panel provided in the present application.
[0074] Figure 6 This is a schematic flowchart of a method for controlling an electronic device interface based on a touch panel provided in the present application.
[0075] Figure 7 This is a schematic diagram of a coordinate system on a touch panel provided in this application.
[0076] Figure 8 This is an example of a report point P provided by this application i Schematic diagram of the angle between the straight line connecting the first reporting point P0 and the horizontal line.
[0077] Fig. 9 This is a schematic interface diagram provided by the present application showing corresponding changes in the display interface of an electronic device in response to a user's single-finger sliding operation on a touch pad.
[0078] Fig.10 This is another example provided by the present application, which is a schematic interface diagram of the corresponding changes in the display interface of an electronic device in response to a user's single-finger sliding operation on a touch pad.
[0079] Fig.11 This is another example provided by the present application, which is a schematic interface diagram of the corresponding changes in the display interface of an electronic device in response to a user's single-finger sliding operation on a touch pad.
[0080] Fig.12 This is a schematic flowchart of another example of a method for controlling an electronic device interface based on a touch panel provided in the present application.
[0081] Fig.13 This is a schematic diagram of an example of a process for an electronic device to judge a reporting point in a reporting point sequence provided by the present application.
[0082] Fig.14 This is a schematic diagram of another example of a process for an electronic device to judge a reporting point in a reporting point sequence provided by the present application.
[0083] Fig.15 This is a schematic flowchart of an example of supplementing points in an electronic device reporting sequence provided by the present application.
[0084] Fig.16 This is a schematic flowchart of an example of supplementing points in an electronic device reporting sequence provided by the present application.
[0085] Fig.17 It is a schematic block diagram of a communication device provided in an embodiment of the present application.
[0086] Fig.18 It is a schematic block diagram of another communication device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0087] At present, electronic devices such as tablet computers, laptop computers, and PDAs used by users may be equipped with touchpads, and the systems of electronic devices matched with touchpads provide support for users to operate on the touchpads, such as clicking, sliding, dragging, rotating, etc., to achieve control functions of electronic devices, such as changing the size of the display interface (or display window) of the electronic device, changing the interface displayed by a certain application, starting the multitasking interface, returning to the main desktop, switching the currently running application, etc. In other words, the touchpad can replace the function of the mouse, and users can operate on the touchpad with their fingers or a stylus.
[0088] For example, Figure 1 The figure shows a schematic diagram of a notebook computer equipped with a touch panel. Figure 1 In the example shown, the laptop computer and the touchpad are connected in a wired communication manner, for example, through a universal serial bus (USB). The user can slide on the touchpad with a finger, and as the user slides on the touchpad (for example, slides to the right), the cursor 101 on the laptop computer display screen also moves as the user's finger slides on the touchpad (slides to the right). In other words, the user's finger sliding on the touchpad is equivalent to controlling the movement of the cursor 101 on the laptop computer display screen, that is, the touchpad can replace the function of the mouse. The trajectory of the user sliding on the touchpad with a finger or a stylus matches the movement trajectory of the cursor 101 on the laptop computer display screen in the display screen. In other words. The relative position of the trajectory of the user sliding on the touchpad and the touchpad is the same as the relative position of the movement trajectory of the cursor 101 in the display screen and the display screen.
[0089] Optionally, there may be one or more buttons on the touchpad, such as Figure 1 As shown, there are a power on key or power off key 102, a key 103 and a key 104 on the touch panel. Among them, the power on key or power off key 102 can be used to turn on or off the touch panel. Exemplarily, the key 103 can realize the function of the left mouse button, and the key 104 can realize the function of the right mouse button.
[0090] Optionally, there may be an indicator light 105 on the touchpad. When the touchpad is in the on state, the indicator light 105 is always on to prompt the user that the touchpad is in the on state; when the touchpad is in the off state, the indicator light 105 is off to prompt the user that the touchpad is in the off state.
[0091] Of course, it should be understood that Figure 1 This is merely exemplary and should not impose any restrictions on the touchpad and the electronic device. For example, the touchpad can also be used in conjunction with a large-screen device, a tablet computer, and the like. The connection between the touchpad and the electronic device with a display screen can also be a variety of wireless connection methods. The user can also use a stylus to click, slide, drag, rotate, and the like on the touchpad. Alternatively, there may be more buttons with different functions on the touchpad, and multiple buttons may be set at other locations on the touchpad, and the embodiments of the present application are not limited thereto.
[0092] At present, for the scenario where the user uses fingers to operate on the touchpad, a two-finger sliding operation is defined, which is similar to the sliding operation of the user using two fingers on the touch screen. For example, when the user slides on the touchpad with two fingers, in response to the two-finger sliding operation of the user on the touchpad, the electronic device display screen can scroll up and down the list, switch the page displayed on the desktop, etc. And, in this process, the cursor on the electronic device display screen will not move (i.e., the cursor is locked).
[0093] At present, in the scenario where the user uses two fingers to slide on the touchpad, a gesture hot zone can be set at the edge of the touchpad. In order to avoid the user's accidental touch operation, the user's two-finger sliding operation will be shielded in the gesture hot zone, that is, in the gesture hot zone, when the user slides two fingers on the touchpad, the cursor on the electronic device display screen will not move. As long as the electronic device determines that the landing point of the user's two-finger sliding is located in the gesture hot zone, the electronic device will start the corresponding function (such as scrolling the list up and down, switching the page displayed on the desktop), but it cannot move the cursor on the electronic device display screen by sliding two fingers in the gesture hot zone of the touchpad. In other words, this interaction scheme conflicts with the sliding operation on the touchpad defined by the two-finger gesture, and the edge position cannot respond to the normal two-finger sliding operation. In addition, in the above schemes, the user is required to use two fingers to operate on the touchpad, and currently most users use a single finger to operate on the touchscreen for electronic devices with touch screens (such as smart phones, tablets, etc.), which is inconsistent with user habits, increases the user's learning cost, is unfriendly to users, and reduces the user experience.
[0094] In view of this, the present application provides an electronic device interface method, system and electronic device based on touchpad control, the system includes an electronic device and a touchpad, the electronic device includes a display screen, and the electronic device supports control through the touchpad. Through the user using a single finger to slide on the edge of the touchpad, the electronic device obtains the point information of the landing point when the user slides on the touchpad with a single finger, and determines whether the user's operation on the touchpad meets the requirements according to the point information. If the requirements are met, in response to the user's operation on the edge of the touchpad, the current display interface of the electronic device will change adaptively (i.e., execute the interactive function). In other words, when the electronic device determines that the user's single-finger sliding operation on the touchpad meets the conditions for triggering the interactive function, the electronic device executes the interactive function. By judging and determining that the user is performing a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction, the electronic device can determine that the user's operation is intended to trigger or execute the interactive function, thereby executing the interactive function. For example, the interactive functions may include: returning the currently displayed application on the electronic device to or displaying the application control center, adjusting the size of the window displayed on the electronic device display screen, displaying a side task bar and a multitasking center on the electronic device, switching the currently displayed application on the electronic device, etc. This is consistent with the user's single-finger operation habits on electronic devices with touch screens, is user-friendly, and improves the user experience.
[0095] In the embodiment of the present application, application return can be understood as: before the user operates on the touch pad with a finger, the display interface of the electronic device displays the interface of a certain application (for distinction, referred to as the first interface), and after the user operates on the touch pad with a finger, in response to the user's operation on the touch pad with a finger, the display interface of the electronic device will display the upper level interface of the first interface or the parent interface of the first interface. Of course, if the first interface is the first-level interface or the main interface of the application, then in response to the user's operation on the touch pad with a finger, the electronic device will no longer display the interface of the application, that is, the application exits or enters the background operation of the electronic device.
[0096] It should be understood that in this application, the touchpad and the touch screen are two different terms. The touch screen can display the user interface. For example, electronic devices such as smart phones and tablets can be provided with a touch screen, and the user can operate on the touch screen with a finger or a stylus. The touchpad cannot display the user interface. The touchpad and the electronic device with a display screen are two different devices. The display screen of the electronic device can be a touch screen or a non-touch screen. After the touchpad and the electronic device establish a communication connection, the user can use a finger or a stylus to slide on the touchpad and other operations. As the user operates on the touchpad, the display interface in the display screen of the electronic device will also change. The user's operation on the touchpad is equivalent to the user's operation on the mouse.
[0097] It should also be understood that the present application does not limit the shape of the touchpad. For example, the front side of the touchpad (i.e., the side of the touchpad used to receive user finger or stylus operations, also referred to as the touch area of the touchpad) can be a rectangle, a square, or other possible shapes (such as an irregular shape, a circle, etc.), and the embodiments of the present application are not limited thereto.
[0098] The following describes a communication system to which the method provided by the present application is applicable.
[0099] The method provided in the present application can be applied to an electronic device including a touch panel and a display screen. The electronic device supports control via a touch panel. For example, the electronic device with a display screen may include: a laptop computer, a tablet computer, a large-screen device, or a smart screen. The present application does not limit the specific form of the electronic device.
[0100] There is a communication network between the control board and the electronic device, and the communication network can be a wired network or a wireless network. For example, the communication network can be a local area network (LAN) or a wide area network (WAN), such as the Internet. The communication network can be implemented using any known network communication protocol, and the network communication protocol can be various wired or wireless communication protocols, such as Ethernet, USB, FIREWIRE, global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth, wireless fidelity (Wi-Fi), wireless local area networks (WLAN), near field communication (NFC), communication protocols supporting network slicing architecture, or any other suitable communication protocols. This application is not limited here.
[0101] For example, the electronic device may be equipped with Android Microsoft Harmony or other operating systems.
[0102] For example, the method provided in this application can be applied to Figure 1 In the communication system shown.
[0103] The structure of the electronic device provided by the present application is described below. Figure 2 The figure shows a schematic diagram of the hardware structure of an electronic device provided by the present application. The electronic device 200 and the touch panel are connected to each other by wire or wireless communication.
[0104] The electronic device may be any electronic device with a display screen (such as a tablet computer, a PC, a large-screen device, a smart TV, etc.). Figure 2 As shown, the electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, etc. The electronic device 200 is used to execute the steps of the method for controlling the electronic device interface based on a touch panel provided in the present application or any interface displayed.
[0105] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0106] The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0107] A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or circulated. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. Repeated access is avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system. For example, the processor 210 may determine the specific area of the user's touch point, and determine the speed, direction, and distance of the user's sliding operation, etc., based on the point information generated by the user's single-finger sliding operation on the touchpad. If it is determined that a sliding operation that meets the preset conditions is performed on the touchpad within the preset edge gesture hot zone, the processor 210 may respond to the user's operation on the touchpad, control the application displayed on the display screen of the electronic device 200 to return, display the application control center, display the side application bar, or switch the currently running application, etc.
[0108] The wireless communication function of the electronic device 200 can be implemented through the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor and the baseband processor.
[0109] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0110] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 200. The mobile communication module 250 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 250 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the same device as at least some of the modules of the processor 210.
[0111] The wireless communication module 260 can provide wireless communication solutions including wireless local area networks (WLAN) applied to the electronic device 200, such as wireless fidelity (Wi-Fi) networks, bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 210. The wireless communication module 260 can also receive the signal to be sent from the processor 210, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2. For example, the electronic device can communicate with the touch panel through the wireless communication module 260 and receive the point information sent by the touch panel.
[0112] In some embodiments, the antenna 1 of the electronic device 200 is coupled to the mobile communication module 250, and the antenna 2 is coupled to the wireless communication module 260, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), LTE, BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite-based augmentation system (SBAS).
[0113] The electronic device 200 implements the display function through a GPU, a display screen 294, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs, which execute program instructions to generate or change display information.
[0114] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 200 may include 1 or N display screens 294, where N is a positive integer greater than 1. For example, in response to the user's operation on the touchpad, the application displayed on the display screen 294 returns, displays the application control center, displays the side application bar, or switches the currently running application.
[0115] Display screen 294 may be a touch screen or a non-touch screen.
[0116] The electronic device 200 can realize the shooting function through ISP, camera 293, video codec, GPU, display screen 294 and application processor.
[0117] The ISP is used to process the data fed back by the camera 293. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 293.
[0118] The camera 293 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 200 may include 1 or N cameras 293, where N is a positive integer greater than 1.
[0119] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 200 is performing frequency selection, the digital signal processor is used to perform Fourier transform on frequency energy.
[0120] Video codecs are used to compress or decompress digital videos. The electronic device 200 may support one or more video codecs. In this way, the electronic device 200 may play or record videos in a variety of coding formats, such as moving picture experts group (MPEG) 1, MPEG2, MPEG2, MPEG4, etc.
[0121] The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0122] The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 200 (such as audio data, a phone book, etc.), etc. For example, the data storage area may store reporting point information (such as the position, time, speed, etc. of the sliding point of the user's finger on the touch surface), etc.
[0123] In addition, the internal memory 221 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0124] The electronic device 200 can implement audio functions such as music playing and recording through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone jack 270D, and the application processor.
[0125] The audio module 270 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 270 can also be used to encode and decode audio signals. In some embodiments, the audio module 270 can be arranged in the processor 210, or some functional modules of the audio module 270 can be arranged in the processor 210.
[0126] The speaker 270A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 200 can listen to music or listen to a hands-free call through the speaker 270A.
[0127] The receiver 270B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 200 receives a call or voice message, the voice can be received by placing the receiver 270B close to the human ear.
[0128] Microphone 270C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 270C to input the sound signal into the microphone 270C. The electronic device 200 can be provided with at least one microphone 270C. In other embodiments, the electronic device 200 can be provided with two microphones 270C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 200 can also be provided with three, four or more microphones 270C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.
[0129] The earphone interface 270D is used to connect a wired earphone and can be a USB interface 230 or a 2.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0130] The sensor module 280 may include: a pressure sensor, a gyroscope sensor, an angle sensor, a folding sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc. For example, the electronic device 200 may detect the user's click, slide, drag and other operations on the controls on the display screen through the pressure sensor, and transmit the acquired detection parameters to the processor for further processing, thereby realizing the batch adjustment of the display mode of the superimposed floating windows, or switching the floating window displayed on the top layer.
[0131] Of course, the electronic device 200 may also include a charging management module, a power management module, a battery, buttons, indicators, and one or more SIM card interfaces, etc., and the embodiments of the present application do not impose any restrictions on this.
[0132] Figure 3 The diagram shown is a schematic diagram of the software architecture of an electronic device. Figure 3 As shown, the layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the framework layer, the kernel layer, and the hardware layer.
[0133] Applications include system applications and third-party applications. For example, applications may include: camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, game, shopping, travel, instant messaging (such as short messages), etc. In addition, application packages may also include: home screen (i.e. desktop), control center, notification center, etc. system applications.
[0134] The framework layer provides application programming interface (API) and programming framework for applications in the application layer.
[0135] exist Figure 3 In the example shown, the frame layer includes: a multimode input frame and a short-range module.
[0136] The multi-mode input framework includes: an input service module (Inputflinger), an input management module (InputManager) and a window management module (windowManager).
[0137] The input service module (Inputflinger) includes sub-modules such as event reading (Event Hub), event processing (Input Reader), sliding operation recognition algorithm, and event distribution (Input Dispatcher).
[0138] The window management module (WindowManager) includes: window root view (DecorView) and event distribution (ViewRootlmpl) submodules. The input service (Inputflinger) module is connected to the input management module (InputManager) through the Java native interface (java nativeinterface, JNI), and there is a communication interface between the input management module (InputManager) and the window management module (WindowManager).
[0139] The short-range module includes: Bluetooth protocol stack (Bluetooth Stack), Bluetooth Java local interface (BluetoothJNI), Bluetooth service (Bluetooth Service) and Bluetooth profiles (Bluetooth Profiles).
[0140] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, sensor driver, input driver, human interface device (HID) driver, Bluetooth driver, etc.
[0141] The hardware layer is the interface layer between the operating system software and the hardware components, which provides an interface for the interaction between the upper software and the lower hardware. For example, the lower hardware may include: a touch panel. The touch panel is connected to the electronic device via Bluetooth communication. The touch panel includes: a touch module, a touch chip, and a Bluetooth microcontroller (Bluetooth MCU).
[0142] The touchpad is an independent peripheral device. The touchpad is connected to the short-range module through the bluetooth driver, connected to the kernel through the short-range module, and connected to the multi-mode input framework through the kernel. The touch reporting events are transmitted to the multi-mode input framework via Bluetooth. The input service module (Inputflinger) and input management module (InputManager) in the multi-mode input framework process the touch reporting events.
[0143] The input service module (Inputflinger) is used to process and convert the original report. The input management module (InputManager) is mainly used to process the converted report events and inject the report events into various business modules, such as Figure 3 As shown, the input management module (InputManager) injects a reporting event into the current application through the window management module (windowManager), and the current application responds to the reporting event.
[0144] The function of the sliding operation recognition algorithm submodule is to convert the original touchpad reporting events, implement the anti-mistouch mechanism, and process the user's sliding events.
[0145] After obtaining the original point reporting data of the touchpad, the sliding operation recognition algorithm submodule processes the sliding event. For example, based on the point reporting information generated by the user's single-finger sliding operation on the touchpad, it determines the specific area of the user's touch point, as well as the sliding speed, direction, sliding distance, etc. during the user's sliding operation.
[0146] After the input service module (Inputflinger) converts and processes the sliding events, it injects sliding events into various business applications through the input management module (InputManager) and the window management module (windowManager), such as application return, sidebar startup, full-screen window size adjustment and other system functions.
[0147] It should be understood that Figure 3 This is only an example and should not impose any restrictions on the software architecture of the electronic device in this application. Figure 3 In the examples shown, different hierarchical structures or each layer may include more or fewer modules, or a combination of multiple different modules. The present application embodiment is not limited here. The electronic device may also include Figure 3 All or part of the modules shown in the figure are not limited in this application.
[0148] The method provided in this application is described below with reference to specific examples.
[0149] First, the electronic device can set the touch area of the touchpad in advance. In the embodiment of the present application, the effective area (or also called the edge gesture hot zone) for the user's single finger operation in the touch area can be set. Only when the user performs a single-finger sliding operation on the touchpad that meets the preset conditions within the preset edge gesture hot zone, the electronic device can respond to the user's sliding operation on the touchpad, and the application displayed on the screen of the electronic device returns, displays the application control center, displays the side application bar, or switches the currently running application, etc. If the user's operation on the touchpad is not in the preset edge gesture hot zone, or the user's single-finger sliding operation does not meet the preset conditions, the display interface of the electronic device will not be adaptively changed according to the user's single-finger sliding operation on the touchpad. For example, if the starting point of the user's sliding operation on the touchpad is not within the preset edge gesture hot zone, it is regarded as the user's normal operation on the touchpad. In this case, the cursor on the display screen of the electronic device moves as the user slides on the touch screen.
[0150] For example, Figure 4 The figure shows an example of the distribution of edge gesture hotspots of a touchpad.
[0151] exist Figure 4 In the example shown, the resolution of the touchpad (i.e., the resolution of the touch area of the touchpad) is the same as the resolution of the screen of the electronic device (taking a tablet computer as an example), for example, 2880x1920 pixels. Of course, in other implementations of the present application, the resolution of the touchpad can also be other values, or the resolution of the touchpad can also be different from the resolution of the tablet computer screen, and the present application embodiment does not limit this.
[0152] exist Figure 4 In the example shown, the edge gesture hot zone of the touchpad includes four areas: area 1 to area 4, where area 1 is located at the left edge of the touch area of the touchpad, area 2 is located at the lower left corner edge of the touch area of the touchpad, area 3 is located at the right edge of the touch area of the touchpad, and area 4 is located at the lower right corner edge of the touch area of the touchpad. The user can use a single finger to slide to the right (inward slide) in area 1 and area 2, and slide to the left (inward slide) in area 3 and area 4. In different areas, when the user's single-finger sliding operation meets the conditions, the display interface of the electronic device will change differently.
[0153] exist Figure 4In the example shown, the width of area 1 is 100 pixels, the shape of area 2 is a square with a side length of 150 pixels, the width of area 3 is also 100 pixels, and the shape of area 4 is a square with a side length of 150 pixels. Of course, in other implementations of the present application, the edge gesture hotspot of the touchpad may also include more or fewer areas, such as only including the sliding area of the left edge or the right edge. The size of each area may also be other values, which are not limited in the embodiments of the present application.
[0154] For example, Figure 5 Shown is another example of a schematic diagram of the edge gesture hot zone distribution of a touchpad.
[0155] exist Figure 5 In the example shown, the edge gesture hot zone of the touchpad includes six areas: Area 1 to Area 6. Among them, Area 1 is located at the upper left edge of the touch area of the touchpad, Area 2 is located at the upper edge of the touch area of the touchpad, Area 3 is located at the upper right edge of the touch area of the touchpad, Area 4 is located at the lower right corner edge of the touch area of the touchpad, Area 5 is located at the lower edge of the touch area of the touchpad, and Area 6 is located at the lower left edge of the touch area of the touchpad. The user can use a single finger to slide downward (inward sliding) in Areas 1 to 3, and slide upward (inward sliding) in Areas 4 and 6. In different areas, when the user's sliding operation meets the conditions, the display interface of the electronic device will change differently.
[0156] exist Figure 5 In the example shown, the shapes of regions 1, 3, 4, and 6 are squares with a side length of 150 pixels, and the widths of regions 2 and 5 are 100 pixels.
[0157] Of course, it is understandable that Figure 4 and Figure 5 The illustration is merely exemplary. In other implementations of the present application, the edge gesture hotspot of the touchpad may include more or fewer areas, such as only including the sliding area of the upper edge or the lower edge. The size of each area may also be other values, which are not limited in the present application.
[0158] After determining each edge gesture area, the conditions that the user needs to meet when sliding with one finger in each area and the corresponding functions of the electronic device when the conditions are met can be pre-defined. In the embodiment of the present application, the corresponding functions of the electronic device can be understood as: the changes in the display interface of the electronic device when the user's single-finger sliding meets the conditions in different areas. The corresponding functions when the user slides with one finger in different areas are different. In other words, only when the user's sliding operation meets the preset conditions can the electronic device respond to the user's sliding operation to implement the corresponding function. Different functions correspond to different preset conditions. The electronic device can store the correspondence between the function and the conditions that the user's sliding operation needs to meet.
[0159] The following is an example to illustrate this.
[0160] For example, Figure 4 The edge gesture hotspot shown is used as an example for explanation.
[0161] Assumption: In Figure 4 In the example shown, the corresponding functions for sliding a single finger in each area are defined as follows:
[0162] The functions are: returning to the application currently displayed on the electronic device, starting the application control center, or switching the currently running application; the corresponding preset conditions are: the starting position (i.e., initial landing point) of the user's single-finger inward swipe (i.e., sliding towards the middle of the screen) is within area 1 or area 3, and the swipe is fast and continuous.
[0163] The function is: the electronic device displays the side taskbar; the corresponding preset condition is: the user slides inward with one finger, that is, the starting position (i.e., the initial landing point) of the slide to the middle of the screen is in area 1 or area 3, and the slide is paused. Of course, after the pause, the user can continue to slide, or end the sliding operation, that is, lift the finger from the touchpad.
[0164] The function is: the display window area of the electronic device display screen increases or decreases; the corresponding preset conditions are: the starting position (i.e. the initial landing point) of the user's single finger inward sliding is in area 2 or area 4, and it is a fast and continuous sliding.
[0165] It can be understood that the above functions and corresponding preset conditions are only exemplary. In other implementations of the present application, other functions may correspond to a single-finger slide in each area. Alternatively, the electronic device may also provide a function setting interface to the user, on which the user can set the function corresponding to a single-finger slide in each area. Alternatively, the function corresponding to a single-finger slide in each area may be set according to the different programs currently running on the electronic device. For example, if the electronic device is currently running a gallery, in area 1, the user slides inward with a single finger, and the electronic device switches the currently displayed picture to the next picture; in area 3, the user slides inward with a single finger, and the electronic device switches the currently displayed picture to the previous picture; in area 2, the user slides inward with a single finger, and the currently displayed picture is enlarged; in area 4, the user slides inward with a single finger, and the currently displayed picture is reduced, etc.; the embodiment of the present application does not limit the function corresponding to a single-finger slide in each area of the touchpad gesture hot zone, and the preset conditions corresponding to the function.
[0166] After the electronic device determines the function corresponding to the sliding of a single finger in each area of the touchpad gesture hot zone and the preset conditions corresponding to the function, the electronic device can obtain the point reporting information of the user sliding on the touchpad with a single finger. The point reporting information can be understood as: when the user's finger slides on the touchpad, the integrated circuit on the touchpad calculates the position parameters, time parameters, etc. of multiple touch points (also called multiple landing points). The position parameters of the touch points can be represented by the coordinate values of the touch points. Based on the point reporting information of the user's single finger sliding on the touchpad, the electronic device can determine whether the user's operation on the touchpad is within a certain area and whether the preset conditions are met. If it is within a certain area and meets the preset conditions, the electronic device controls the electronic device display to display the interface corresponding to the function of the area.
[0167] Combine the following Figure 6 The method shown is explained. Figure 6 The figure shows a schematic flow chart of a method for controlling an electronic device interface based on a touch panel. Figure 6 As shown, the method 600 includes:
[0168] S601: The touch panel receives a single-finger sliding operation from the user.
[0169] For example, a user may use a single finger to perform a sliding operation on the touch pad, and the position of the sliding operation by the user may be any area of the touch area of the touch pad.
[0170] Exemplarily, the user's single-finger sliding operation may include: the user's single-finger sliding operation from the edge of the touchpad or from outside the edge of the touchpad to the center of the touchpad.
[0171] S602, the electronic device obtains point information reported when the user slides the touch pad with one finger.
[0172] After the user slides on the touchpad with a single finger, the sensor on the touchpad can obtain the point information of the user's single finger sliding on the touchpad, and periodically send the point information to the electronic device. It can be understood that the electronic device includes a display screen.
[0173] The reporting point information includes the position coordinates and time (moment) corresponding to the multiple reporting points. In other words, the sliding track when the user slides with a single finger on the touchpad can be represented by the reporting point information, and the reporting point information includes the information of the user's single-finger sliding operation track point. The reporting points included in the reporting point information can be a reporting point sequence, and different reporting points correspond to different positions, and different reporting points correspond to different times (or timestamps). The multiple reporting points in the reporting point sequence are arranged in chronological order from early to late.
[0174] For example, when the user's finger touches the touchpad and does not slide, that is, it is stationary, the touchpad can only detect one reporting point at a time, and periodically reports the reporting point to the electronic device. If the user's finger touches the touchpad and slides, the touchpad can detect multiple reporting points, the attribute corresponding to the first reporting point is "down", and the attributes of the subsequent multiple reporting points are all "move". If the user's finger touches the touchpad and slides a certain distance and then leaves the touchpad, the touchpad can detect multiple reporting points, the attribute corresponding to the first reporting point is "down", the attributes of the multiple reporting points in the middle are all "move", and the attribute of the last reporting point is "up". The touchpad can report these reporting point information to the electronic device.
[0175] It should be understood that as long as the user's finger contacts or touches the touchpad, the reporting point information will always be generated, regardless of whether the user's finger slides on the touchpad. If the user's finger slides on the touchpad, the positions corresponding to different reporting points are different in chronological order. If the user's finger only contacts the touchpad without sliding, the positions corresponding to multiple reporting points are the same in chronological order.
[0176] The above-mentioned S601 and S602 can also be expressed as: in response to receiving a single-finger sliding operation of the user on the touch panel through the touch panel, the electronic device determines the point reporting information generated by the single-finger sliding operation.
[0177] S603: The electronic device determines the first reporting point in the reporting point information according to the reporting point information.
[0178] The first reported point is the earliest reported point in the reported point sequence, and the time corresponding to the other reported points is later than the first reported point. The other reported points are all reported points in the reported point sequence except the first reported point. Optionally, the first reported point can also be called the initial landing point or the initial touch point. For example, the electronic device can determine the first reported point according to the time corresponding to each reported point.
[0179] S604: For the first reported point, the electronic device determines whether the first reported point is within a preset edge gesture hot zone.
[0180] The electronic device can determine whether the first reported point is within a preset edge gesture hot zone based on the position information of the first reported point. The preset edge gesture hot zone may include one or more areas. As long as it is determined that the first reported point is located in any area, it can be determined that the first reported point is within the preset edge gesture hot zone.
[0181] In other words, the electronic device can determine whether the position of the first reported point is in the edge area of the touch pad.
[0182] For example, assuming that the reporting point sequence includes reporting points P0 to P m , m is an integer greater than 1, the first reported point is P0, and the position coordinates of P0 are (X0, Y0). Exemplarily, the electronic device can define a coordinate origin in the touch area of the touch panel, for example, Figure 7 As shown, the upper left corner is the origin of the coordinates, the coordinates of the origin of the coordinates are (0, 0), the horizontal direction is the X axis, the vertical direction is the Y axis, and each point (report point) on the touchpad can correspond to a point in the coordinate system, that is, each point on the touchpad has a coordinate value, and the coordinates corresponding to the point on the origin of the coordinates are (0, 0). The value of (X0, Y0) can be the coordinate value of point P0 in the coordinate system, and (X0, Y0) can indicate the position information of the first reported point P0.
[0183] The position boundary values of each area in the touchpad gesture hot zone can also be represented by the coordinate values of the points on the position boundary of each area in the coordinate system. For example, assuming that the coordinate boundary value corresponding to a certain area is (0 to X m , 0 to Y m ), if X0 is less than or equal to X m , and Y0 is less than or equal to Y m , it is determined that the first reported point is within the preset area. Otherwise, the first reported point is not within the preset area. In the above manner, it can be determined whether the first reported point is within the preset edge gesture hot zone.
[0184] When the first reported point is within the preset edge gesture hot zone, or the first reported point is within the edge area of the touch pad, the electronic device executes the subsequent steps (S605 to S610).
[0185] S605: When the first reported point is within the preset edge gesture hot zone, the electronic device records the position information and time information of the first reported point, that is, records the position coordinates and timestamp corresponding to the first reported point.
[0186] When the first reported point is not within the preset edge gesture hot zone, that is, the first reported point is outside the edge gesture hot zone (or the position of the first reported point is not within the edge area of the touchpad), it is determined that the user is performing a normal sliding operation in the center of the touchpad. In this case, when the user slides on the touchpad with a single finger, the electronic device does not enable the corresponding function according to the user's sliding operation, and does not execute the subsequent steps (S606 to S610), but processes it according to normal circumstances. That is: when the user slides on the touchpad with a single finger, the cursor on the electronic device will move as the user's finger slides on the touchpad. During the user's single-finger sliding operation on the touchpad, the display interface of the electronic device will not change accordingly (such as application return, pop-up sidebar, change the display window size of the display screen, etc.).
[0187] S606, for each of the other reported points, the electronic device records the position information and time information of each reported point respectively.
[0188] It is understandable that the other reporting points do not include the first reporting point, that is, the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0189] It should also be understood that the electronic device executes S606 only when the first reported point is within the preset edge gesture hot zone.
[0190] S607, the electronic device determines whether the time interval between each of the other reporting points and the first reporting point is less than a preset threshold.
[0191] For example, the reporting point sequence includes reporting point P0 to reporting point P m , the first reported point is P0, then it is necessary to determine the reporting points P1 to P m Whether the time difference between the time corresponding to each reporting point in and the time corresponding to the first reporting point P0 is less than the preset threshold. i -Whether T0 is less than or equal to T, where T is a preset threshold, for example, the value can be 200ms. T0 represents the time (moment) corresponding to the first reported point P0, T i Indicates point P iThe corresponding time (moment), i has a value of 1 to m. Of course, in the present application, T can also have other values, and the present application does not limit this.
[0192] S608: If the time interval between each of the other reported points and the first reported point is less than or equal to a preset threshold, the electronic device locks the cursor.
[0193] If the time interval between each of the other reported points and the first reported point is less than or equal to the preset threshold (that is, the time interval between each of the other reported points and the first reported point is within the time window), it proves that the user is performing a relatively fast single-finger sliding operation on the touchpad, rather than a slower sliding or stillness. Stillness can also be understood as the user contacting or touching the touchpad with a single finger and not sliding.
[0194] In the embodiment of the present application, locking the cursor can be understood as: the cursor on the screen of the electronic device is stationary or does not move. That is, even if the user continues to slide on the touch pad with a single finger, the cursor on the electronic device will not move with the sliding of the user's finger on the touch pad.
[0195] Since the user slides on the touchpad relatively quickly, locking the cursor can, on the one hand, enhance the user's visual experience, and on the other hand, prevent the cursor from moving when the user slides on the touchpad, causing changes in the display interface of the electronic device.
[0196] Of course, if the time interval between each of the other reported points and the first reported point is less than or equal to the preset threshold, the electronic device may not lock the cursor.
[0197] Optionally, when the time interval between each reported point and the first reported point in other reported points is greater than (or equal to) a preset threshold, the electronic device may not lock the cursor. Not locking the cursor can be understood as: the user continues to slide on the touchpad with a single finger, and the cursor on the electronic device will move as the user's finger slides on the touchpad.
[0198] Optionally, when the time interval between each reported point and the first reported point in other reported points is greater than the threshold, the electronic device can determine that the user's sliding operation on the touchpad is: an edge sliding operation that does not meet the conditions, and the user may be unconsciously touching or pressing the touchpad for a long time with his finger. The electronic device will not enable the corresponding function according to the user's sliding operation, that is, it will not execute the subsequent steps, but will process it according to normal circumstances. When the user slides on the touchpad with a single finger, the cursor on the electronic device will move as the user's finger slides on the touchpad. During the user's sliding operation on the touchpad, the display interface of the electronic device will not change accordingly (such as application return, pop-up sidebar, change the display window size of the display screen, etc.).
[0199] When the time interval between each of the other reporting points and the first reporting point is less than or equal to the preset threshold, the electronic device executes S609.
[0200] S609, the electronic device determines whether the position speed of each of the other reported points is greater than 0, whether the distance between two adjacent reported points in the other reported points meets the threshold, whether the distance between each of the other reported points and the first reported point meets the threshold, and whether the angle between the line connecting each of the other reported points and the first reported point and the horizontal line or the vertical line meets the threshold. The other reported points are the reported points in the reported point sequence except the first reported point.
[0201] Optionally, in S609, the electronic device further determines whether there are multiple reporting points with the same position among other reporting points within a preset time length.
[0202] It should be understood that these judgment processes in S609 are all for judging whether the user's sliding operation is an edge sliding operation that meets the conditions. In other words, these judgment processes in S609 are used to judge whether the user performs the sliding operation at an appropriate speed and direction, etc., and these judgment conditions in S609 are used to judge whether the user's sliding operation meets the conditions for triggering the interactive function.
[0203] The following will specifically describe several judgment processes in S609:
[0204] For example, the electronic device can input the position information and time information corresponding to each reported point in other reported points into the speed tracker in the electronic device to calculate the point speed of each reported point. The point speed of each reported point can also be called the sliding speed of each touch point.
[0205] For example, it is assumed that the reporting point sequence includes reporting points P0 to P m , reporting point P0 to reporting point P m It can also be called the reporting interval when the user slides a single finger on the touchpad.i The corresponding point speed can be V i , i ranges from 1 to m. Then it is necessary to determine V i Is it greater than V, where V represents the preset point speed, or can also be called the sliding speed threshold of the touch point. i Corresponding point speed V i If the value is greater than V, it means that the user does not slide in the opposite direction when sliding on the touchpad, that is, the user slides in the same direction when sliding on the touchpad, and does not slide in the opposite direction (i.e., slide back). i Corresponding point speed V i If it is greater than V, the point speed of the reported point meets the threshold.
[0206] Exemplarily, the value of V may be 0. Of course, in other implementations of the present application, the value of V may also be other values, and the embodiments of the present application are not limited thereto.
[0207] It should also be understood that if the P i Corresponding point speed V i If it is less than 0, it means that the user slides in the opposite direction when sliding on the touchpad, that is, the user does not slide in the same direction when sliding on the touchpad. i Corresponding point speed V i If it is greater than 0, it proves that the user's sliding on the touchpad is continuous.
[0208] It should also be understood that if the P i Corresponding point speed V i If it is less than 0, it means that the user's finger is only touching the touchpad without sliding.
[0209] For other reported points, whether the distance between two adjacent reported points meets the threshold:
[0210] Assumption: Report point P i The corresponding position is S i , report point P i-1 The corresponding position is S i-1 , then report point P i With the report point P i-1 The distance between the next reported point and the previous reported point needs to be greater than or equal to L1 to meet the threshold, where L1 represents the preset distance threshold. i With the report point P i-1 The distance between them can be reported using the point P i The coordinates of the reported point P i-1The coordinate value of L1 is calculated, and optionally, the value of L1 can be 15, and the unit is pixel. Of course, in this application, the value of L1 can be other values, and this application does not limit it. i With the report point P i-1 If the distance between two adjacent reporting points is less than L1, the distance between two adjacent reporting points does not meet the threshold.
[0211] At the reporting point P i With the report point P i-1 When the distance between the two fingers is greater than or equal to L1, it proves that the user is sliding quickly on the touchpad with a single finger, rather than standing still or sliding at a slower speed.
[0212] At the reporting point P i With the report point P i-1 When the distance between the two fingers is less than L1, it indicates that the user may be stationary or sliding slowly on the touchpad with a single finger.
[0213] Whether the distance between each reported point and the first reported point meets the threshold:
[0214] Assumption: Report point P i The corresponding position is S i , the first reported point P0 corresponds to the position S0, then the reported point P i The distance between the first reported point P0 and the first reported point P0 needs to be greater than or equal to L2 to meet the threshold, and L2 represents the preset distance threshold. Optionally, the value of L2 can be 50, and the unit is pixel. Of course, in this application, the value of L2 can be other values, and this application does not limit it here.
[0215] At the reporting point P i If the distance from the first reported point P0 is greater than or equal to L2, it proves that the user has slid a sufficiently long distance on the touchpad, and it is ruled out that the user's sliding operation may be an accidental touch operation. i The distance from the first reported point P0 may also be referred to as a sliding distance when the user slides on the touch pad with a single finger.
[0216] If the distance between each of the other reported points and the first reported point is less than the threshold value L2, then the distance between each of the other reported points and the first reported point does not meet the threshold value. i When the distances from the first reported point P0 are all less than L2, it proves that the user has slid a short distance on the touchpad, and the user's sliding operation may be an accidental touch operation.
[0217] For other reported points, whether the angle between the line connecting each reported point and the first reported point and the horizontal line meets the threshold:
[0218] For example, for Figure 4 In the example shown, assume that: point P i The corresponding position is S i , the first reported point P0 corresponds to the position S0, then you can connect the reported point P i The reported point P0 forms a straight line, and determines whether the angle between the straight line and the horizontal line is less than or equal to a preset angle. If the angle is less than or equal to the preset angle, the threshold is met. For example, the preset angle can be 75 degrees. Of course, in the present application, the preset angle can also be other values, and the present application is not limited thereto.
[0219] Exemplary, combined Figure 8 In the example shown, point P will be reported i A straight line is connected between the horizontal point P0 and the reporting point P1 to form a straight line, which is represented by B1, and the horizontal line is represented by B2. The angle between B1 and B2 is θ, which needs to be less than or equal to 75 degrees.
[0220] If the angle between the line connecting each of the other reported points and the first reported point and the horizontal line or the vertical line is less than or equal to the threshold, it proves that the user is sliding inwards from the edge area of the touchpad (i.e. sliding toward the center of the touchpad), thereby eliminating the user's accidental touch operation on the touchpad (i.e. the sliding direction is not toward the center of the touchpad). Optionally, the angle between the line connecting each of the other reported points and the first reported point and the horizontal line or the vertical line can also be understood as the sliding angle of the user's finger.
[0221] If the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is greater than (or equal to) the threshold, the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line does not meet the threshold.
[0222] Of course, when the user slides inward from the left edge or the right edge of the touchpad, it is necessary to determine whether the angle between the line connecting each of the other reported points and the first reported point and the horizontal line meets the threshold, for example, Figure 4 The edge gesture hot zone distribution is shown. When the user slides inward from the upper edge of the touchpad or the lower edge of the touchpad, for example Figure 5 For the distribution of the edge gesture hotspots of the touchpad shown, it is necessary to determine whether the angle between the line connecting each of the other reported points and the first reported point and the vertical line meets the threshold, for example, whether it is less than a preset angle.
[0223] It should also be understood that the horizontal line in the embodiment of the present application can be understood as a line parallel to the upper and lower edges of the touch panel, and the vertical line can be understood as a line parallel to the left and right edges of the touch panel.
[0224] For other reporting points, whether there are multiple reporting points with the same position within the preset time length:
[0225] Assumption: The preset time length is T m , then within the preset time length, the electronic device can determine whether there are multiple reporting points with the same position, for example, the electronic device can determine the position of each reporting point based on the coordinates of each reporting point. If within the preset time length, there are multiple reporting points (i.e., some reporting points in the reporting point sequence) with the same position (i.e., there are multiple reporting points with the same position), it proves that the user has paused in the process of sliding on the touchpad; if within the preset time length, there are no multiple reporting points with the same position, that is, there are no multiple reporting points with the same position in other reporting points, it proves that the user has been sliding continuously on the touchpad without pause.
[0226] For example, the preset time length is T m The value of can be 250ms. Of course, in other implementations of the present application, T m The value of can also be other values, which is not limited in the embodiment of the present application.
[0227] S610, when the point speed of each reported point among other reported points is greater than 0, the distance between two adjacent reported points among other reported points meets the threshold, the distance between each reported point among other reported points and the first reported point meets the threshold, and the angle between the line connecting each reported point among other reported points and the first reported point and the horizontal line or the vertical line meets the threshold, the electronic device responds to the user's single-finger sliding operation on the touch pad, and the display screen of the display device enables the corresponding function according to the user's single-finger sliding operation.
[0228] in other words, Figure 6 The process shown is a judgment process for the electronic device to determine whether the single-finger sliding operation of the user on the touchpad is an edge sliding operation that meets the conditions. When the threshold condition in S609 is met, the electronic device can determine that the sliding operation of the user on the touchpad is: an edge sliding operation that meets the conditions, that is, it is determined that the sliding operation of the user meets the conditions for triggering the interactive function, so that in response to the single-finger sliding operation of the user on the touchpad, the display screen of the electronic device enables the corresponding function according to the single-finger sliding operation of the user (that is, the electronic device performs the interactive function).
[0229] In other words, when the conditions in S609 are met, the electronic device can determine that the user is performing a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction, and the user's operation needs to trigger or execute an interactive function, thereby executing the interactive function.
[0230] For example, when a user slides a finger on the touchpad, the first reported point is within the preset edge gesture hot zone; and when the following five conditions are met, the electronic device can determine that the user's operation is an inward sliding operation that meets the conditions, and the electronic device can respond to the user's sliding operation on a certain area to implement the corresponding function (i.e., execute the interactive function).
[0231] Condition 1: The time interval between each of the other reporting points and the first reporting point is less than or equal to a preset threshold;
[0232] Condition 2: The speed of each reported point in other reported points is greater than 0;
[0233] Condition 3: The distance between two adjacent reporting points among other reporting points is greater than or equal to the threshold;
[0234] Condition 4: The distance between each of the other reported points and the first reported point is greater than or equal to the threshold;
[0235] Condition 5: The angle between the line connecting each of the other reported points and the first reported point and the horizontal line or vertical line is less than or equal to the threshold;
[0236] If conditions one to five are met, it can be determined that the user is performing a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction, and the sliding is rapid and continuous, that is, the user's sliding operation on the touchpad is an edge sliding operation that meets the conditions.
[0237] Through the above-mentioned judgment conditions, it is possible to more accurately determine whether the user's sliding operation on the touchpad meets the preset conditions, thereby improving the accuracy of judging the user's sliding operation, and effectively preventing the display screen from enabling the corresponding function based on the user's single-finger sliding operation due to the user's accidental touch operation, thereby avoiding the user's accidental triggering behavior and improving the accuracy of identifying the user's intention.
[0238] For example, combined with Fig. 9 In the example shown, the touch panel and the electronic device are connected by wireless communication, and the edge gesture hot zone of the touch panel is divided into four areas, such as Fig. 9 As shown in Figure c, the corresponding functions and Figure 4 If the first reported point P0 falls within area 1 and meets the above five conditions, it proves that the starting position of the user's single finger inward sliding is in area 1 and the sliding is fast and continuous, that is, it is determined that the user's sliding operation meets the conditions for triggering the interactive function. Before the user slides on the touchpad, the interface displayed by the electronic device is as follows Fig. 9In response to a single-finger sliding operation of the user on the touch panel, the electronic device performs an interactive function. For example, the interface displayed by the electronic device is as follows: Fig. 9 Jump to the image a in Fig. 9 As shown in Figure b, the display interface switches to Fig. 9 The upper level interface (parent interface) of the interface shown in Figure a, that is, the application currently displayed on the electronic device, is returned.
[0239] For example, combining Fig.10 In the example shown, the touch panel and the electronic device are connected by wireless communication, and the edge gesture hot zone of the touch panel is divided into four areas, such as Fig.10 As shown in Figure c, the corresponding functions and Figure 4 If the first reported point P0 falls in area 2 and meets the above five conditions, it proves that the starting position of the user's single finger inward sliding is in area 2 and the sliding is fast and continuous, that is, it is determined that the user's sliding operation meets the conditions for triggering the interactive function. Before the user slides on the touchpad, the interface displayed by the electronic device is as follows Fig.10 In response to a single-finger sliding operation of the user on the touch panel, the electronic device performs an interactive function. For example, the interface displayed by the electronic device is as follows: Fig.10 Jump to the image a in Fig.10 As shown in Figure b, the display window area of the electronic device display screen is reduced.
[0240] Optionally, if the above condition 2 is replaced by: the speed of some of the other reported points is greater than 0; and condition 6 is added: within the preset time length, there are multiple reported points with the same position in the other reported points. In this case, if the first reported point is within the preset edge gesture hot zone and meets conditions 1 to 6, it can be determined that: the user is performing a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction, and there is a pause, that is, it is determined that the user's sliding operation meets the conditions for triggering the interactive function. Of course, after the pause, the user can continue to slide, or end the sliding operation.
[0241] For example, combined with Fig.11 In the example shown, the touchpad and the electronic device are connected wirelessly, and the edge gesture hot zone of the touchpad is divided into four areas, such as Fig.11 As shown in Figure c, the corresponding functions and Figure 4If the first reported point P0 falls within area 1 and meets the above six conditions, it proves that the starting position of the user's single finger inward sliding is in area 1, and it is an inward sliding and pause, that is, it is determined that the user's sliding operation meets the conditions for triggering the interactive function. Before the user slides on the touchpad, the interface displayed by the electronic device is as follows Fig.11 In response to a single-finger sliding operation of the user on the touch panel, the electronic device performs an interactive function. For example, the interface displayed by the electronic device is as follows: Fig.11 Jump to the image a in Fig.11 As shown in Figure b, the electronic device displays a side task bar 1101.
[0242] Optionally, in some possible implementations, in S607, if the electronic device determines that the time interval between each of the other reported points and the first reported point is less than or equal to a preset threshold, the electronic device can lock the cursor, and the cursor locked state can continue until the judgment of S609 is executed. If the condition in S609 is met, the cursor locked state can continue to be maintained until the user's finger leaves the touchpad and the cursor is unlocked. If the condition of S609 is not met, the cursor is unlocked. In other words, the electronic device can lock the cursor in the process of determining whether the user's single-finger sliding operation on the touchpad is an edge sliding operation that meets the conditions. In other words, the electronic device can lock the cursor when determining that the user's single-finger sliding operation on the touchpad is an edge sliding operation that meets the conditions (that is, determining that the user's sliding operation meets the conditions for triggering the interactive function). By locking the cursor, on the one hand, the user's visual experience can be improved. On the other hand, it can prevent the cursor from moving when the user slides on the touchpad and causing changes in the display interface of the electronic device.
[0243] If the first reported point is not within the preset edge gesture hot zone (the first reported point is within the edge area of the touchpad), or any one of the above conditions one to five or at least one condition is not met, then it can be determined that the user's sliding operation on the touchpad is a normal sliding operation (determining that the user's sliding operation does not meet the conditions for triggering the interactive function). In this case, it is processed according to the normal situation: that is, when the user slides on the touchpad with a single finger, the cursor on the electronic device will move with the sliding of the user's finger on the touchpad (that is, the cursor is not locked), and the electronic device will not enable the corresponding function according to the user's sliding operation, that is, the electronic device display interface will not change accordingly when the user slides with a single finger in different areas. In other words, when it is determined that the user's sliding operation does not meet the conditions for triggering the interactive function, that is, the user does not perform a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at an appropriate or appropriate speed and direction, the electronic device can determine that the user's operation does not trigger the intention to execute the interactive function, and the electronic device does not execute the interactive function.
[0244] Optionally, in some possible implementations, when the first reported point is not within the preset edge gesture hot zone (the position of the first reported point is within the edge area of the touchpad), or when any one of the above conditions or at least one of the five conditions is not satisfied, the electronic device may further perform point supplementation processing on the reported point sequence, and the specific process of point supplementation processing is described in detail below. In other words, upon determining that the user's sliding operation does not meet the conditions for triggering an interactive function, that is, the user does not perform a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at an appropriate or appropriate speed and direction, the electronic device may determine that the user's operation does not have the intention to trigger the execution of an interactive function, and the electronic device may further perform point supplementation on the reported point sequence.
[0245] The method for controlling the interface of an electronic device based on a touchpad provided in the present application determines the reporting interval of a user sliding on a touchpad with a single finger through an electronic device, and determines whether the user's operation on the touchpad meets the requirements according to multiple factors such as sliding distance, sliding angle, sliding direction, and sliding speed. If the requirements are met, in response to the user's single-finger sliding operation on the edge of the touchpad, the current display interface of the electronic device will change adaptively. In other words, the electronic device can determine that the user's operation has the intention of triggering the execution of an interactive function by judging that the user is sliding from the edge of the touchpad or from the edge of the touchpad to the center of the touchpad with a single finger at an appropriate speed and direction, and the electronic device executes the interactive function. For example, the application currently displayed on the electronic device returns to or displays the application control center, adjusts the size of the display window in the electronic device display screen, calls out the side taskbar of the electronic device display screen (that is, the screen of the electronic device displays the side taskbar), etc. It is consistent with the user's single-finger operation habit on electronic devices with touch screens and is user-friendly. In addition, multiple factors such as sliding distance, sliding angle, sliding direction, and sliding speed are used to determine whether the user's operation of the touchpad meets the requirements, that is, an anti-mistouch mechanism is added, which can avoid changes in the current display interface of the electronic device due to the user's accidental touch operation (that is, avoid the electronic device from performing interactive functions), ensure the matching between the user's actual intention and the change of the current display interface of the electronic device (that is, ensure the matching between the user's actual intention and whether the electronic device performs interactive functions), and improve the user experience.
[0246] Optionally, in some possible embodiments of the present application, after the electronic device obtains the reporting point information of the user sliding on the touch pad with a single finger, it can determine whether the reporting point meets the requirements based on the attribute parameters corresponding to each reporting point in the reporting point information (also referred to as the reporting point type mark).
[0247] For example, assuming that the reporting point sequence includes reporting points P0 to P m , m is an integer greater than 1, the first reporting point is P0, and the electronic device can determine whether the reporting point is a large-area palm reporting point or a single finger reporting point based on the attribute information of each reporting point (the marking position of the reporting point).
[0248] It should be understood that no matter whether the user uses the palm or a single finger to touch the touchpad, the touchpad can only detect one reporting point at the same time, that is, the number of reporting points detected by the touchpad has nothing to do with the area of the touchpad that the user touches. Therefore, when the user uses the palm or a single finger to touch the touchpad, the electronic device can only receive one reporting point. Of course, if the user touches (using the palm or a single finger) the touchpad and slides a certain distance and then leaves the touchpad, the touchpad can detect multiple reporting points, and each reporting point corresponds to an attribute information. In addition to including: the attribute of the reporting point is "down", "move" or "up", the attribute information can also include information for indicating the type of reporting point (i.e., palm reporting point or single finger reporting point).
[0249] As a possible implementation, the type of the reporting point can be expressed as "TOOL_TYPE". If "TOOL_TYPE = PALM", it is determined that the reporting point is a large-area palm reporting point, which does not meet the requirements. If "TOOL_TYPE = FINGER", it is determined that the reporting point is a single-finger reporting point, which meets the requirements.
[0250] In other words, after S602 in method 600, the electronic device can first determine the type of each reporting point according to the attribute parameters corresponding to each reporting point. When it is determined that the type of each reporting point is a single-finger reporting point, the electronic device executes the subsequent steps (S603 to S609) of method 600. In this way, invalid reporting points can be simply and quickly excluded, that is, the user's accidental touch operation can be excluded, effectively preventing the user's accidental touch operation from triggering the electronic device to perform an interactive function, avoiding the user's accidental triggering behavior, and improving the accuracy of user intent recognition.
[0251] Optional, Fig.12 FIG. 2 shows another schematic flow chart of a method for controlling an electronic device interface based on a touch panel. Fig.12 As shown, Fig.12 The method 1200 shown may be performed by an electronic device, and the method 1200 includes:
[0252] S1201, obtaining the original reported point when the user's finger slides on the touch pad.
[0253] S1202, determining whether the original reported point is the initial landing point, that is, judging whether it is the initial reported point.
[0254] S1203: If it is an initial point report, determine whether the initial landing point falls on the edge area of the touch panel, that is, whether it falls within the edge gesture hot zone of the touch panel.
[0255] S1204: If the initial landing point falls on the edge area of the touch panel, record the initial position S0 and time T0 of the initial landing point P0.
[0256] S1205: If it is not the initial point, record the initial point P of the current point i Location S i Time T i .
[0257] S1206, determine whether the time interval between the current point and the initial point is within the time window, that is, determine whether T i -Whether T0 is less than T. S1206 can be used to determine whether the user moves the cursor with a normal single finger or with an edge gesture. For example, the value of T can be 200ms.
[0258] S1207, if the time interval between the current point and the initial point is within the time window, the cursor is locked, that is, the cursor is locked to report the point and the cursor is not moved.
[0259] S1208, the current landing point position S i and time T i Time is added to the speed tracker and the point speed is calculated as V i .
[0260] S1209, determine whether the following conditions are met:
[0261] The angle between the trajectory line and the horizontal line or the vertical line between the current landing point and the starting point is determined to determine whether the angle is less than θ. For example, the value of θ can be 75 degrees.
[0262] Determine whether the moving distance between the previous and next two frames is greater than the distance threshold L1, that is, the moving distance S between the two frames i -S i-1 Is it greater than L1? For example, the value of L1 can be 15 pixels.
[0263] Determine whether the distance between the current point and the initial point is greater than the distance threshold L2, that is, the distance S between the current point and the initial landing point i - Is S0 greater than L2? For example, the value of L2 can be 50 pixels.
[0264] Determine whether the finger reporting speed is reversed, that is, the speed V of the current point i Is it greater than V. For example, the value of V can be 0.
[0265] S1210, if the angle between the trajectory line between the current landing point and the starting point and the horizontal line or the vertical line is less than θ; the moving distance between the previous and next two frames is greater than the distance threshold L1; the distance between the current point and the initial point is greater than the distance threshold L2; the current point reporting speed is greater than the speed V, then it is determined that the user's sliding operation is an edge gesture.
[0266] S1211, after being identified as a touchpad edge gesture, the acquired reporting point is converted into a touchpad edge hot zone event, and sent to the corresponding business module through the InputManager of the electronic device to trigger the gesture function (ie, execute the interactive function).
[0267] S1212, if:
[0268] If at least one of the following conditions is not met: the angle between the trajectory line between the current landing point and the starting point and the horizontal line or the vertical line is less than θ, the moving distance between the previous and next two frames is greater than the distance threshold L1, the distance between the current point and the initial point is greater than the distance threshold L2, and the current point reporting speed is greater than the speed V, it is not recognized as a touchpad edge gesture, and the reported point can be supplemented.
[0269] S1213, after supplementing the reported points, the reported points P0 to P i Moves the cursor on the display.
[0270] use Fig.12 The method shown in the figure determines the gesture intention through multiple factors such as gesture reporting interval, sliding distance, angle, supplementary point, etc., identifies whether it is an edge gesture, adds false touch protection, cursor processing mechanism, and realizes single-finger edge operation. The operation experience is consistent with the touch screen. In addition, invalid reporting points can be simply and quickly excluded, that is, the user's false touch operation can be excluded, effectively preventing the electronic device from executing interactive functions due to the user's false touch operation, avoiding the user's false triggering behavior, and improving the accuracy of user intention recognition.
[0271] For example, Fig.13 FIG. 6 is a schematic diagram showing a process of determining a time in a time sequence by an electronic device in method 600. Fig.13 The process shown can exclude invalid reporting points, that is, exclude the user's accidental touch operation, effectively prevent the electronic device from enabling the corresponding function due to the user's accidental touch operation on the touch panel, that is, avoid the user's false triggering behavior and improve the accuracy of user intention recognition. In other words, Fig.13 The process shown can be understood as a judgment process for the electronic device to determine whether the user's sliding operation meets the conditions for triggering the interactive function. That is, whether the user's operation is: a single-finger sliding operation from the edge of the touchpad or from the outside of the edge of the touchpad to the center of the touchpad at a suitable or appropriate speed and direction. If so, it is recognized as an edge gesture, that is, the conditions for triggering the interactive function are met, and the electronic device performs the interactive function.
[0272] like Fig.13 As shown, the process includes:
[0273] S1301, after the electronic device obtains the reporting point sequence when the user slides the touch panel with one finger, it analyzes the attribute parameters of each reporting point, that is, analyzes the mark position of the reporting point.
[0274] For example, if the attribute parameter "TOOL_TYPE" of the reporting point is "PALM", it is determined that the reporting point is a large-area palm reporting point, which does not meet the requirements. If the attribute parameter "TOOL_TYPE" of the reporting point is "FINGER", it is determined that the reporting point is a single-finger reporting point, which meets the requirements.
[0275] S1302: If the reported point is a large-area palm report, no processing is performed on the reported point.
[0276] For example, if the reported points are reported by a large area of palm, it is considered that the user's palm accidentally touches the touchpad, and therefore these reported points need to be discarded.
[0277] S1303: If the point reported is reported by a single finger, determine whether the first reported point in the point reporting sequence is within a preset edge gesture hot zone.
[0278] S1304: If the first reported point is outside the preset edge gesture hot zone, the electronic device does not enable the corresponding function according to the user's sliding operation.
[0279] For example, if the first reported point is outside the preset edge gesture hot zone, it is determined that the user is performing a normal sliding operation in the center of the touchpad, and the display interface of the electronic device will not be adaptively changed according to the user's single-finger sliding operation on the touchpad. The cursor on the electronic device display moves as the user slides on the touch screen.
[0280] S1305: If the first reporting point is within the preset edge gesture hot zone, determine whether the time interval between each of the other reporting points and the first reporting point is within the time window. The other reporting points are reporting points in the reporting point sequence except the first reporting point.
[0281] S1306: If the time interval between each of the other reported points and the first reported point is not within the time window, the electronic device does not enable the corresponding function according to the user's sliding operation. The cursor on the electronic device display moves as the user slides on the touch screen.
[0282] S1307: If the time interval between each of the other reporting points and the first reporting point is within the time window, the electronic device determines whether the sliding speed and sliding direction of the other reporting points meet the requirements.
[0283] For example, if the point speed of each of the other reported points is greater than 0, and the angle between the line connecting each of the other reported points and the first reported point and the horizontal line or the vertical line meets the threshold (less than or equal to the preset threshold), then the sliding direction meets the requirements, that is, the sliding direction is consistent.
[0284] If the distance between two adjacent reported points in other reported points is greater than the threshold, and the point speed of each reported point in other reported points is greater than 0, then the sliding speed meets the requirement, that is, a faster sliding speed.
[0285] S1308: If the sliding speed and sliding direction of other reporting points do not meet the requirements, the electronic device does not enable the corresponding function according to the user's sliding operation.
[0286] For example, if the other reported points are fast sliding or the sliding direction is consistent, the requirement is met. Otherwise, the requirement is not met.
[0287] S1309, if the sliding speed and sliding direction of other reporting points meet the requirements, the electronic device enables corresponding functions according to the user's sliding operation. That is, when the user slides a single finger in different areas of the touch panel, the electronic device display interface will change accordingly.
[0288] For example, when a user slides one finger on the edge of the touchpad, the sliding direction needs to be consistent and reverse sliding cannot occur. The sliding speed needs to be greater than a threshold, that is, it needs to slide at a faster speed, to determine that the user's sliding operation meets the conditions for triggering the interactive function.
[0289] The electronic device does not enable the corresponding function according to the user's single-finger sliding operation on the edge of the touchpad, which can be understood as: during the user's single-finger sliding operation on the touchpad, the electronic device display interface will not change accordingly (such as application return, pop-up sidebar, change the display window size of the display screen, etc.), that is, the interactive function is not executed.
[0290] The electronic device enables the corresponding function according to the single-finger sliding operation on the edge of the touchpad: It can be understood that the electronic device responds to the user's single-finger sliding operation on the edge of the touchpad, and the current display interface of the electronic device will change adaptively. For example, the application currently displayed on the electronic device returns or displays the application control center, adjusts the size of the display window on the electronic device display, and displays the side task bar on the display. That is, the electronic device performs the interactive function.
[0291] Understandably, Fig.13What is shown is merely exemplary, and in other implementations of the present application, the electronic device may also use other judgment conditions to determine: whether the user's single-finger sliding operation on the touchpad meets the requirements (i.e., whether the user's sliding operation meets the conditions for triggering the interactive function), that is, whether to enable the corresponding function (whether to execute the interactive function) based on the user's single-finger sliding operation on the touchpad.
[0292] pass Fig.13 The judgment process shown can exclude invalid reporting points, that is, exclude the user's accidental touch operation, effectively prevent the change of the current display interface of the electronic device caused by the user's accidental touch operation, that is, avoid the user's false triggering behavior, improve the accuracy of user intention recognition, and improve the user experience. In other words, the user's false touch operation can be excluded, effectively preventing the electronic device from performing interactive functions due to the user's false touch operation, avoiding the user's false triggering behavior, and improving the accuracy of user intention recognition.
[0293] Optionally, as a possible implementation method, in an embodiment of the present application, if the electronic device detects that: when the user slides with a single finger on the touchpad, the first reported point is within a preset edge gesture hot zone, and the user quickly slides in a certain direction for a distance and then slides in the opposite direction, in this case, the electronic device can also cancel the function corresponding to the edge gesture hot zone.
[0294] For example, combined with Fig. 9 The example shown is Fig. 9 As shown in Figure c in FIG. 1 , if the user starts sliding one finger inward in area 1 and slides quickly and continuously and then slides in the opposite direction, the interface displayed by the electronic device remains as shown in FIG. Fig. 9 As shown in Figure a, it will not jump to Fig. 9 As shown in Figure b, the application return function is not enabled.
[0295] Optionally, before performing the above Fig.13 In the judgment process shown, the cursor on the display screen of the electronic device can be locked. In other words, when the electronic device is judging whether the single-finger sliding operation of the user on the touchpad is an edge sliding operation that meets the conditions, the electronic device can lock the cursor.
[0296] Fig.14 A schematic diagram showing another example of a process in which an electronic device determines a reporting point in a reporting point sequence in method 600 is shown. Fig.14 The process shown can be executed by an electronic device.
[0297] Fig.14 The process shown mainly includes:
[0298] Get the original reporting sequence, that is, the reporting sequence sent by the touchpad.
[0299] According to the keyboard firmware bottom-level reporting type mark, the reporting mark bit is parsed. The large-area palm reporting mark is parsed to eliminate the palm sliding accidental touch and large-area palm reporting. When the user's palm is on the edge of the touchpad, the gesture event is not responded.
[0300] Among them, "TOOL_TYPE" indicates the point reporting type or the mark of the point reporting, and the value is "PALM" or "FINGER", PALM represents the palm, and FINGER represents a single finger.
[0301] Based on the initial landing point, determine whether the user is sliding normally with one finger or sliding inward from the edge, that is, determine whether the initial landing point is inside or outside the edge hot zone of the touchpad. Exclude the initial landing point from being outside the edge hot zone of the touchpad, that is, exclude the possibility of the user accidentally triggering an edge gesture after sliding from the center to the edge.
[0302] Determine whether there is sliding within the time window. If there is no sliding within the time window, it will not be recognized as an edge gesture, and false touches caused by unconscious contact or pressing will be excluded;
[0303] Whether the time window slides, determine the sliding speed and sliding direction.
[0304] According to the sliding speed and sliding direction, if it is determined to be: a fast slide and the sliding direction is consistent, it is determined that the user's sliding on the touchpad is an edge slide (that is, it is recognized as an edge gesture), the user's sliding operation meets the conditions for triggering the interactive function, and the electronic device executes the interactive function.
[0305] According to the sliding speed and sliding direction, if it is determined to be: slow sliding or back sliding, it is determined that the user's sliding on the touchpad is not an inward sliding on the edge (that is, it is not recognized as an edge gesture), and the user has no intention of sliding inward on the touchpad. It can be determined that the user operation does not have the intention to trigger the execution of the interactive function, the user's sliding operation does not meet the conditions for triggering the interactive function, and the electronic device does not perform the interactive function.
[0306] exist Fig.14 In the process shown, by disassembling and distinguishing the false touch scenarios, the bottom-level reporting point type mark and sliding parameters are used to strictly constrain the edge gesture triggering conditions, effectively preventing false triggering behaviors in various usage scenarios. In other words, the electronic device determines that the user's single-finger sliding operation from the edge of the touchpad or from the outside of the touchpad edge to the center of the touchpad at an appropriate speed and direction, and the electronic device determines that the user's operation has the intention of triggering the execution of the interactive function, and the electronic device executes the interactive function.
[0307] Optionally, in some possible implementations, if at least one of the following six conditions is met, the electronic device may also supplement the reporting sequence:
[0308] Condition 1: The first reported point is not within the preset edge gesture hot zone;
[0309] Condition 2: The time interval between each of the other reporting points and the first reporting point is greater than a preset threshold;
[0310] Condition 3: The speed of each reported point in other reported points is equal to or less than 0;
[0311] Condition 4: The distance between two adjacent reporting points among other reporting points is less than the threshold;
[0312] Condition 5: The distance between each of the other reported points and the first reported point is less than the threshold;
[0313] Condition 6: The angle between the line connecting each of the other reported points and the first reported point and the horizontal line or vertical line is greater than the threshold;
[0314] Among them, other reporting points are reporting points other than the first reporting point in the reporting point sequence.
[0315] In other words, if the electronic device determines that the user's sliding operation on the touchpad is an edge sliding operation that does not meet the conditions based on the reporting sequence generated by the user's single-finger sliding on the touchpad, in this case, since the number of reported points in the reporting sequence may be relatively small, for example, when the user slides a single finger on the edge of the touchpad, the number of reported points in the reporting sequence is relatively small. The electronic device can also supplement the reporting sequence. By supplementing the reporting sequence, the number of reported points in the reporting sequence can be increased, so that when the user slides on the touchpad with a single finger, the cursor on the electronic device display screen moves more smoothly with the user's sliding, avoiding the phenomenon of cursor jumping, and improving the user experience.
[0316] For example, Fig.15 The figure shows a schematic flow chart of an example of supplementing a point in a sequence of electronic equipment reporting points. Fig.15 As shown, the process includes:
[0317] S1501, the electronic device obtains a point reporting sequence generated by a single finger sliding on the touch pad of the user.
[0318] S1502: The electronic device determines, based on the reporting sequence, whether the single-finger sliding operation of the user on the touchpad is an edge sliding operation that meets the conditions (ie, the sliding operation of the user meets the conditions for triggering the interactive function).
[0319] For example, the judgment process of whether the single-finger sliding operation of the electronic device on the touch pad is an edge sliding operation that meets the conditions can refer to Figure 6 , Fig.12 , Fig.13 or Fig.14 The process shown will not be repeated here.
[0320] Optionally, in the process of determining whether the single-finger sliding operation of the user on the touchpad is an edge sliding operation that meets the conditions, the electronic device can lock the cursor.
[0321] S1503, if the single-finger sliding operation performed by the user on the touchpad is an edge sliding operation that meets the conditions, the electronic device responds to the single-finger sliding operation of the user on the touchpad, and the display screen of the electronic device enables the corresponding function according to the single-finger sliding operation of the user.
[0322] S1504: If the single-finger sliding operation performed by the user on the touchpad is an edge sliding operation that does not meet the condition, determine whether the number of reported points in the reported point sequence is greater than a threshold.
[0323] For example, the preset threshold may be 5. Of course, in other implementations of the present application, the preset threshold may also be other values, and the embodiments of the present application are not limited thereto.
[0324] S1505: If the number of reported points in the reported point sequence is greater than the threshold, no additional points are added to the reported point sequence, and the electronic device moves the cursor according to the reported point sequence.
[0325] If the number of reported points in the reporting sequence is greater than the threshold, the reporting sequence is not supplemented. The electronic device moving the cursor according to the reporting sequence can be understood as: the moving track of the cursor on the display screen of the electronic device corresponds to the information of the reported points in the reporting sequence. In other words, the moving track of the cursor on the display screen is determined according to the information of the reported points in the reporting sequence.
[0326] Of course, S1505 may also be replaced by: if the number of reported points in the reported point sequence is equal to or less than the threshold, moving the cursor according to the reported point sequence.
[0327] If the cursor is locked in S1502, then in S1505, the electronic device may first unlock the cursor and then move the cursor on the display screen according to the reporting sequence.
[0328] S1506: When the number of reported points in the reported point sequence is less than or equal to the threshold, determine whether it is necessary to add a point between two adjacent reported points.
[0329] Assumption: The reporting sequence includes reporting point P0 to reporting point P m , reporting point P0 is the first reporting point, i ranges from 1 to m, and m is a positive integer greater than 1.
[0330] For example, if the reported point P i The previous report point P i-1, and the reported point P i If the distance between them is greater than, point P is reported. i-1 Time and report point P i The length of time between the time and V i-1 The product of , then determine the need to report point P i With the report point P i-1 Make up points in between.
[0331] For example, report point P i The previous reported point is P i-1 , report point P i-1 The corresponding position is S i-1 , report point P i The corresponding position is S i , report point P i-1 The corresponding time (moment) is T i-1 , report point P i The corresponding time is T i , V i-1 To report point P i-1 The point velocity needs to satisfy the following formula (1):
[0332] S i-1 +(T i -T i-1 )V i-1 ≤S i (1)
[0333] In the case where formula (1) is satisfied, that is, when the number of reported points in the reported point sequence is less than the threshold, if the reported point P i The previous report point P i-1 , and report point P i The distance between them is greater than the reporting point P i-1 Time and report point P i The length of time between the time and V i-1 The product of , then determine the need to report point P i With the report point P i-1 Make up points in between.
[0334] Of course, the above formula (1) is only exemplary. In other implementations of the present application, other conditions or methods may be used to determine whether it is necessary to report point P. i With the report point P i-1 The present application does not limit the method for determining whether it is necessary to fill in points between two adjacent reported points.
[0335] If the above formula (1) is not satisfied, execute S1507: do not fill in a point between two adjacent reported points. i With the report point P i-1No filling in between.
[0336] S1508, when it is necessary to add a point between two adjacent reported points, add a point between the two adjacent reported points to obtain a new reported point sequence.
[0337] Assume that you need to report point P i With the report point P i-1 For example, point P i With the report point P i-1 The coordinates of the additional reporting points can be determined according to formula (2):
[0338] S i-1 +(T i -T i-1 )V i-1 (2)
[0339] Of course, the above formula (2) is only exemplary. In other implementations of the present application, other conditions or methods may be used to determine the value of the reporting point P. i With the report point P i-1 The present application does not limit the method for determining the position of the supplementary point between two adjacent reported points.
[0340] The above method of filling in points between two adjacent reported points can also be called an interpolation filling method. By using the interpolation filling method, the coordinates of the filling points can be quickly determined, making the positions of the filling points more accurate, thereby improving the accuracy and efficiency of the filling points.
[0341] After the reporting point sequence is supplemented, the number of reporting points in the reporting point sequence is increased to obtain a new reporting point sequence.
[0342] In S1509, the electronic device can use the new dot sequence to control the movement of the cursor on the electronic device display screen. In the above manner, by supplementing the dot sequence, the cursor on the electronic device display screen moves more smoothly, avoiding the phenomenon of cursor jumping, and improving the user experience.
[0343] Optionally, as a possible implementation method, the above S1506 can also be replaced by: when the number of reported points in the reported point sequence is less than or equal to the threshold value, the electronic device determines that the reported point sequence needs to be supplemented. That is to say, in other implementation methods of the present application, when the electronic device determines that the number of reported points in the reported point sequence is less than or equal to the threshold value, it can supplement the reported point sequence without continuing to determine whether it is necessary to supplement points between two adjacent reported points. In this case, after S1506, it can be directly executed: the electronic device supplements points between the supplemented points in the reported point sequence to obtain a new reported point sequence. Then execute S1509. The way in which the electronic device supplements points between the supplemented points in the reported point sequence can also be an interpolation supplement method or other supplement methods, etc., which is not limited in the embodiments of the present application.
[0344] The method for controlling the interface of an electronic device based on a touchpad provided by the present application determines the reporting interval of a user sliding on a touchpad with a single finger through an electronic device, and judges whether the user's operation on the touchpad meets the requirements according to multiple factors such as sliding distance, sliding angle, sliding direction, and sliding speed. If the requirements are met, in response to the user's single-finger sliding operation on the edge of the touchpad, the current display interface of the electronic device will change adaptively. This is consistent with the user's single-finger operation habits of electronic devices with touch screens, and is user-friendly. The sliding distance, sliding angle, sliding direction, sliding speed, and other factors are used to determine whether the user's operation on the touchpad meets the requirements, and an anti-mistouch mechanism is added, which can avoid changes in the current display interface of the electronic device caused by the user's mistouch operation, ensure the matching between the user's actual intention and the change in the current display interface of the electronic device, and improve the user experience. In addition, after judging that the user's sliding operation on the touchpad does not meet the requirements, the reporting sequence generated when the user slides the touchpad is supplemented, which can achieve smoother movement of the cursor on the display screen of the electronic device, avoid the phenomenon of cursor jumping, and improve the user experience.
[0345] For example, Fig.16 FIG. 1 is another schematic flow chart of a method for supplementing a sequence of electronic equipment reporting points. Fig.16 shown. Fig.16 The process shown can be executed by an electronic device, and the process includes:
[0346] Get the original reporting sequence P0 to P i The original reporting sequence is the reporting sequence sent by the touch panel.
[0347] Identify whether the cursor is locked during edge gestures and save the original point reporting data.
[0348] After being recognized as an edge gesture by the edge gesture recognition algorithm, the cursor is kept locked and the electronic device performs the interactive function.
[0349] After the edge gesture recognition algorithm recognizes it as a non-edge gesture, the cursor lock is released and the original point report is used to move the cursor, and the cursor can move normally.
[0350] When there are more original reported points, which are greater than the threshold (e.g. 5), the cursor can be moved normally by using the original reported points to report;
[0351] When the number of original reported points is small, less than a threshold value (e.g., 5), interpolation points are added between the original reported points according to the moving distance and speed of the reported points, and the speed and position of the previous reported point are compared with the speed and position of the current reported point, and the interpolation point filling mechanism is used to add reported points between two adjacent reported points. After adding the reported points, the cursor is moved using the original and interpolated points.
[0352] Exemplarily, the interpolation point implementation mechanism is: when P i-1 +(T i -T i-1 )V i-1 >P i No points added, when P i-1 +(T i -T i-1 )V i-1 <P i At the reporting point P i And report point P i-1 Fill in the points between them, and the coordinates of the fill points are P i-1 +(T i -T i-1 )V i-1 .
[0353] Among them, P0 represents the starting position of the reporting sequence, P i Indicates the current position of the reporting point in the reporting sequence, T i The timestamp of the current report point, V i Indicates the current reporting speed, V i-1 Indicates the speed of the previous reporting point of the current reporting point, T i-1 Indicates the timestamp of the previous reporting point of the current reporting point.
[0354] Through the above Fig.16 In the process shown, the cursor will not move during gesture recognition; when there is no gesture, the cursor moves more smoothly by using the point filling method based on the number of reported points.
[0355] The method for controlling the interface of an electronic device based on a touchpad provided by the present application is that the user's gesture operation on the touchpad and the touch screen is consistent (single-finger sliding operation), so that the user has a consistent experience for the touchpad and the touch screen edge gesture interaction, which reduces the user's learning cost and is user-friendly. In addition, the gesture intention is judged by multiple factors such as the gesture reporting interval, sliding distance, sliding angle, sliding direction, etc., and an anti-mistouch mechanism is added. The user's mistouch operation can be excluded, and the electronic device is effectively prevented from performing interactive functions due to the user's mistouch operation, avoiding the user's mistriggering behavior and improving the accuracy of user intention recognition. In addition, after determining that the user's sliding operation on the touchpad does not meet the requirements, the reporting sequence generated when the user slides the touchpad is supplemented, which can achieve smoother movement of the cursor on the electronic device display screen, avoid the phenomenon of cursor jumping, and improve the user experience.
[0356] It should be understood that the above is only to help those skilled in the art better understand the embodiments of the present application, rather than to limit the scope of the embodiments of the present application. According to the above examples given, those skilled in the art can obviously make various equivalent modifications or changes, for example, some steps in the above process (method embodiment) may not be necessary, or some new steps may be added. Or a combination of any two or any multiple embodiments of the above. Such modifications, changes or combined solutions also fall within the scope of the embodiments of the present application.
[0357] It should also be understood that the division of the methods, situations, categories and embodiments in the embodiments of the present application is only for the convenience of description and should not constitute a special limitation. The features of various methods, categories, situations and embodiments can be combined without contradiction.
[0358] It should also be understood that the various numerical numbers involved in the embodiments of the present application are only for the convenience of description and are not used to limit the scope of the embodiments of the present application. The size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0359] It should also be understood that the above description of the embodiments of the present application focuses on emphasizing the differences between the various embodiments. The same or similar points that are not mentioned can be referenced to each other. For the sake of brevity, they will not be repeated here.
[0360] This embodiment can divide each device (including the above-mentioned electronic device) into functional modules according to the above-mentioned method embodiment. For example, it can be divided into various functional modules corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0361] It should be noted that the relevant contents of each step involved in the above method embodiment can all be referred to the functional description of the corresponding functional module, which will not be repeated here.
[0362] The electronic device provided in the embodiment of the present application is used to execute the process provided in any of the above embodiments, so that the same effect as the above implementation method can be achieved. In the case of an integrated unit, the electronic device may include a processing module, a storage module and a communication module. Among them, the processing module can be used to control and manage the actions of the electronic device. For example, it can be used to support the electronic device to execute the steps performed by the processing unit. The storage module can be used to support the storage of program codes and data, etc. The communication module can be used to support the communication between the electronic device and other devices (such as a touchpad).
[0363] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic boxes, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, and so on. The storage module can be a memory. The communication module can specifically be a device that interacts with other devices (such as a touch panel) such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.
[0364] For example, Fig.17 A schematic block diagram of a communication device 1700 according to an embodiment of the present application is shown. The communication device 1700 may correspond to the above-mentioned electronic device, or may be a chip or component applied to the electronic device, and each module or unit in the communication device 1700 is respectively used to perform the above-mentioned Figure 6 , Figures 12 to 16 Each action or processing process performed by an electronic device.
[0365] like Fig.17 As shown, the communication device 1700 includes a transceiver unit 1710 and a processing unit 1720. The transceiver unit 1710 is used to perform specific signal transmission and reception under the drive of the processing unit 1720.
[0366] The transceiver unit 1710 is used for, in response to receiving a single-finger sliding operation of a user on the touch panel through the touch panel, receiving the point reporting information generated by the single-finger sliding operation;
[0367] Processing unit 1720 is also used to: execute interactive functions according to the reporting information and the currently displayed first interface, and the interactive functions include: returning to the currently displayed application interface, displaying the side task bar, switching the currently displayed application, or changing the size of the displayed application window.
[0368] The communication device provided in the present application obtains the point information of the user's finger landing on the touchpad through the user's finger sliding operation on the edge of the touchpad, and determines whether the user's operation on the touchpad meets the requirements based on the point information. If the requirements are met, in response to the user's single-finger sliding operation on the edge of the touchpad, the communication device performs an interactive function, that is, controls the current display interface (first interface) to change adaptively. For example, the currently displayed application returns to or displays the application control center, adjusts the size of the display window in the display screen, calls up the side task bar of the display screen, the multitasking center, switches the currently running application, etc. It is consistent with the user's single-finger operation habits on electronic devices with touch screens, is user-friendly, and improves the user experience.
[0369] In some possible implementations, the single-finger sliding operation is: a single-finger sliding operation from the edge of the touchpad or from outside the edge of the touchpad to the center of the touchpad.
[0370] In some possible implementations, the reporting point information includes information of each reporting point in the reporting point sequence, and the reporting point information includes: attribute parameters of each reporting point, the position of the first reporting point in the reporting point sequence, the distance between two adjacent reporting points in the reporting point sequence, the speed of the reporting points in the reporting point sequence, the time interval between each reporting point in other reporting points and the first reporting point, the distance between each reporting point in other reporting points and the first reporting point, or at least one of the angles between the line connecting each reporting point in other reporting points and the first reporting point and a horizontal line or a vertical line, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0371] In some possible implementations, the processing unit 1720 is further used to: determine whether the reporting point information meets the conditions for triggering the interactive function; and execute the interactive function if the conditions for triggering the interactive function are met.
[0372] In some possible implementations, the processing unit 1720 is also used to: determine, based on the reporting point information, that the position of the first reporting point in the reporting point sequence is in the edge area of the touch pad, and each of the other reporting points moves toward the center of the touch pad in turn, then determine that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0373] In some possible implementations, the processing unit 1720 is further used to: determine based on the reporting point information: each reporting point in the reporting point sequence is a single-finger reporting point, the time interval between each of the other reporting points and the first reporting point is less than or equal to a threshold, and the distance between two adjacent reporting points in the other reporting points is greater than or equal to a threshold, then determine that the reporting point information meets the conditions for triggering an interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0374] In some possible implementations, the processing unit 1720 is also used to: determine according to the reporting point information: the point speed of each of the other reporting points is greater than 0, the distance between each of the other reporting points and the first reporting point is greater than or equal to a threshold, and the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
[0375] In some possible implementations, the processing unit 1720 is also used to: determine based on the reporting point information: the point speed of some of the other reporting points is greater than 0, the distance between each of the other reporting points and the first reporting point is greater than or equal to a threshold, the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold, and within a preset time length, there are multiple reporting points in the other reporting points with the same position, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the point sequence except the first reporting point.
[0376] In some possible implementations, the processing unit 1720 is further configured to: during the execution of the interactive function, a cursor on the display screen of the electronic device does not move.
[0377] In some possible implementations, when the conditions for triggering an interactive function are not met, the processing unit 1720 is further used to: when the number of points in the point reporting sequence is less than a threshold, supplement the point reporting sequence to obtain an updated point reporting sequence; and move the cursor on the display screen of the electronic device according to the updated point reporting sequence.
[0378] In some possible implementations, the processing unit 1720 is also used to: determine the position of the supplementary point inserted between two adjacent reporting points in the reporting point sequence based on the distance between the two adjacent reporting points, the times corresponding to the two adjacent reporting points, and the speeds of the two adjacent reporting points; and insert a supplementary point between the two adjacent reporting points based on the position of the supplementary point inserted between the two adjacent reporting points.
[0379] In some possible implementations, the edge area of the touch panel includes one or more preset areas, and different areas correspond to different interactive functions.
[0380] In some possible implementations, the processing unit 1720 determines that the sliding operation satisfies the condition for triggering the interactive function when the following conditions are met:
[0381] Each point reported in the reporting sequence is reported by a single finger;
[0382] The first reported point in the reporting sequence is within the preset edge gesture hotspot of the touchpad:
[0383] The time interval between each of the other reporting points and the first reporting point is less than or equal to a preset threshold;
[0384] The point speed of each reported point in other reported points is greater than 0;
[0385] The distance between two adjacent reporting points in other reporting points is greater than or equal to the threshold;
[0386] The distance between each of the other reported points and the first reported point is greater than or equal to the threshold;
[0387] The angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to the threshold.
[0388] In some possible implementations, the processing unit 1720 determines that the sliding operation satisfies the condition for triggering the interactive function when the following conditions are met:
[0389] Each point reported in the reporting sequence is reported by a single finger;
[0390] The first reported point in the reporting sequence is within the preset edge gesture hotspot of the touchpad:
[0391] The time interval between each of the other reporting points and the first reporting point is less than or equal to the threshold;
[0392] The point speed of some of the other reported points is greater than 0;
[0393] The distance between two adjacent reporting points in other reporting points is greater than or equal to the threshold;
[0394] The distance between each of the other reported points and the first reported point is greater than or equal to the threshold;
[0395] The angle between the line connecting each of the other reported points and the first reported point and the horizontal line or the vertical line is less than or equal to the threshold value;
[0396] Within the preset time length, there are multiple reporting points with the same position among other reporting points.
[0397] Further, the communication device 1700 may also include a storage unit, and the transceiver unit 1710 may be a transceiver, an input / output interface, or an interface circuit. The storage unit is used to store instructions executed by the transceiver unit 1710 and the processing unit 1720. The transceiver unit 1710, the processing unit 1720, and the storage unit are coupled to each other, the storage unit stores instructions, the processing unit 1720 is used to execute the instructions stored in the storage unit, and the transceiver unit 1710 is used to perform specific signal transmission and reception under the drive of the processing unit 1720.
[0398] It should be understood that the specific process of each unit in the communication device 1700 performing the above corresponding steps can be referred to in conjunction with the above Figure 6 , Figures 12 to 16 For the sake of brevity, the description of the electronic device related to the related embodiments is not repeated here.
[0399] It should be understood that the transceiver unit 1710 may be a transceiver, an input / output interface, or an interface circuit. The storage unit may be a memory. The processing unit 1720 may be implemented by a processor. Fig.18 As shown, the communication device 1800 may include a processor 1810, a memory 1820, a transceiver 1830 (the transceiver may include a transmitter and a receiver), and a bus system 1840. The various components of the communication device 1800 are coupled together through the bus system 1840, wherein the bus system 1840 may include a power bus, a control bus, and a status signal bus in addition to a data bus. However, for the sake of clarity, Fig.18 In FIG. 1 , various buses are labeled as bus system 1840. For ease of representation, Fig.18 The drawing is only schematic.
[0400] It should be understood that when the communication device 1800 is a chip, the communication device 1800 may include a processor 1810 and a transceiver 1830, and the transceiver 1830 may correspond to an input and output interface, for example, the transceiver 1830 may include an input interface and an output interface. Alternatively, the transceiver 1830 may also correspond to an interface circuit, which is used to output and / or input signals.
[0401] Fig.17 The communication device 1700 shown or Fig.18 The communication device 1800 shown can implement the aforementioned Figure 6 , Figures 12 to 17 The steps performed by the electronic device in each embodiment of the present invention can be referred to the description of the corresponding method mentioned above for similar description. To avoid repetition, it will not be described here.
[0402] It should also be understood that Fig.17 The communication device 1700 shown or Fig.18 The communication device 1800 shown may be an electronic device, or the electronic device may include Fig.17 The communication device 1700 shown or Fig.18 The communication device 1800 is shown. It should be understood that the electronic device may also include a display screen.
[0403] It should also be understood that the electronic device in the present application may also be a chip, a chip system, or a processor that supports the electronic device to implement the method, and the embodiments of the present application are not limited here.
[0404] It should also be understood that the division of units (or modules) in the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And the units in the device can all be implemented in the form of software calling through processing elements; they can also be implemented in the form of hardware; some units can also be implemented in the form of software calling through processing elements, and some units can be implemented in the form of hardware. For example, each unit can be a separately established processing element, or it can be integrated in a certain chip of the device. In addition, it can also be stored in the memory in the form of a program, and called and executed by a certain processing element of the device. The processing element here can also be called a processor, which can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each unit above can be implemented by an integrated logic circuit of hardware in the processor element or in the form of software calling through a processing element.
[0405] In one example, the unit in any of the above devices may be one or more integrated circuits configured to implement the above method, such as one or more application specific integrated circuits (ASIC), or one or more digital signal processors (DSP), or one or more field programmable gate arrays (FPGA), or a combination of at least two of these integrated circuit forms. For another example, when the unit in the device can be implemented in the form of a processing element scheduler, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call a program. For another example, these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).
[0406] It should be understood that in the embodiments of the present application, the processor may be a CPU, and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0407] It should also be understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).
[0408] The present application also provides a device, which is included in an electronic device, and has the function of implementing the behavior of the electronic device in any of the above embodiments. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above function.
[0409] The present application also provides an electronic device that supports control via a touch panel. For example, the structure of the electronic device can be as follows: Figure 2 or Figure 3 As shown, the electronic device includes a display screen. The electronic device is used to execute the steps executed by the electronic device in any of the above embodiments.
[0410] Exemplarily, the electronic device may be any one of a tablet computer, a PC, a large-screen device, a smart TV, etc.
[0411] An embodiment of the present application also provides a computer storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the steps executed by the electronic device in any of the above embodiments.
[0412] An embodiment of the present application also provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the steps executed by the electronic device in any of the above embodiments.
[0413] An embodiment of the present application also provides a system for controlling the display interface of an electronic device based on a touchpad. The system is installed in the electronic device and is communicatively connected to the touchpad of the electronic device. The system is used to execute the steps executed by the electronic device in any of the above embodiments or to execute the method for controlling the interface of an electronic device based on a touchpad provided in the present application.
[0414] For example, the system may be implemented by software modules, or by hardware structures and software modules.
[0415] An embodiment of the present application also provides a graphical user interface on an electronic device, wherein the electronic device has a display screen, a camera, a memory, and one or more processors, wherein the one or more processors are used to execute one or more computer programs stored in the memory, and the graphical user interface includes a graphical user interface displayed when the electronic device executes steps as performed by the electronic device in any of the above embodiments.
[0416] An embodiment of the present application also provides a system for controlling a display interface of an electronic device based on a touch panel, the system comprising: the electronic device and the touch panel provided in the above embodiment.
[0417] An embodiment of the present application further provides a chip, which includes: a processor, which is used to execute a computer program or instruction in a memory, so that an electronic device equipped with the chip executes any one of the methods provided in the above-mentioned embodiments of the present application.
[0418] Optionally, any one of the communication devices provided in the above-mentioned embodiments of the present application may include the chip.
[0419] Optionally, the computer instructions are stored in a storage unit.
[0420] Optionally, the storage unit is a storage unit in the chip, such as a register, a cache, etc. The storage unit can also be a storage unit located outside the chip in the terminal, such as a ROM or other types of static storage devices that can store static information and instructions, RAM, etc. Among them, the processor mentioned in any of the above can be a CPU, a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the above method. The processing unit and the storage unit can be decoupled and respectively set on different physical devices, and connected by wired or wireless means to implement the respective functions of the processing unit and the storage unit to support the system chip to implement the various functions in the above embodiments. Alternatively, the processing unit and the memory can also be coupled on the same device.
[0421] It is understandable that, in order to realize the above functions, the above electronic device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.
[0422] The embodiment of the present application can divide the functional modules of the above-mentioned electronic device etc. according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0423] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0424] Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.
[0425] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.
[0426] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for controlling an electronic device interface based on a touch panel, characterized in that: The method is applied to an electronic device supporting touch panel control, and the method comprises: In response to receiving a single-finger sliding operation of a user on the touch panel through the touch panel, determining point reporting information generated by the single-finger sliding operation; An interactive function is executed according to the reporting point information and the currently displayed first interface, wherein the interactive function includes: returning to the currently displayed application interface, displaying a side task bar, switching the currently displayed application, or changing the size of the displayed application window.
2. The method according to claim 1, characterized in that The single-finger sliding operation is: a single-finger sliding operation from the edge of the touch panel or from outside the edge of the touch panel to the center of the touch panel.
3. The method according to claim 1 or 2, characterized in that: The reporting point information includes information of each reporting point in the reporting point sequence, and the reporting point information includes: At least one of the attribute parameters of each reporting point, the position of the first reporting point in the reporting point sequence, the distance between two adjacent reporting points in the reporting point sequence, the speed of reporting points in the reporting point sequence, the time interval between each reporting point in other reporting points and the first reporting point, the distance between each reporting point in other reporting points and the first reporting point, or the angle between the line connecting each reporting point in other reporting points and the first reporting point and a horizontal line or a vertical line, wherein the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
4. The method according to any one of claims 1 to 3, characterized in that The performing of the interactive function according to the reporting point information and the currently displayed first interface includes: Determining whether the reporting point information meets the condition for triggering the interactive function; When the condition for triggering the interactive function is met, the interactive function is executed.
5. The method according to claim 4, characterized in that The reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information satisfies the condition for triggering the interactive function includes: According to the reporting point information, it is determined that the position of the first reporting point in the reporting point sequence is in the edge area of the touch pad, and each of the other reporting points moves toward the center of the touch pad in turn, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
6. The method according to claim 4 or 5, characterized in that: The reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information satisfies the condition for triggering the interactive function includes: According to the reporting point information, it is determined that: each reporting point in the reporting point sequence is reported by a single finger, the time interval between each reporting point and the first reporting point in the other reporting points is less than or equal to a threshold, and the distance between two adjacent reporting points in the other reporting points is greater than or equal to a threshold, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
7. The method according to any one of claims 4 to 6, characterized in that The reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information satisfies the condition for triggering the interactive function includes: According to the reporting point information, it is determined that: if the point speed of each of the other reporting points is greater than 0, the distance between each of the other reporting points and the first reporting point is greater than or equal to a threshold, and the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
8. The method according to any one of claims 4 to 6, characterized in that The reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information satisfies the condition for triggering the interactive function includes: It is determined according to the reporting point information that: the point speed of some of the other reporting points is greater than 0, the distance between each of the other reporting points and the first reporting point is greater than or equal to a threshold, the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold, and within a preset time length, there are multiple reporting points in the other reporting points with the same position, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: During the execution of the interactive function, the cursor on the display screen of the electronic device does not move.
10. The method according to any one of claims 4 to 8, characterized in that When the condition for triggering the interactive function is not met, the method further includes: If the number of reported points in the reported point sequence is less than a threshold, supplement the reported point sequence to obtain an updated reported point sequence; A moving cursor on a display screen of the electronic device is provided according to the updated reporting sequence.
11. The method according to claim 10, characterized in that The point reporting sequence is supplemented, comprising: Determine the position of the supplementary point inserted between the two adjacent reporting points according to the distance between the two adjacent reporting points in the reporting point sequence, the time corresponding to the two adjacent reporting points, and the speed of the two adjacent reporting points; According to the position of the supplementary point inserted between the two adjacent reporting points, a supplementary point is inserted between the two adjacent reporting points.
12. The method according to claim 5, characterized in that The touch panel edge area includes one or more preset areas, and different areas correspond to different interactive functions.
13. A system for controlling the display interface of an electronic device based on a touch panel, characterized in that: The system is installed in an electronic device and is communicatively connected with a touch panel of the electronic device. The system is used to perform the following steps: In response to receiving a single-finger sliding operation of a user on the touch panel through the touch panel, determining point reporting information generated by the single-finger sliding operation; An interactive function is executed according to the reporting point information and the currently displayed first interface, wherein the interactive function includes: returning to the currently displayed application interface, displaying a side task bar, switching the currently displayed application, or changing the size of the displayed application window.
14. The system according to claim 13, characterized in that The single-finger sliding operation is: a single-finger sliding operation from the edge of the touch panel or from outside the edge of the touch panel to the center of the touch panel.
15. The system according to claim 13 or 14, characterized in that The reporting point information includes information of each reporting point in the reporting point sequence, and the reporting point information includes: At least one of the attribute parameters of each reporting point, the position of the first reporting point in the reporting point sequence, the distance between two adjacent reporting points in the reporting point sequence, the speed of reporting points in the reporting point sequence, the time interval between each reporting point in other reporting points and the first reporting point, the distance between each reporting point in other reporting points and the first reporting point, or the angle between the line connecting each reporting point in other reporting points and the first reporting point and a horizontal line or a vertical line, wherein the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
16. The system according to any one of claims 13 to 15, characterized in that The performing of the interactive function according to the reporting point information and the currently displayed first interface includes: Determining whether the reporting point information meets the condition for triggering the interactive function; When the condition for triggering the interactive function is met, the interactive function is executed.
17. The system according to claim 16, characterized in that The reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information satisfies the condition for triggering the interactive function includes: According to the reporting point information, it is determined that the position of the first reporting point in the reporting point sequence is in the edge area of the touch pad, and each of the other reporting points moves toward the center of the touch pad in turn, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
18. The system according to claim 16 or 17, characterized in that The reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information satisfies the condition for triggering the interactive function includes: According to the reporting point information, it is determined that: each reporting point in the reporting point sequence is reported by a single finger, the time interval between each reporting point and the first reporting point in the other reporting points is less than or equal to a threshold, and the distance between two adjacent reporting points in the other reporting points is greater than or equal to a threshold, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
19. The system according to any one of claims 16 to 18, characterized in that The reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information satisfies the condition for triggering the interactive function includes: According to the reporting point information, it is determined that: if the point speed of each of the other reporting points is greater than 0, the distance between each of the other reporting points and the first reporting point is greater than or equal to a threshold, and the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
20. The system according to any one of claims 16 to 18, characterized in that The reporting point information includes information of each reporting point in the reporting point sequence, and determining whether the reporting point information satisfies the condition for triggering the interactive function includes: It is determined according to the reporting point information that: the point speed of some of the other reporting points is greater than 0, the distance between each of the other reporting points and the first reporting point is greater than or equal to a threshold, the angle between the line connecting each of the other reporting points and the first reporting point and the horizontal line or the vertical line is less than or equal to a threshold, and within a preset time length, there are multiple reporting points in the other reporting points with the same position, then it is determined that the reporting point information meets the conditions for triggering the interactive function, and the other reporting points are the reporting points in the reporting point sequence except the first reporting point.
21. The system according to any one of claims 13 to 20, characterized in that The system is also used to perform the following steps: During the execution of the interactive function, the cursor on the display screen of the electronic device does not move.
22. The system according to any one of claims 16 to 20, characterized in that When the condition for triggering the interactive function is not met, the system is further configured to perform the following steps: If the number of reported points in the reported point sequence is less than a threshold, supplement the reported point sequence to obtain an updated reported point sequence; A moving cursor on a display screen of the electronic device is provided according to the updated reporting sequence.
23. The system according to claim 22, characterized in that The point reporting sequence is supplemented, comprising: Determine the position of the supplementary point inserted between the two adjacent reporting points according to the distance between the two adjacent reporting points in the reporting point sequence, the time corresponding to the two adjacent reporting points, and the speed of the two adjacent reporting points; According to the position of the supplementary point inserted between the two adjacent reporting points, a supplementary point is inserted between the two adjacent reporting points.
24. The system according to claim 17, characterized in that The touch panel edge area includes one or more preset areas, and different areas correspond to different interactive functions.
25. An electronic device, characterized in that: The electronic device supports touch panel control, and the electronic device is used to execute the method according to any one of claims 1 to 12.
26. An electronic device, characterized in that: The electronic device comprises: a display screen, a processor and a memory, wherein the memory is used to store instructions, and the processor is used to read the instructions to execute the method according to any one of claims 1 to 12.
27. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 12.
28. A chip, characterized in that: include: A processor, used to call and run a computer program from a memory, so that an electronic device equipped with the chip executes the method as claimed in any one of claims 1 to 12.
29. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is run on an electronic device, the electronic device is caused to perform the method according to any one of claims 1 to 12.