One-handed mode determination method and electronic device
By combining touch data and inertial measurement unit data to identify the consistency between the holding hand and the touch hand, the accuracy problem of single-handed mode recognition for electronic devices is solved, the user interface is adapted and adjusted, and the single-handed user experience is improved.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2025-11-12
- Publication Date
- 2026-07-30
AI Technical Summary
Existing technologies struggle to accurately identify whether a user is using an electronic device with one hand, leading to improper user interface adjustments and negatively impacting the one-handed user experience.
By combining touch data and inertial measurement unit data, it can identify whether the holding hand and the touch hand are consistent, determine whether the electronic device is in one-handed mode, and then adjust the user interface to adapt to one-handed use.
It improves the accuracy of one-handed mode recognition, ensuring that the user interface is adapted for one-handed use and enhancing the user experience.
Smart Images

Figure CN2025134254_30072026_PF_FP_ABST
Abstract
Description
Single-handed pattern recognition method and electronic device
[0001] This application claims priority to Chinese patent application filed on January 21, 2025, with application number 202510102570.X and entitled "Single-handed pattern recognition method and electronic device", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of touch technology, and in particular to a single-handed pattern recognition method and electronic device. Background Technology
[0003] With the development of electronic devices, the touchscreen sizes of mobile phones and other electronic devices are increasing daily. This makes it increasingly difficult for users to operate electronic devices with one hand. Electronic devices should be able to adjust the user interface layout to facilitate one-handed use after recognizing whether a user is using the device with one hand. How to accurately identify whether a user is using an electronic device with one hand is a problem that urgently needs to be solved. Summary of the Invention
[0004] This application provides a one-handed pattern recognition method and an electronic device. The method can determine the holding hand and the touch hand of the electronic device based on touch data and inertial measurement unit data, and further determine that the electronic device is in one-handed mode when the holding hand and the touch hand are the same. This method can improve the accuracy of one-handed pattern recognition.
[0005] Firstly, this application provides a one-handed mode recognition method, applied to an electronic device including a touchscreen and an inertial measurement unit (IMU). The electronic device detects a first user operation, acquires touch data from the touchscreen, and acquires IMU data within a time period determined by the duration of the first operation. Based on the touch data and IMU data, the electronic device determines the holding hand information and the touch hand information. By confirming that the holding hand and the touch hand are consistent, the electronic device is determined to be in one-handed mode.
[0006] The grip hand and the touch hand are the same hand. For example, both the grip hand and the touch hand are left hands. Or, both the grip hand and the touch hand are right hands.
[0007] As can be seen, the method described above, which detects the holding hand and the touch hand based on touch data and inertial measurement unit data, can improve the accuracy of single-handed mode recognition, thereby making better decisions on whether to adjust the user interface to adapt to single-handed mode. This can improve the user experience of using electronic devices with one hand.
[0008] In conjunction with the first aspect, in some embodiments, if it is determined from the holding hand information and the touch hand information that both the holding hand and the touch hand are left-handed, the electronic device can determine that the electronic device is in left-handed mode. Alternatively, if it is determined from the holding hand information and the touch hand information that both the holding hand and the touch hand are right-handed, the electronic device is determined to be in right-handed mode.
[0009] In conjunction with the first aspect, in some embodiments, the first operation includes a first touch operation performed on the touch screen, the touch data includes first touch data corresponding to the first touch operation, and the inertial measurement unit data includes first inertial measurement unit data detected within a first time period, the first time period being determined based on the duration of the first touch operation.
[0010] It can be seen that electronic devices can use touch data and inertial measurement unit (IMU) data corresponding to the same touch operation to identify the usage mode of the electronic device. This not only reduces the error of identifying the usage mode using touch data or IMU data alone, but also avoids the error caused by the user switching hands during the time interval when using IMU data and touch data collected at too long intervals. The above method can improve the accuracy of single-handed mode recognition of electronic devices.
[0011] In conjunction with the first aspect, in some embodiments, the electronic device determines the gripping hand information based on first inertial measurement unit (IMU) data and a first model; the electronic device determines the touch hand information based on first touch data and a second model. Specifically, the electronic device can input the first IMU data into the first model. The electronic device can determine the gripping hand information based on the output of the first model. The electronic device can also input the second IMU data into the second model. The electronic device can determine the touch hand information based on the output of the second model. The first model can refer to the gripping hand detection model 1 shown in Figure 3A of this application. The second model can refer to the touch hand detection model shown in Figure 3A of this application.
[0012] In conjunction with the first aspect, in some embodiments, the electronic device determines the grip information and the touch hand information based on first inertial measurement unit data, first touch data, and a third model. Specifically, the electronic device can input the first inertial measurement unit data and the first touch data into the third model. The electronic device can determine the grip information and the touch hand information based on the output of the third model. The third model can refer to the usage mode detection model shown in Figure 2A of this application.
[0013] In conjunction with the first aspect, in some embodiments, the first operation includes a second touch operation and a third touch operation acting on the touchscreen, the third touch operation following the second touch operation, the touch data including the second touch data corresponding to the second touch operation and the third touch data corresponding to the third touch operation, the inertial measurement unit data including the second inertial measurement unit data detected within a second time period, the second time period being the time period after the second touch operation and before the third touch operation, the electronic device determining the first gripping hand information of the electronic device based on the second touch data; the electronic device determining gripping hand switching information based on the second inertial measurement unit data, the gripping hand switching information being used to indicate whether the electronic device generates a gripping hand switching action; the electronic device determining gripping hand information based on the first gripping hand information and the gripping hand switching information; and the electronic device determining touch hand information based on the third touch data.
[0014] Specifically, if the grip switching information instructs the electronic device to perform a grip switching action, the grip determined based on the grip information is the opposite of the grip determined based on the first grip information. For example, if the grip determined based on the first grip information is the left hand, then the grip determined based on the grip information is the right hand. If the grip determined based on the first grip information is the right hand, then the grip determined based on the grip information is the left hand. If the grip switching information instructs the electronic device not to perform a grip switching action, then the grip determined based on the grip information is the same as the grip determined based on the first grip information.
[0015] As can be seen, the above embodiments can update the gripping hand recognized by the electronic device in a timely manner after the gripping hand of the electronic device is switched, avoiding errors caused by too long a detection time interval between the gripping hand and the touch hand.
[0016] In conjunction with the first aspect, in some embodiments, before the electronic device determines the holding hand information and touch hand information of the electronic device based on touch data and inertial measurement unit data, the electronic device lights up the touch screen; or, the electronic device detects that the electronic device displays a first user interface; or, the electronic device receives a second operation for enabling single-handed mode recognition.
[0017] It can be seen that the electronic device can perform one-handed mode recognition after meeting preset conditions. These preset conditions include at least one of the following: the electronic device turns on its touchscreen, the electronic device detects that it is displaying a first user interface, and the electronic device receives a second operation to enable one-handed mode recognition. This way, the electronic device does not need to perform one-handed mode recognition for an extended period, reducing its power consumption.
[0018] In conjunction with the first aspect, in some embodiments, before the electronic device determines the holding hand information and touch hand information of the electronic device based on touch data and inertial measurement unit data, the electronic device displays a first keyboard and a first control. The first keyboard is a keyboard adapted to non-one-handed mode, and the first control is used to trigger the electronic device to display a keyboard adapted to one-handed mode. The electronic device receives an operation on the first control. After determining that the electronic device is in one-handed mode, the electronic device displays a second keyboard, which is a keyboard adapted to one-handed mode.
[0019] The first keyboard can refer to the keyboard 1411 shown in Figure 14A of this application. The first control can refer to the one-handed keyboard control 1412 shown in Figure 14A of this application. The second keyboard can refer to the left-hand keyboard 1413 shown in Figure 14C of this application or the right-hand keyboard 1415 shown in Figure 14E of this application.
[0020] As can be seen, in text input scenarios, when an electronic device detects an operation that triggers the display of a keyboard adapted to one-handed mode, such as an operation on the first control, one-handed mode detection can be performed. Upon detecting the one-handed mode of the electronic device, the corresponding keyboard, such as a left-handed keyboard or a right-handed keyboard, can be directly displayed on the touchscreen. This reduces the power consumption of the electronic device while meeting the user's need for one-handed operation.
[0021] In conjunction with the first aspect, in some embodiments, before determining that the electronic device is in one-handed mode, the electronic device displays a first keyboard; after determining that the electronic device is in one-handed mode, the electronic device displays a second control; in response to an operation on the second control, the electronic device switches the first keyboard to the second keyboard, the second keyboard being a keyboard adapted to one-handed mode.
[0022] If the electronic device is in left-handed mode, the second control is located within the comfort zone of left-handed mode, and the second keyboard is a keyboard adapted to left-handed mode; if the electronic device is in right-handed mode, the second control is located within the comfort zone of right-handed mode, and the second keyboard is a keyboard adapted to right-handed mode.
[0023] The scenario where the second control is located within the comfort zone of the left-handed mode can be referred to in Figure 12B of this application. The scenario where the second control is located within the comfort zone of the right-handed mode can be referred to in Figure 12D of this application.
[0024] As can be seen, in text input scenarios, after the electronic device detects that it is in one-handed mode, it can use a second control to ask the user whether they want to display a keyboard adapted to one-handed mode. If the user agrees, the electronic device can display a keyboard adapted to one-handed mode on the touchscreen, such as a left-handed keyboard or a right-handed keyboard. This better meets the user's needs and improves the user experience.
[0025] In conjunction with the first aspect, in some embodiments, before determining that the electronic device is in one-handed mode, the electronic device displays a second user interface; after determining that the electronic device is in one-handed mode, the electronic device displays a one-handed mode user interface, which is the user interface corresponding to the second user interface in one-handed mode.
[0026] One-handed mode includes left-handed mode or right-handed mode. If the electronic device is in left-handed mode, the electronic device displays a third user interface, which is the user interface corresponding to the second user interface in left-handed mode. If the electronic device is in right-handed mode, the electronic device displays a fourth user interface, which is the user interface corresponding to the second user interface in right-handed mode.
[0027] For example, the second user interface can refer to the user interface 710 shown in FIG. 7A of this application. The third user interface can refer to the user interface 720 shown in FIG. 7B of this application. The fourth user interface can refer to the user interface 730 shown in FIG. 7C of this application. As another example, the second user interface can refer to the user interface 810 shown in FIG. 8A of this application. The third user interface can refer to the user interface 820 shown in FIG. 8B of this application. The fourth user interface can refer to the user interface 830 shown in FIG. 8C of this application.
[0028] As can be seen, when an electronic device is in one-handed mode, the user interface can be adjusted to match the one-handed mode, such as left-handed or right-handed mode. This makes it easier for users to use the electronic device with one hand, improving the user experience.
[0029] In conjunction with the first aspect, in some embodiments, the second user interface includes a third control located at a first position on the touchscreen; the one-handed mode user interface includes a third control located at a second position on the touchscreen, the second position being located in the comfort zone corresponding to the one-handed mode.
[0030] The third control can refer to the skip control 811 shown in Figure 8A of this application. The first position can refer to the position where the skip control 811 is displayed as shown in Figure 8A of this application. The second position can refer to the position where the skip control 811 is displayed as shown in Figure 8B or Figure 8C of this application.
[0031] The one-handed mode includes either a left-handed mode or a right-handed mode. If the electronic device is in left-handed mode, the second position is located in the first comfort zone. The first comfort zone can be the comfort zone corresponding to the left-handed mode, specifically referring to comfort zone 611 shown in Figure 6A of this application. If the electronic device is in right-handed mode, the second position is located in the second comfort zone, which is different from the first comfort zone. The second comfort zone can be the comfort zone corresponding to the right-handed mode, specifically referring to comfort zone 621 shown in Figure 6B of this application.
[0032] As can be seen, in one-handed mode, electronic devices can move one or more controls in the user interface to the corresponding comfort zone. This makes it easier for users to operate the controls in the user interface and improves the user experience when using electronic devices with one hand.
[0033] In conjunction with the first aspect, in some embodiments, the second user interface includes a fourth control with a fixed display position; after the electronic device displays the one-handed mode user interface, in response to a touch operation performed on a third position of the touch screen, the electronic device displays the fourth control in a first area of the one-handed mode user interface, the first area being determined based on the third position; in response to a touch operation performed on a fourth position of the touch screen, the electronic device displays the fourth control in a second area of the one-handed mode user interface, the second area being determined based on the fourth position.
[0034] The fourth control can refer to the transfer station control shown in Figure 10B of this application. The touch operation performed on the third position of the touchscreen can refer to the long press operation on thumbnail 1011 shown in Figure 10C of this application. The fourth control displayed in the first area can refer to the transfer station control 1012 shown in Figure 10D of this application. The touch operation performed on the fourth position can refer to the long press operation on thumbnail 1013 shown in Figure 10E of this application. The fourth control displayed in the second area can refer to the transfer station control 1012 shown in Figure 10F of this application.
[0035] It can be seen that the comfort zone determined by the electronic device varies depending on the location of the touch operation on the touchscreen. This allows the controls that the user needs to operate to be moved to the corresponding comfort zone in real time during one-handed operation, improving the user experience of using electronic devices with one hand.
[0036] In conjunction with the first aspect, in some embodiments, after determining that the electronic device is in one-handed mode, the electronic device displays a one-handed mode control within the comfort zone of the one-handed mode, the one-handed mode control being used to trigger the electronic device to display a user interface adapted to the one-handed mode.
[0037] When using an electronic device with one hand, users may not want the user interface to be adjusted to suit one-handed mode. Therefore, after confirming the device is in one-handed mode, it can use the aforementioned one-handed mode control to ask the user if they want the user interface adjusted. If the user agrees, the device can display the user interface adapted to one-handed mode for convenient one-handed use. If the user does not agree, the device does not need to adjust the touchscreen display to suit one-handed mode. This better meets user needs and improves the user experience.
[0038] In conjunction with the first aspect, in some embodiments, the single-handed mode includes a left-handed mode or a right-handed mode; if the electronic device is in left-handed mode, the electronic device displays a fifth control within the comfort zone of the left-handed mode, and the fifth control is used to trigger the electronic device to display a user interface adapted to the left-handed mode; if the electronic device is in right-handed mode, the electronic device displays a sixth control within the comfort zone of the right-handed mode, and the sixth control is used to trigger the electronic device to display a user interface adapted to the right-handed mode.
[0039] As can be seen, after determining that the electronic device is in one-handed mode, it can determine the display position of the one-handed mode controls based on the one-handed mode setting. If the electronic device is in left-handed mode, it can display the one-handed mode controls (the fifth control) within the comfort zone of left-handed mode. This allows users to easily touch the one-handed mode controls in left-handed mode to instruct the electronic device to adjust the user interface to adapt to left-handed mode. If the electronic device is in right-handed mode, it can display the one-handed mode controls (the sixth control) within the comfort zone of right-handed mode. This allows users to easily touch the one-handed mode controls in right-handed mode to instruct the electronic device to adjust the user interface to adapt to right-handed mode.
[0040] Secondly, this application provides an electronic device, which includes a touch screen, an inertial measurement unit (IMU), and a processor. The touch screen is used to detect a first user operation and to detect touch data based on the first operation. The IMU is used to collect IMU data within a time period determined based on the duration of the first operation. The processor is used to determine the holding hand information and the touch hand information of the electronic device based on the touch data and the IMU data. When the holding hand information and the touch hand information determine that the holding hand and the touch hand are consistent, the electronic device is determined to be in a one-handed mode.
[0041] The grip hand and the touch hand are the same hand. For example, both the grip hand and the touch hand are left hands. Or, both the grip hand and the touch hand are right hands.
[0042] As can be seen, the method described above, which detects the holding hand and the touch hand based on touch data and inertial measurement unit data, can improve the accuracy of single-handed mode recognition, thereby making better decisions on whether to adjust the user interface to adapt to single-handed mode. This can improve the user experience of using electronic devices with one hand.
[0043] In conjunction with the second aspect, in some embodiments, the processor is further configured to determine that the electronic device is in left-handed mode when it is determined, based on the holding hand information and the touch hand information, that both the holding hand and the touch hand are left-handed, and / or to determine that the electronic device is in right-handed mode when it is determined, based on the holding hand and the touch hand information, that both the holding hand and the touch hand are right-handed.
[0044] In conjunction with the second aspect, in some embodiments, the first operation includes a first touch operation performed on the touch screen, the touch data includes first touch data corresponding to the first touch operation, and the inertial measurement unit data includes first inertial measurement unit data detected within a first time period, the first time period being determined based on the duration of the first touch operation.
[0045] It can be seen that electronic devices can use touch data and inertial measurement unit (IMU) data corresponding to the same touch operation to identify the usage mode of the electronic device. This not only reduces the error of identifying the usage mode using touch data or IMU data alone, but also avoids the error caused by the user switching hands during the time interval when using IMU data and touch data collected at too long intervals. The above method can improve the accuracy of single-handed mode recognition of electronic devices.
[0046] In conjunction with the second aspect, in some embodiments, the processor is configured to determine gripping hand information based on first inertial measurement unit data and a first model, and to determine touch hand information based on first touch data and a second model.
[0047] In conjunction with the second aspect, in some embodiments, the processor is configured to determine holding hand information and touch hand information based on first inertial measurement unit data, first touch data, and a third model.
[0048] In conjunction with the second aspect, in some embodiments, the first operation includes a second touch operation and a third touch operation acting on the touchscreen, the third touch operation following the second touch operation, the touch data including second touch data corresponding to the second touch operation and third touch data corresponding to the third touch operation, and the inertial measurement unit data including second inertial measurement unit data detected within a second time period, the second time period being the time period after the second touch operation and before the third touch operation. The processor is configured to determine first hand information of the electronic device based on the second touch data, determine hand switching information based on the second inertial measurement unit data, the hand switching information indicating whether the electronic device performs a hand switching action, determine hand information based on the first hand information and the hand switching information, and determine touch hand information based on the third touch data.
[0049] As can be seen, the above embodiments can update the gripping hand recognized by the electronic device in a timely manner after the gripping hand of the electronic device is switched, avoiding errors caused by too long a detection time interval between the gripping hand and the touch hand.
[0050] In conjunction with the second aspect, in some embodiments, the touch screen is also used to display a first keyboard and a first control, the first keyboard being a keyboard adapted to non-one-handed mode, and the first control being used to trigger the electronic device to display a keyboard adapted to one-handed mode; the touch screen is also used to receive operations on the first control and display a second keyboard, the second keyboard being a keyboard adapted to one-handed mode.
[0051] As can be seen, in text input scenarios, when an electronic device detects an operation that triggers the display of a keyboard adapted to one-handed mode, such as an operation on the first control, one-handed mode detection can be performed. Upon detecting the one-handed mode of the electronic device, the corresponding keyboard, such as a left-handed keyboard or a right-handed keyboard, can be directly displayed on the touchscreen. This reduces the power consumption of the electronic device while meeting the user's need for one-handed operation.
[0052] In conjunction with the second aspect, in some embodiments, the touch screen is also used to display a first keyboard; after determining that the electronic device is in one-handed mode, the touch screen is also used to display a second control; in response to an operation on the second control, the touch screen is also used to switch the first keyboard to a second keyboard, the second keyboard being a keyboard adapted to one-handed mode.
[0053] If the electronic device is in left-handed mode, the second control is located within the comfort zone of left-handed mode, and the second keyboard is a keyboard adapted to left-handed mode; if the electronic device is in right-handed mode, the second control is located within the comfort zone of right-handed mode, and the second keyboard is a keyboard adapted to right-handed mode.
[0054] As can be seen, in text input scenarios, after the electronic device detects that it is in one-handed mode, it can use a second control to ask the user whether they want to display a keyboard adapted to one-handed mode. If the user agrees, the electronic device can display a keyboard adapted to one-handed mode on the touchscreen, such as a left-handed keyboard or a right-handed keyboard. This better meets the user's needs and improves the user experience.
[0055] In conjunction with the second aspect, in some embodiments, the touch screen is also used to display a second user interface; after determining that the electronic device is in one-handed mode, the touch screen is also used to display a one-handed mode user interface, which is the user interface corresponding to the second user interface in one-handed mode.
[0056] One-handed mode includes left-handed mode or right-handed mode. If the electronic device is in left-handed mode, the touch screen displays a third user interface, which is the user interface corresponding to the second user interface in left-handed mode. If the electronic device is in right-handed mode, the touch screen displays a fourth user interface, which is the user interface corresponding to the second user interface in right-handed mode.
[0057] As can be seen, when an electronic device is in one-handed mode, the user interface can be adjusted to match the one-handed mode, such as left-handed or right-handed mode. This makes it easier for users to use the electronic device with one hand, improving the user experience.
[0058] In conjunction with the second aspect, in some embodiments, the second user interface includes a third control located at a first position on the touchscreen; the one-handed mode user interface includes a third control located at a second position on the touchscreen, the second position being located in the comfort zone corresponding to the one-handed mode.
[0059] The one-handed mode includes either a left-handed mode or a right-handed mode. If the electronic device is in left-handed mode, the second position is located in the first comfort zone. The first comfort zone can be the comfort zone corresponding to the left-handed mode, specifically referring to comfort zone 611 shown in Figure 6A of this application. If the electronic device is in right-handed mode, the second position is located in the second comfort zone, which is different from the first comfort zone. The second comfort zone can be the comfort zone corresponding to the right-handed mode, specifically referring to comfort zone 621 shown in Figure 6B of this application.
[0060] As can be seen, in one-handed mode, electronic devices can move one or more controls in the user interface to the corresponding comfort zone. This makes it easier for users to operate the controls in the user interface and improves the user experience when using electronic devices with one hand.
[0061] In conjunction with the second aspect, in some embodiments, the second user interface includes a fourth control with a fixed display position; after the touch screen displays the one-handed mode user interface, in response to a touch operation performed on a third position of the touch screen, the touch screen is further configured to display the fourth control in a first area of the one-handed mode user interface, the first area being determined based on the third position; in response to a touch operation performed on a fourth position of the touch screen, the touch screen is further configured to display the fourth control in a second area of the one-handed mode user interface, the second area being determined based on the fourth position.
[0062] It can be seen that the comfort zone determined by the electronic device varies depending on the location of the touch operation on the touchscreen. This allows the controls that the user needs to operate to be moved to the corresponding comfort zone in real time during one-handed operation, improving the user experience of using electronic devices with one hand.
[0063] Thirdly, this application provides a computer-readable storage medium storing instructions that, when executed by a processor, can implement any of the possible implementations described in the first aspect.
[0064] Fourthly, this application provides a computer program product that may contain computer instructions that, when executed on a processor, can implement any of the possible implementation methods described in the first aspect.
[0065] Fifthly, this application provides a chip for use in an electronic device, the chip including one or more processors for invoking computer instructions to cause the electronic device to perform any of the possible implementation methods in the first aspect.
[0066] It is understood that the computer-readable storage medium provided in the third aspect, the computer program product provided in the fourth aspect, and the chip provided in the fifth aspect are all used to execute the methods provided in the embodiments of this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description
[0067] Figures 1A to 1E are schematic diagrams of the usage modes of the electronic devices provided in the embodiments of this application;
[0068] Figure 2A is a schematic diagram of a pattern recognition method provided in an embodiment of this application;
[0069] Figure 2B is a schematic diagram of another pattern recognition method provided in an embodiment of this application;
[0070] Figure 3A is a schematic diagram of another pattern recognition method provided in an embodiment of this application;
[0071] Figure 3B is a schematic diagram of another pattern recognition method provided in an embodiment of this application;
[0072] Figure 4A is a schematic diagram of another pattern recognition method provided in an embodiment of this application;
[0073] Figure 4B is a schematic diagram of another pattern recognition method provided in an embodiment of this application;
[0074] Figure 5 is a schematic flowchart of a method for detecting a one-handed pattern provided in an embodiment of this application;
[0075] Figures 6A and 6B are schematic diagrams of some comfort zones provided in embodiments of this application;
[0076] Figures 7A to 7C are schematic diagrams of some scenarios for adjusting the user interface in one-handed mode provided by embodiments of this application;
[0077] Figures 8A to 8C are schematic diagrams of other scenarios for adjusting the user interface in one-handed mode provided by embodiments of this application;
[0078] Figures 9A and 9B are schematic diagrams of other comfort zones provided in embodiments of this application;
[0079] Figures 10A to 10F are schematic diagrams of other scenarios for adjusting the user interface in one-handed mode provided by embodiments of this application;
[0080] Figure 11 is a flowchart illustrating a method for adjusting the user interface in one-handed mode according to an embodiment of this application.
[0081] Figures 12A to 12D are schematic diagrams of some scenarios for adjusting the user interface in one-handed mode provided by embodiments of this application;
[0082] Figure 13 is a flowchart illustrating a method for adjusting the user interface in one-handed mode according to an embodiment of this application.
[0083] Figures 14A to 14E are schematic diagrams of some scenarios for adjusting the user interface in one-handed mode provided by embodiments of this application;
[0084] Figure 15 is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application;
[0085] Figure 16 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0086] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, "at least one" and "one or more" refer to one or more (including two). The term "and / or" is used to describe the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.
[0087] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.
[0088] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.
[0089] Figures 1A to 1E illustrate schematic diagrams of electronic device usage patterns.
[0090] The usage modes of electronic devices can include: single-handed mode and non-single-handed mode. Single-handed mode can include left-handed mode and right-handed mode. Non-single-handed mode can include two-handed mode and alternating-handed mode.
[0091] An electronic device being in non-single-hand mode indicates that the user is using the electronic device with both hands.
[0092] As shown in Figure 1A, the electronic device is in two-handed mode. Two-handed mode indicates that the user holds the electronic device with both hands and uses their left and / or right hands to perform touch operations on the device's touchscreen. It can be seen that in two-handed mode, the electronic device is held by both hands, i.e., the left and right hands, and the touch-operating hand is the left and / or right hand. The holding hand refers to the hand that holds the electronic device. The touch-operating hand refers to the hand that performs touch operations on the electronic device. The touch-operating hand can also be called the operating hand.
[0093] As shown in Figure 1B, the electronic device is in an alternating hand mode. This alternating hand mode indicates that the user holds the electronic device with one hand while using the other hand to perform touch operations on the device's touchscreen. It can be seen that in alternating hand mode, the touch-operated hand and the holding hand are different. For example, alternating hand mode can include situations where the holding hand is the left hand and the touch-operated hand is the right hand, or vice versa.
[0094] An electronic device being in one-handed mode indicates that the user is using the device with one hand. Left-handed mode indicates that the user is using the device only with their left hand, and right-handed mode indicates that the user is using the device only with their right hand.
[0095] As shown in Figure 1C, the electronic device is in left-handed mode. In this mode, the user holds the electronic device with their left hand and uses it to perform touch operations on the device's touchscreen. That is, both the holding hand and the touch-operating hand are left-handed.
[0096] As shown in Figure 1D, the electronic device is in right-handed mode. In this mode, the user holds the electronic device with their right hand and uses their right hand to perform touch operations on the device's touchscreen. That is, both the holding hand and the touch-operating hand are the right hand.
[0097] In some embodiments, the usage modes of the electronic device may not distinguish between the two-handed mode and the opposite-handed mode described above. For example, the usage modes of the electronic device may include left-handed mode, right-handed mode, and non-single-handed mode.
[0098] It can be seen that the area touched by the touch hand differs depending on the usage mode. For example, in left-hand mode, since the touch hand is only the left hand, controls on the left side of the touch screen are more easily reached, and the shape of the touched area on the touch screen is mostly the shape of the left thumbprint. In right-hand mode, since the touch hand is only the right hand, controls on the right side of the touch screen are more easily reached, and the shape of the touched area on the touch screen is mostly the shape of the right thumbprint.
[0099] Furthermore, the posture of the hand holding the electronic device differs under different usage modes, and the vibration state of the electronic device also varies.
[0100] As shown in Figure 1E, in left-handed mode, when a user wants to touch the upper right area of the touchscreen, the user typically needs to tilt the touchscreen towards their left hand so that their left thumb can reach the upper right area of the touchscreen. The posture of the electronic device shown in Figure 1E is clearly different from the posture of the electronic devices shown in Figures 1A-1D. Similarly, in right-handed mode, when a user wants to touch the upper left area of the touchscreen, the user typically needs to tilt the touchscreen towards their right hand so that their right thumb can reach the upper left area of the touchscreen.
[0101] When holding an electronic device and keeping it stationary, the user's hand will produce small physiological tremors due to factors such as breathing, heartbeat, and muscle contraction. Therefore, the electronic device will vibrate slightly in response to the user's hand. Furthermore, the tremors of a person's left and right hands are usually different. These tremors can include amplitude and frequency. For example, a user's right hand is their dominant hand, and their left hand is their non-dominant hand. The amplitude of the tremor when holding an electronic device with the right hand is generally smaller than that when holding it with the left hand. Therefore, the amplitude of the vibration of the electronic device in left-hand mode differs from that in right-hand mode. When a user touches the screen of an electronic device, the device will also vibrate. In two-handed mode, the vibration is mainly caused by both left and right hand touches. In one-handed mode, the vibration is mainly caused by either left or right hand touches. Therefore, the vibration state of the electronic device differs depending on the usage mode.
[0102] This application provides a one-handed mode recognition method, which can be applied to electronic devices including a touchscreen and an inertial measurement unit (IMU). The electronic device can acquire touch data on the touchscreen based on the user's first operation on the touchscreen, and acquire IMU data through the IMU. The IMU data acquired by the electronic device can be collected within a time period determined based on the duration of the first operation. The touch data can reflect information such as the type and location of the touch operation on the touchscreen. The IMU data can reflect information such as the posture and movement of the electronic device. The electronic device can determine its usage mode based on the touch data and IMU data. Specifically, the electronic device can determine the holding hand information and the touch hand information based on the touch data and IMU data. When the holding hand information and the touch hand information are consistent, the electronic device can determine that the electronic device is in one-handed mode.
[0103] In some embodiments, when it is determined that both the holding hand and the touch hand are left-handed based on the holding hand information and the touch hand information, the electronic device is determined to be in left-handed mode. When it is determined that both the holding hand and the touch hand are right-handed based on the holding hand information and the touch hand information, the electronic device is determined to be in right-handed mode.
[0104] In some embodiments, when the electronic device is determined to be in left-handed mode, it can display a user interface adapted to left-handed mode on the touchscreen. This user interface adapted to left-handed mode allows the user to easily manipulate controls on the user interface using only their left hand. When the electronic device is determined to be in right-handed mode, it can display a user interface adapted to right-handed mode on the touchscreen. This user interface adapted to right-handed mode allows the user to easily manipulate controls on the user interface using only their right hand.
[0105] The aforementioned method of detecting electronic device usage patterns based on touch and IMU data can improve the accuracy of one-handed mode recognition, thereby allowing for better decision-making on whether to adjust the user interface to be adapted for one-handed mode. This improves the user experience of using electronic devices with one hand.
[0106] The following describes some methods for recognizing one-handed modes based on touch data and IMU data provided in the embodiments of this application.
[0107] Figure 2A illustrates a schematic diagram of a pattern recognition method provided in this application.
[0108] As shown in Figure 2A, the electronic device can store a trained usage pattern detection model. The electronic device can detect usage patterns based on this model. The input to the usage pattern detection model can include IMU data and touch data. The output of the usage pattern detection model can include the usage pattern, such as a one-handed mode or a non-one-handed mode. Optionally, the output of the usage pattern detection model can be a more specific usage pattern, such as a left-handed mode, a right-handed mode, a two-handed mode, or a different-handed mode.
[0109] In some embodiments, the IMU data may include at least one of the following: acceleration data acquired by an accelerometer, angular velocity data acquired by a gyroscope, and magnetometer data acquired by a magnetometer. If the touchscreen of the electronic device is a capacitive touchscreen, the touch data may include capacitive signals on the touchscreen. If the touchscreen of the electronic device is a resistive touchscreen, the touch data may include resistive signals on the touchscreen.
[0110] Training data for training the usage pattern detection model may include: IMU data and touch data detected by the electronic device in two-handed mode, IMU data and touch data detected by the electronic device in left-handed mode, and IMU data and touch data detected by the electronic device in right-handed mode. Optionally, the aforementioned IMU data and touch data in different usage modes may include: IMU data and touch data of the electronic device in different usage modes in portrait mode, and IMU data and touch data of the electronic device in different usage modes in landscape mode. It should be noted that the aforementioned usage pattern detection model may be trained using multiple sets of training data. A set of training data may include a set of IMU data and a set of touch data detected by the electronic device in one usage mode, such as two-handed mode, left-handed mode, or right-handed mode. The training dataset includes a set of touch data that can include touch data detected on the touchscreen during the time period of a single touch operation, and a set of IMU data that can include IMU data detected by the IMU during the same time period of the touch operation, and / or IMU data detected by the IMU during a time period prior to the touch operation. In other words, the touch data and IMU data in the training dataset can correspond to the same touch operation.
[0111] In some embodiments, the usage pattern detection model described above may employ a convolutional neural network model, and its training method may be based on deep learning techniques. This application does not limit the type of usage pattern detection model or the training method described above.
[0112] Referring to the schematic diagram of a usage pattern recognition method provided in this application shown in Figure 2B, the method of determining the usage pattern of an electronic device by using a pattern detection model is described.
[0113] S211, A touch operation on the touch screen was detected.
[0114] The types of touch operation 1 may include, but are not limited to: single click, swipe, long press, double click, knuckle click, etc.
[0115] S212. Obtain touch data 1 and IMU data 1 corresponding to touch operation 1. IMU data 1 includes IMU data detected by the electronic device during time period 1 and / or time period 2. Time period 1 is the time period during which touch operation 1 is performed on the touch screen, and time period 2 is the time period before touch operation 1 is performed on the touch screen.
[0116] In some embodiments, the electronic device can acquire IMU data via an IMU and store the IMU data and the acquisition time of the IMU data. When a touch operation 1 is detected on the touch screen, the electronic device can obtain the IMU data corresponding to the touch operation 1, i.e., IMU data 1, based on the acquisition time of the IMU data.
[0117] For example, the electronic device can determine the aforementioned time period 1 and / or time period 2 based on the acquisition time of touch data 1, and obtain IMU data acquired within time period 1 and / or time period 2 based on the acquisition time of IMU data, thereby obtaining IMU data 1. For example, time period 1 can be the time period corresponding to the start and end time of touch data 1 acquisition. Time period 2 can be the time period corresponding to the preset time before touch data 2 acquisition begins and the start time of touch data 1 acquisition. The acquisition time of touch data 1 can represent the time during which touch operation 1 is applied to the touch screen.
[0118] S213. Input touch data 1 and IMU data 1 into the usage mode detection model, and determine the usage mode of the electronic device based on the usage mode detection model.
[0119] The electronic device can store a trained usage pattern detection model. The electronic device can input touch data 1 and IMU data 1 into the usage pattern detection model, and then determine the usage pattern of the electronic device based on the output of the usage pattern detection model. For example, if the output of the usage pattern detection model is left-handed mode, the electronic device can determine that it is in left-handed mode. If the output of the usage pattern detection model is right-handed mode, the electronic device can determine that it is in right-handed mode.
[0120] As can be seen, electronic devices can use touch data and IMU data corresponding to the same touch operation to identify the usage pattern of the electronic device. This not only reduces the error caused by using touch data or IMU data alone to identify the usage pattern, but also avoids the error caused by the user switching hands during the time interval when using IMU data and touch data collected at too long intervals. The above method can improve the accuracy of single-handed mode recognition of electronic devices.
[0121] In some embodiments, the electronic device can determine its usage mode by combining touch data and IMU data corresponding to multiple touch operations. For example, the electronic device can detect multiple touch operations within a time period, such as 3 seconds, 4 seconds, 5 seconds, etc. The electronic device can acquire the touch data and IMU data corresponding to these multiple touch operations. The touch data corresponding to a single touch operation may include the touch data detected on the touchscreen when the touch operation is applied. The IMU data corresponding to a single touch operation may include the IMU data detected on the touchscreen when and / or before the touch operation. Specifically, refer to the touch data 1 and IMU data 1 corresponding to the aforementioned touch operation 1. The electronic device can input the touch data and IMU data corresponding to these multiple touch operations into a usage mode detection model, and then obtain the usage mode corresponding to these multiple touch operations based on the usage mode detection model. The usage mode corresponding to a single touch operation can represent the usage mode of the electronic device when the touchscreen is applied. The electronic device can determine its usage mode based on the usage mode corresponding to these multiple touch operations. For example, if the proportion of left-handed mode is higher than proportion 1 in the usage modes corresponding to these multiple touch operations, the electronic device can determine that the electronic device is in left-handed mode. If the proportion of right-handed mode is higher than proportion 1 in the usage modes corresponding to these multiple touch operations, the electronic device can determine that the electronic device is in right-handed mode. If the proportion of two-handed mode is higher than proportion 1 in the usage modes corresponding to these multiple touch operations, the electronic device can determine that the electronic device is in two-handed mode. The embodiment of this application does not limit the value of proportion 1. For example, proportion 1 can be 85%, 90%, etc.
[0122] In some embodiments, the output of the usage pattern detection model may include grip hand information and touch hand information. Grip hand information can be used to indicate the gripping hand of the electronic device. Touch hand information can be used to indicate the touch hand of the electronic device. The electronic device can determine its usage mode based on the grip hand information and touch hand information output by the usage pattern detection model. Specifically, the electronic device can determine whether the gripping hand and touch hand are the same. If the gripping hand and touch hand are the same, the electronic device can determine that it is in a one-handed mode; otherwise, it is in a non-one-handed mode. For example, if both the gripping hand and touch hand are left-handed, the electronic device can determine that it is in a left-handed mode. If both the gripping hand and touch hand are right-handed, the electronic device can determine that it is in a right-handed mode. Otherwise, it can determine that it is in a non-one-handed mode. Optionally, in a non-one-handed mode, the electronic device can determine whether it is in a two-handed mode or a different-handed mode based on the grip hand information and touch hand information. If both the gripping hand and touch hand are two-handed and the touch hand is left-handed and / or right-handed, the electronic device can determine that it is in a two-handed mode. If the electronic device is held by the left hand and the touch hand is the right hand, or if the electronic device is held by the right hand and the touch hand is the left hand, then the electronic device can determine that it is in an opposite-hand mode.
[0123] In some embodiments, not limited to the usage pattern detection model described above, based on the IMU data and touch data collected during the same time period, the electronic device can use other methods to identify its usage pattern. For example, the electronic device can store a pre-trained usage pattern classification and recognition model. The electronic device can extract features from the IMU data and touch data corresponding to the same touch operation, such as IMU data 1 and touch data 1, and fuse the extracted features of the IMU data with the features of the touch data. The electronic device can input the combined features obtained after feature fusion into the usage pattern classification and recognition model, and then determine the usage pattern of the electronic device based on the output of the usage pattern classification and recognition model. The output of the usage pattern classification and recognition model may include the usage pattern of the electronic device. Alternatively, the output of the usage pattern classification and recognition model may include the holding hand information and touch hand information of the electronic device. The usage pattern classification and recognition model described above can be trained based on machine learning. This application embodiment does not limit the type and training method of the usage pattern classification and recognition model.
[0124] Figure 3A illustrates a schematic diagram of another single-handed pattern recognition method provided in this application.
[0125] As shown in Figure 3A, the electronic device can store a trained hand-holding detection model 1 and a touch-sensitive hand detection model.
[0126] An electronic device can use a hand-holding detection model 1 to detect the hand holding the electronic device. The input to the hand-holding detection model 1 may include IMU data. The output of the hand-holding detection model 1 may include hand-holding detection results. The IMU data can be referred to the description in the foregoing embodiments. The hand-holding detection results can be used to indicate the hand holding the electronic device. For example, the hand holding the electronic device may be the left hand and / or the right hand.
[0127] Electronic devices can use a touch hand detection model to detect the touch hand. The input to the touch hand detection model may include touch data. The output of the touch hand detection model may include touch hand detection results. The touch data can be referred to the description in the foregoing embodiments. The touch hand detection results can be used to indicate the touch hand of the electronic device. For example, the touch hand of the electronic device can be the left hand and / or the right hand.
[0128] The training data used to train the hand-holding detection model 1 may include: IMU data detected by the electronic device when both hands are holding the electronic device, IMU data detected by the electronic device when only the left hand is holding the electronic device, and IMU data detected by the electronic device when only the right hand is holding the electronic device.
[0129] Training data used to train the touch hand detection model may include: touch data detected by the electronic device when both hands are used to perform touch operations on the touch screen, touch data detected by the electronic device when only the left hand is used to perform touch operations on the touch screen, and touch data detected by the electronic device when only the right hand is used to perform touch operations on the touch screen.
[0130] This application does not limit the type or training method of the above-mentioned hand-holding detection model 1 and touch-sensitive hand detection model.
[0131] The electronic device can detect whether the gripping hand and the touch hand are consistent based on the aforementioned grip and touch hand detection results. If the gripping hand and the touch hand are consistent, the electronic device can determine that it is in one-handed mode. If the gripping hand and the touch hand are inconsistent, the electronic device can determine that it is in non-one-handed mode.
[0132] The "holding hand and touch hand being the same" condition can include either both being left-handed or both being right-handed. If both the holding hand detection result and the touch hand detection result indicate that the holding hand is left-handed, the electronic device can determine that it is in left-handed mode. If both the holding hand detection result and the touch hand detection result indicate that the holding hand is right-handed, the electronic device can determine that it is in right-handed mode. "Holding hand and touch hand being the same" can also mean that the holding hand and touch hand are the same hand. Therefore, having both the holding hand and touch hand as two hands does not constitute a case of "holding hand and touch hand being the same".
[0133] Inconsistent grip and touch hand can include: the grip hand being one hand and the touch hand being another hand; both the grip hand and the touch hand being two hands; or both the grip hand and the touch hand being two hands and the touch hand being one hand. If the electronic device's grip hand is two hands and the touch hand is the left and / or right hand, the electronic device can determine that it is in two-handed mode. If the electronic device's grip hand is the left hand and the touch hand is the right hand, or if the electronic device's grip hand is the right hand and the touch hand is the left hand, the electronic device can determine that it is in opposite-handed mode. The grip hand and touch hand being the same can also mean that the grip hand and the touch hand are not the same hand.
[0134] Referring to the schematic diagram of a usage pattern recognition method provided in this application shown in Figure 3B, the method for determining the usage pattern of electronic devices through a holding hand detection model 1 and a touch hand detection model is described.
[0135] S311, A touch operation 2 was detected on the touch screen.
[0136] For touch operation 2, please refer to the description of touch operation 1 shown in Figure 2B above.
[0137] S312. Obtain touch data 2 and IMU data 2 corresponding to touch operation 2. IMU data 2 includes IMU data detected by the electronic device during time period 3 and / or time period 4. Time period 3 is the time period during which touch operation 2 is performed on the touch screen, and time period 4 is the time period before touch operation 2 is performed on the touch screen.
[0138] Step S312 can be referred to the description of step S212 shown in Figure 2B above.
[0139] S313. Determine the holding hand of the electronic device based on IMU data 2, and determine the touch hand of the electronic device based on touch data 2.
[0140] In some embodiments, the electronic device can input IMU data 2 into the hand-holding detection model 1 to obtain the hand-holding detection result output by the hand-holding detection model 1, thereby determining the hand holding the electronic device. The electronic device can also input touch data 2 into the touch hand detection model to obtain the touch hand detection result output by the touch hand detection model, thereby determining the touch hand of the electronic device.
[0141] S314. Determine the usage mode of the electronic device based on the hand holding the device and the hand touching it.
[0142] In some embodiments, the electronic device can determine its usage mode by detecting whether the holding hand and the touch hand are the same. If the holding hand and the touch hand are the same, the electronic device can determine that it is in one-handed mode. If the holding hand and the touch hand are not the same, the electronic device can determine that it is in non-one-handed mode. In some embodiments, if both the holding hand and the touch hand are left-handed, the electronic device is in left-handed mode. If both the holding hand and the touch hand are right-handed, the electronic device is in right-handed mode.
[0143] As can be seen, electronic devices can use touch data and IMU data corresponding to the same touch operation to identify the usage pattern of the electronic device. This not only reduces the error caused by using touch data or IMU data alone to identify the usage pattern, but also avoids the error caused by the user switching hands during the time interval when using IMU data and touch data collected at too long intervals. The above method can improve the accuracy of single-handed mode recognition of electronic devices.
[0144] Figure 4A illustrates an exemplary schematic diagram of another single-handed pattern recognition method provided in this application.
[0145] As shown in Figure 4A, the electronic device can store a trained hand-holding detection model 2 and a touch-sensitive hand detection model. The touch-sensitive hand detection model can be referred to the description in Figure 3A above.
[0146] Electronic devices can use a hand-holding detection model 2 to detect the hand holding the electronic device. The input to the hand-holding detection model 2 may include touch data and / or IMU data. The output of the hand-holding detection model 2 may include the hand-holding detection result. The touch data and IMU data can be referred to the description in the foregoing embodiments. The hand-holding detection result can be used to indicate the hand holding the electronic device. For example, the hand holding the electronic device may be the left hand and / or the right hand.
[0147] If the input to the hand-holding detection model 2 includes touch data and IMU data, then the data input to the hand-holding detection model 2 can be the touch data and IMU data corresponding to the same touch operation.
[0148] The training data used to train the hand-holding detection model 2 may include at least one of the following: IMU data detected by the electronic device when both hands are holding the electronic device, IMU data detected by the electronic device when only the left hand is holding the electronic device, IMU data detected by the electronic device when only the right hand is holding the electronic device, touch data detected by the electronic device when both hands are holding the electronic device, touch data detected by the electronic device when only the left hand is holding the electronic device, and touch data detected by the electronic device when only the right hand is holding the electronic device. This application embodiment does not limit the type or training method of the aforementioned hand-holding detection model 2.
[0149] Furthermore, the electronic device can perform hand-hand switching detection based on the hand-hand detection result output by hand-hand detection model 2 and the IMU data collected after obtaining the hand-hand detection result, to obtain a hand-hand switching detection result. The hand-hand switching detection result can be used to indicate the current hand holding the electronic device. Hand-hand switching detection may include: detecting whether the electronic device has generated a hand-hand switching action based on the IMU data collected after obtaining the hand-hand detection result, and then determining the current hand holding the electronic device based on whether the electronic device has generated a hand-hand switching action and the hand-hand detection result.
[0150] Among them, the electronic device can detect whether the electronic device has generated a hand-holding switching action based on IMU data.
[0151] If an electronic device initiates a hand-switching action, it can determine the hand holding the device after the switch by combining the hand-switching detection result output by hand-switching detection model 2. For example, if the hand-switching detection result output by hand-switching detection model 2 indicates a left hand, then the hand holding the electronic device after the switch is the right hand. If the hand-switching detection result output by hand-switching detection model 2 indicates a right hand, then the hand holding the electronic device after the switch is the left hand.
[0152] If the electronic device does not perform a hand-switching action, the hand holding the electronic device remains unchanged, and the hand-switching detection result output by hand-switching detection model 2 is still the same. That is, the hand-switching detection result is the same as the hand-switching detection result output by hand-switching detection model 2.
[0153] Electronic devices can detect whether the gripping hand and the touch hand are consistent based on the hand-holding detection results and the touch hand detection results.
[0154] If the grip hand changes, the electronic device can identify the new grip hand as its current grip hand. When a touch operation is detected on the touchscreen again, the electronic device can acquire the touch data corresponding to the touch operation and input the touch data into the touch hand detection model to obtain the touch hand detection result output by the touch hand detection model. The electronic device can determine whether the grip hand and the touch hand are consistent based on the above-mentioned new grip hand and touch hand detection result. If the touch hand and the new grip hand are consistent, the electronic device can determine that the electronic device is in one-handed mode; otherwise, the electronic device is in non-one-handed mode. Specifically, if the new grip hand is the left hand and the touch hand detection result indicates that the touch hand is the left hand, the electronic device can determine that the electronic device is in left-handed mode. If the new grip hand is the right hand and the touch hand detection result indicates that the touch hand is the right hand, the electronic device can determine that the electronic device is in right-handed mode.
[0155] If the grip hand remains unchanged, the electronic device can identify the unchanged grip hand as its own. When another touch operation is detected on the touchscreen, the electronic device can acquire the touch data corresponding to that operation and input it into the touch hand detection model to obtain the touch hand detection result output by the model. The electronic device can then determine whether the grip hand and touch hand are consistent based on the unchanged grip hand and the touch hand detection result, thereby determining the usage mode of the electronic device.
[0156] Figure 4B illustrates a schematic diagram of a pattern recognition method provided in an embodiment of this application.
[0157] S411. Acquire touch data 3 and / or IMU data 3, where touch data 3 is the touch data corresponding to touch operation 3.
[0158] S412. Determine the hand holding the electronic device based on the touch data 3 and / or IMU data 3.
[0159] In some embodiments, IMU data 3 may be IMU data corresponding to touch operation 3. When a touch operation 3 is detected on the touch screen, the electronic device can acquire the touch data and IMU data corresponding to the touch operation 3, thus obtaining the aforementioned touch data 3 and IMU data 3. The touch data and IMU data corresponding to a single touch operation can be referred to the description in the foregoing embodiments. The electronic device can input the touch data 3 and IMU data 3 into the hand-holding detection model 2 shown in FIG4A to obtain the hand-holding detection result output by the hand-holding detection model 2, thereby determining the hand holding the electronic device.
[0160] In some embodiments, the electronic device can input touch data 3 into the hand-holding detection model 2 shown in FIG4A to obtain the hand-holding detection result output by the hand-holding detection model 2, thereby determining the hand holding the electronic device.
[0161] In some embodiments, the electronic device can acquire IMU data 3. IMU data 3 can be IMU data collected within any time period. The electronic device can input IMU data 3 into the hand-holding detection model 2 shown in Figure 4A to obtain the hand-holding detection result output by the hand-holding detection model 2, thereby determining the hand holding the electronic device.
[0162] S413. Acquire IMU data 4, which is detected after touch data 3 and / or touch data 3.
[0163] S414. Based on the grip hand determined in step S412 and IMU data 4, perform grip hand switching detection to determine the current grip hand of the electronic device.
[0164] In some embodiments, the electronic device can detect whether it has performed a hand-switching action based on IMU data 4. The electronic device may store a trained hand-switching detection model. The electronic device can input IMU data 4 into the hand-switching detection model and determine whether it has performed a hand-switching action based on the model's output. This application does not limit the type and training method of the hand-switching detection model described above. The electronic device may also use other methods to detect whether it has performed a hand-switching action, not just the hand-switching detection model.
[0165] If the electronic device initiates a hand-holding switch, it can determine the new hand-holding device based on the hand-holding information determined in step S412. For example, if in step S412 the electronic device determines the hand-holding device is left-handed based on touch data 3 and / or IMU data 3, then the new hand-holding device will be right-handed. Conversely, if in step S412 the electronic device determines the hand-holding device is right-handed based on touch data 3 and / or IMU data 3, then the new hand-holding device will be left-handed.
[0166] If the electronic device does not perform a hand-switching action, the electronic device can determine that the current hand-switching hand is still the hand-switching hand determined in step S412 above.
[0167] S415, A touch operation on the touch screen has been detected.
[0168] Touch operation 4 can be a touch operation performed on the touch screen after the electronic device acquires IMU data 4.
[0169] S416. Obtain the touch data 4 corresponding to touch operation 4.
[0170] S417. Determine the touch hand of the electronic device based on touch data 4.
[0171] Step S417 can refer to step S313 shown in Figure 3B above.
[0172] S418. Determine the usage mode of the electronic device based on the holding hand determined in step S414 and the touch hand determined in step S417.
[0173] If the holding hand determined in step S414 and the touch hand determined in step S417 are both left hands, the electronic device can determine that it is in left-handed mode. If the holding hand determined in step S414 and the touch hand determined in step S417 are both right hands, the electronic device can determine that it is in right-handed mode. If the holding hand determined in step S414 and the touch hand determined in step S417 are different, or if the holding hand and / or the touch hand are both hands, the electronic device can determine that it is in non-single-handed mode.
[0174] In some embodiments, before detecting touch operation 4, the electronic device can acquire IMU data collected at different times multiple times and perform steps S413 and S414 as described above. Specifically, the electronic device can detect whether it has performed a hand-switching action based on the most recently acquired IMU data, and then determine the current hand-switching hand by combining this with the previously identified hand-switching hand. If the electronic device performs a hand-switching action, it can determine that the current hand-switching hand is the opposite of the previously identified hand-switching hand. If the electronic device does not perform a hand-switching action, it determines that the current hand-switching hand is the same as the previously identified hand-switching hand. This allows the electronic device to update the identified hand-switching hand promptly after a hand-switching action, avoiding errors caused by excessively long detection intervals between the hand-switching hand and the touch-sensitive hand.
[0175] For example, the methods shown in Figures 4A and 4B above can accurately identify whether an electronic device is in one-handed mode in the following scenarios: a user takes the electronic device out of their pocket with their left hand and switches it to their right hand, using the electronic device with their right hand. During the process of taking the electronic device out of the pocket, the device's posture changes, and the user's fingers may touch the device's touchscreen. The electronic device can use touch data and / or IMU data to identify the holding hand, referring to steps S411 and S412 in Figure 4B. During the process of switching the electronic device from the user's left hand to their right hand, the device's posture changes, resulting in a hand-switching action. The electronic device can use IMU data to detect the hand-switching, referring to steps S413 and S414 in Figure 4B. During the user's one-handed use of the electronic device with their right hand, the user's right-hand fingers may touch the device's touchscreen. The electronic device can detect the corresponding touch operation and then use the touch data corresponding to the touch operation to identify the touching hand, referring to steps S415 to S418 in Figure 4B.
[0176] In some embodiments, the touch operation 3 described above can be a touch operation detected before the electronic device's screen is turned on. The touch operation 4 described above can be a touch operation detected after the electronic device's screen is turned on. Both IMU data 3 and IMU data 4 described above can be IMU data collected by the electronic device before the touch operation 4 is performed on the touch screen. In this way, the electronic device can complete the recognition of the holding hand before the screen is turned on and the user performs a touch operation, and only needs to recognize the touching hand after the screen is turned on, improving the speed of single-handed mode detection, thereby providing users with services corresponding to single-handed mode more quickly, such as adjusting the user interface displayed on the touch screen to a user interface adapted to left-handed or right-handed mode.
[0177] Figure 5 illustrates a schematic flowchart of a method for detecting one-handed patterns provided in this application.
[0178] S511. Determine whether to perform one-handed mode detection.
[0179] In some embodiments, the electronic device may perform one-handed mode detection when a first condition is met. The first condition may include at least one of the following: the electronic device's screen is turned on, the electronic device displays a preset user interface, the electronic device receives a user operation for performing one-handed mode detection, etc. The first condition is merely an illustrative example of this application and should not be construed as limiting this application.
[0180] The electronic device can detect whether the current conditions are met. If the conditions are met, the electronic device can execute step S512 to perform one-handed mode detection. If the conditions are not met, the electronic device can execute step S511 again. For example, when it is detected that the above conditions are not met, the electronic device can wait for a period of time and then determine whether to perform one-handed mode detection again.
[0181] S512: Obtain touch data and IMU data based on the touch operation performed on the touch screen.
[0182] S513: Identify one-handed mode based on touch data and IMU data.
[0183] The method for acquiring touch data and IMU data, and for identifying one-handed mode based on the touch data and IMU data, can be found in the description of the foregoing embodiments.
[0184] If it is determined that the electronic device is in left-handed or right-handed mode, the electronic device may execute step S514. If it is determined that the electronic device is not in one-handed mode, the electronic device may wait for a period of time and then execute steps S511 to S513 again, without executing steps S514 to S516.
[0185] S514. Determine the comfort zone based on one-handed mode.
[0186] When an electronic device detects that it is in one-handed mode, it can determine a comfort zone based on this mode. The comfort zone represents the area on the touchscreen that a user can easily reach with one hand when using the electronic device.
[0187] In some embodiments, the electronic device may store a comfort zone corresponding to a left-hand mode and a comfort zone corresponding to a right-hand mode. The comfort zone corresponding to the left-hand mode may be fixed. The comfort zones corresponding to the right-hand mode may also be fixed. The comfort zones corresponding to the left-hand mode and the right-hand mode may be determined based on human factors research results, thumb statistics, or other data. This application does not limit the scope of the aforementioned comfort zones corresponding to the left-hand mode and the right-hand mode.
[0188] In some embodiments, in one-handed mode, the electronic device can determine a comfort zone based on the location of a reporting point on the touchscreen. A reporting point can include a point on the touchscreen that causes a signal change due to a touch operation. A reporting point location can be determined based on the location of a single touch operation performed on the touchscreen. The comfort zone corresponding to a reporting point location can change as the reporting point location changes. For example, the comfort zone corresponding to a reporting point location can be an area on the touchscreen composed of points whose distance from the reporting point location is less than a distance threshold of 1. This application embodiment does not limit the size of the comfort zone corresponding to a reporting point location.
[0189] In left-hand or right-hand mode, the electronic device can also use other methods to determine the comfort zone. This application does not limit this approach.
[0190] S515, Adjust the user interface displayed on the touchscreen according to the comfort zone.
[0191] If the electronic device is in left-handed mode, it can adjust the user interface displayed on the touchscreen to be compatible with left-handed mode. If the electronic device is in right-handed mode, it can adjust the user interface displayed on the touchscreen to be compatible with right-handed mode.
[0192] In some embodiments, the comfort zones corresponding to left-handed mode and right-handed mode are fixed. In left-handed mode, the electronic device can shrink the entire user interface so that the shrunken user interface is fully or partially displayed within the comfort zone corresponding to left-handed mode. In right-handed mode, the electronic device can shrink the entire user interface so that the shrunken user interface is fully or partially displayed within the comfort zone corresponding to right-handed mode.
[0193] In some embodiments, the comfort zones corresponding to left-handed mode and right-handed mode are fixed. In left-handed mode, the electronic device can adjust the layout of controls in the user interface, moving one or more controls to the comfort zone corresponding to left-handed mode. In right-handed mode, the electronic device can adjust the layout of controls in the user interface, moving one or more controls to the comfort zone corresponding to right-handed mode.
[0194] In some embodiments, the comfort zone is associated with the reporting point location. In one-handed mode, when a touch operation is detected on the touchscreen, the electronic device can determine the reporting point location based on the touch operation, and then move one or more controls in the user interface to the comfort zone corresponding to the reporting point location.
[0195] In some embodiments, the electronic device can detect its usage mode and provide an interface to the application for obtaining the current usage mode. Application developers can design a user interface adapted for one-handed mode as needed. For example, compared to the user interface displayed in non-one-handed mode, in the user interface adapted for one-handed mode, one or more user-operable controls are moved to the comfort zone corresponding to one-handed mode. When the application runs on the electronic device, it can obtain the current usage mode of the electronic device through the interface provided by the system, and then display a user interface adapted to one-handed mode, such as left-handed or right-handed mode, when the electronic device is in one-handed mode.
[0196] The above method is merely an illustrative example of adjusting the user interface in one-handed mode and should not be construed as limiting this application.
[0197] S516. Determine whether to end the one-handed mode detection.
[0198] In some embodiments, after determining that the electronic device is in left-handed or right-handed mode, the electronic device may periodically or irregularly determine whether to end the one-handed mode detection. If the electronic device meets a second condition, it may end the one-handed mode detection. The second condition may include at least one of the following: the electronic device screen is off, the electronic device does not display a preset user interface, the electronic device receives a user operation to end the one-handed mode detection, etc. The above second condition is merely an illustrative example of this application and should not be construed as limiting this application.
[0199] After the one-handed mode detection is completed, the electronic device can cancel the adjustment of the user interface in step S515 above and restore the user interface to the display state in non-one-handed mode.
[0200] If the electronic device does not meet the second condition mentioned above, the electronic device may execute step S512 to perform the one-handed mode detection again.
[0201] If the electronic device detects that the one-handed mode of the electronic device has not changed when it performs one-handed mode detection again, the electronic device can continue to display the user interface adjusted in step S515.
[0202] If the electronic device detects that it is still in one-handed mode when it performs another one-handed mode detection, but the one-handed mode has changed, the electronic device can readjust the user interface according to step S515 above. For example, if the electronic device changes from left-handed mode to right-handed mode, it can adjust the user interface displayed on the touchscreen to be compatible with right-handed mode. If the electronic device changes from right-handed mode to left-handed mode, it can adjust the user interface displayed on the touchscreen to be compatible with left-handed mode.
[0203] If the electronic device detects that it is no longer in one-handed mode when it performs one-handed mode detection again, that is, the electronic device is in non-one-handed mode, the electronic device can cancel the adjustment of the user interface in step S515 above and restore the user interface to the display state in non-one-handed mode.
[0204] Understandably, users often switch hands when using electronic devices. For example, a user might switch from using an electronic device with their left hand to their right hand, or from using one hand to using both hands. By re-detecting the single-handed mode, the electronic device can determine if the usage pattern has changed, and then adjust the user interface accordingly to provide a better user experience.
[0205] It should be noted that steps S511 and S516 above are optional. The electronic device can continuously perform one-handed mode detection without needing to determine whether to start / stop one-handed mode detection.
[0206] As demonstrated by the methods described above, electronic devices can identify whether they are in one-handed mode, and specifically whether they are in left-handed or right-handed mode, based on IMU data and touch data. This improves the accuracy of one-handed mode recognition. When the electronic device is in one-handed mode, it can also adjust the user interface to display a user interface adapted to the one-handed mode, such as left-handed or right-handed mode. This facilitates one-handed use of the electronic device and improves the user experience.
[0207] Figures 6A and 6B provide illustrative diagrams of some comfort zones.
[0208] As shown in Figure 6A, in left-handed mode, the touchscreen of the electronic device can include a comfort zone 611 and a non-comfort zone 612. The comfort zone 611 can be located in the lower left area of the touchscreen. The non-comfort zone 612 can be any area other than the comfort zone 611. The non-comfort zone 611 can be any area that is inconvenient for the user to touch when using the electronic device with their left hand. The position and size of the comfort zone 611 can remain fixed.
[0209] As shown in Figure 6B, in right-handed mode, the touchscreen of the electronic device may include a comfort zone 621 and a non-comfort zone 622. The comfort zone 621 may be located in the lower right area of the touchscreen. The non-comfort zone 622 may be any area other than the comfort zone 621. The non-comfort zone 621 may be any area that is inconvenient for the user to touch when using the electronic device with their right hand. The position and size of the comfort zone 621 may be fixed.
[0210] In some embodiments, the electronic device may determine the comfort zone 611 corresponding to the left-hand mode and the comfort zone 621 corresponding to the right-hand mode based on human factors research results, thumb statistics, and other data.
[0211] The comfort zones shown in Figures 6A and 6B are merely illustrative examples of this application and should not be construed as limiting the scope of this application.
[0212] Figures 7A to 7C illustrate some scenarios of adjusting the user interface in one-handed mode.
[0213] As shown in Figure 7A, when the electronic device 100 is in non-one-handed mode, the electronic device 100 can display the user interface 710 in full screen.
[0214] The electronic device 100 can detect whether it is in one-handed mode. The method for detecting one-handed mode can be found in the description of the foregoing embodiments.
[0215] As shown in Figure 7B, when the electronic device 100 is detected to be in left-handed mode, the electronic device 100 can shrink the currently displayed user interface and display the shrunken user interface in the lower left area of the touch screen. For example, the electronic device 100 can shrink the user interface 710 shown in Figure 7A to obtain user interface 720. User interface 720 is the user interface corresponding to user interface 710 in left-handed mode. The electronic device 100 can display user interface 720 as shown in Figure 7B in the lower left area of the touch screen. This allows as many controls in user interface 710 as possible to be displayed in the comfort zone corresponding to left-handed mode, such as comfort zone 611 shown in Figure 6A, thereby facilitating the user to use their left hand to touch the controls in user interface 710.
[0216] As shown in Figure 7C, when the electronic device 100 is detected to be in right-hand mode, the electronic device 100 can shrink the currently displayed user interface and display the shrunken user interface in the lower right area of the touch screen. For example, the electronic device 100 can shrink the user interface 710 shown in Figure 7A to obtain user interface 730. User interface 730 is the user interface corresponding to user interface 730 in right-hand mode. The electronic device 100 can display user interface 730 as shown in Figure 7C in the lower right area of the touch screen. This allows as many controls in user interface 710 as possible to be displayed in the comfort area corresponding to right-hand mode, such as comfort area 621 shown in Figure 6B, thereby facilitating the user to use their right hand to touch the controls in user interface 710.
[0217] Figures 8A to 8C illustrate other scenarios of adjusting the user interface in one-handed mode.
[0218] As shown in Figure 8A, when the electronic device 100 is in non-single-handed mode, the electronic device 100 can display a user interface 810. The user interface 810 may include a skip control 811. The skip control 811 can be used to skip the application splash screen advertisement shown in the user interface 810. The skip control 811 may be located in the upper right area of the touchscreen shown in Figure 8A. In left-handed or right-handed mode, it is difficult for the user to reach the skip control 811 located in the upper right area of the touchscreen with one hand.
[0219] As shown in Figure 8B, when the electronic device 100 is detected to be in left-handed mode, the electronic device 100 can move one or more controls on the currently displayed user interface to the comfort zone corresponding to the left-handed mode. For example, the electronic device 100 can display the user interface 820 shown in Figure 8B in left-handed mode. User interface 820 is the same as the user interface 810 in left-handed mode. Comparing user interface 810 and user interface 820, it can be seen that the position of the skip control 811 changes. Specifically, in left-handed mode, the electronic device 100 moves the skip control 811 to the comfort zone corresponding to the left-handed mode to facilitate touch operation of the skip control 811 when the user uses the electronic device 100 with one hand.
[0220] As shown in Figure 8C, when the electronic device 100 is detected to be in right-handed mode, the electronic device 100 can move one or more controls on the currently displayed user interface to the comfort zone corresponding to the right-handed mode. For example, the electronic device 100 can display the user interface 830 shown in Figure 8C in right-handed mode. User interface 830 is the user interface corresponding to user interface 810 in right-handed mode. Comparing user interface 810 and user interface 830, it can be seen that the position of the skip control 811 changes. Specifically, in right-handed mode, the electronic device 100 moves the skip control 811 to the comfort zone corresponding to the right-handed mode to facilitate touch operation of the skip control 811 when the user uses the electronic device 100 with one hand.
[0221] Figures 9A and 9B exemplarily illustrate schematic diagrams of other comfort zones.
[0222] When an electronic device is in left-hand or right-hand mode, it can determine the location of the reporting point based on the touch operation on the touch screen, and then determine the comfort zone based on the reporting point location.
[0223] As shown in Figure 9A, in either left-hand or right-hand mode, when the location of reporting point 1 is determined based on a touch operation, the electronic device can determine the comfort zone 1 corresponding to the location of reporting point 1. Comfort zone 1 can be an area on the touchscreen composed of points whose distance from the location of reporting point 1 is less than a distance threshold 1.
[0224] As shown in Figure 9B, in either left-hand or right-hand mode, when the location of reporting point 2 is determined based on the touch operation, the electronic device can determine the comfort zone 2 corresponding to the location of reporting point 2. The comfort zone 2 can be an area on the touchscreen composed of points whose distance from the location of reporting point 2 is less than a distance threshold 1.
[0225] It can be seen that when the location of the reporting point changes, the comfort zone determined by the electronic device on the touch screen also changes accordingly.
[0226] Understandably, a user's posture when holding an electronic device with one hand may change. The comfortable area for one-handed operation on a touchscreen may also change depending on how the device is held. Specifically, the position of the hand holding the device may change. For example, the user's fingers may be closer to the bottom of the device, making it easier to reach the bottom area. Alternatively, the fingers may be closer to the top, making it easier to reach the top area. Furthermore, the user may also change the tilt of the touchscreen when holding the device with one hand. The area easily reached by the user's hand varies depending on the tilt. For example, in left-handed mode, if the user holds the device with their left hand as shown in Figure 1C, their left thumb is more likely to reach the lower left area of the touchscreen, meaning the comfortable area is located in the lower left corner. In left-handed mode, if a user holds the electronic device with their left hand in the posture shown in Figure 1E, the user's left thumb is more likely to touch the upper right area of the touchscreen, meaning the comfort zone is located in the upper right area of the touchscreen.
[0227] The comfort zone is defined by the location where the user interacts with the touchscreen; these are typically areas the user frequently touches. Therefore, electronic devices can determine a comfort zone based on the reported location, allowing them to move the controls the user needs to operate to the corresponding comfort zone in real-time during one-handed operation, thus improving the user experience when using electronic devices with one hand.
[0228] Figures 10A to 10F illustrate other scenarios of adjusting the user interface in one-handed mode.
[0229] As shown in Figure 10A, in non-one-handed mode, the electronic device 100 can display a user interface 1010. The user interface 1010 can be the user interface of a gallery application. The user interface 1010 can include thumbnails of one or more images, for example, thumbnail 1011. In response to a long-press operation on thumbnail 1011, the electronic device 100 can display a transfer station control 1012 as shown in Figure 10B. The transfer station control 1012 can be used to temporarily store one or more images in the transfer station. The transfer station can represent a storage space in the electronic device 100. Images in the transfer station can be dragged out to applications such as a notes application or an email application for editing. For example, in response to dragging thumbnail 1011 to the location of transfer station control 1012, the electronic device 100 can store the image corresponding to thumbnail 1011 in the transfer station. The transfer station can also store image identifiers. This application embodiment does not limit the implementation method of the transfer station.
[0230] As shown in Figure 10B, in non-one-handed mode, the transfer station control 1012 is fixedly displayed in the upper right area of the touchscreen. When a user wants to place an image in the transfer station, the user needs to perform a swipe operation starting from the location of the image thumbnail and ending at the location of the transfer station control 1012 in the upper right area of the touchscreen. If the user uses the electronic device 100 with one hand, the location of the transfer station control 1012 shown in Figure 10B is in an uncomfortable zone, making it difficult for the user to perform the aforementioned operation of dragging the thumbnail to the location of the transfer station control 1012.
[0231] In some embodiments, in one-handed mode, the electronic device 100 can determine the reporting location based on the long-press operation on the thumbnail, and then determine the comfort zone corresponding to the reporting location. The electronic device 100 can move the transfer station control 1012 to the comfort zone corresponding to the reporting location to facilitate the user's operation of placing the target image at the transfer station.
[0232] As shown in Figure 10C, the electronic device 100 can detect that it is in left-handed mode. In left-handed mode, in response to a long press operation on thumbnail 1011, the electronic device 100 can display the transfer station control 1012 shown in Figure 10D.
[0233] As shown in Figure 10D, the transfer station control 1012 is located within the comfort zone corresponding to the reporting position determined by the long-press operation shown in Figure 10C. It can be seen that the transfer station control 1012 shown in Figure 10D is close to the user's thumb. This allows the user to easily drag the thumbnail 1011 to the location of the transfer station control 1012 in left-handed mode.
[0234] As shown in Figure 10E, the user interface 1010 may also include a thumbnail 1013. In left-handed mode, in response to a long press operation on the thumbnail 1013, the electronic device 100 may display the transfer station control 1012 shown in Figure 10F.
[0235] As shown in Figure 10F, the transfer station control 1012 is located within the comfort zone corresponding to the reporting position determined by the long-press operation shown in Figure 10E. It can be seen that the transfer station control 1012 shown in Figure 10F is close to the user's thumb. This allows the user to easily drag the thumbnail 1013 to the location of the transfer station control 1012 in left-handed mode.
[0236] As shown in Figures 10C to 10F, the comfort zone determined by the electronic device 100 varies depending on the position of the touch operation applied to the touchscreen. Therefore, the position of the transfer station control 1012 displayed by the electronic device 100 in response to a long press operation on thumbnail 1011 as shown in Figure 10C is different from the position displayed in response to a long press operation on thumbnail 1013 as shown in Figure 10E. This allows the controls that the user needs to operate to be moved to the comfort zone corresponding to the reporting position in real time during one-handed mode, improving the user's experience of using the electronic device with one hand.
[0237] Figure 11 illustrates a flowchart of a method for adjusting the user interface in one-handed mode according to an embodiment of this application.
[0238] S1111, Display User Interface 1.
[0239] User interface 1 can be any user interface in the electronic device, or a preset user interface. When user interface 1 is displayed, the electronic device can perform one-handed mode detection.
[0240] S1112, Detect whether there is a touch operation on the user interface 1.
[0241] If a touch operation is detected, the electronic device can acquire touch data and IMU data, and perform the following steps S1113 based on the touch data and IMU data.
[0242] If no touch operation is detected, the electronic device can repeatedly execute step S1112.
[0243] S1113. Detect whether it is in one-handed mode.
[0244] The detection method for single-handed mode can be found in the description of the foregoing embodiments.
[0245] S1114. Maintain the display of the user interface 1.
[0246] If the electronic device is detected to be in non-one-handed mode, the electronic device can continue to display the user interface 1.
[0247] S1115. Display control 1 according to the one-handed mode. Control 1 is used to trigger the electronic device to adjust the user interface according to the one-handed mode.
[0248] If the electronic device is detected to be in one-handed mode, the electronic device can display control 1 according to the one-handed mode.
[0249] For example, if the electronic device is in left-handed mode, control 1 can be used to trigger the display of a user interface adapted to left-handed mode. If the electronic device is in right-handed mode, control 1 can be used to trigger the display of a user interface adapted to right-handed mode.
[0250] Optionally, the control 1 can be displayed within a defined comfort zone of the electronic device to facilitate one-handed touch operation of the control 1. The comfort zone can be referenced from the description in the foregoing embodiments.
[0251] S1116. In response to the operation on control 1, display user interface 2, which is the user interface corresponding to user interface 1 in one-handed mode.
[0252] The scenarios where electronic devices adjust their user interface according to one-handed mode can be referenced from the scenarios shown in Figures 7A-7C, 8A-8C, and 10A-10F. For example, if user interface 1 is user interface 710 as shown in Figure 7A and the electronic device is in left-handed mode, then user interface 2 can be user interface 720 as shown in Figure 7B. If user interface 1 is user interface 710 as shown in Figure 7A and the electronic device is in right-handed mode, then user interface 2 can be user interface 730 as shown in Figure 7B.
[0253] In some embodiments, the operation is not limited to the operation of the control 1 described above. Other preset gesture operations can also be used to trigger the electronic device to adjust the user interface according to the one-handed mode. That is, the electronic device may not display the control 1 described above. When the electronic device is in one-handed mode, it can display a user interface adapted to the one-handed mode according to preset gesture operations.
[0254] Understandably, users may not want their electronic devices to adjust their user interface to suit one-handed mode when using them with one hand. Therefore, upon detecting that the electronic device is in one-handed mode, it can use control 1 to ask the user if they want the user interface adjusted. If the user agrees, the electronic device can display the user interface adapted to one-handed mode for convenient one-handed use. If the user does not agree, the electronic device does not need to adjust the content displayed on the touchscreen to suit one-handed mode. This better meets user needs and improves the user experience.
[0255] Figures 12A to 12D illustrate some scenarios of adjusting the user interface in one-handed mode.
[0256] As shown in Figure 12A, the electronic device 100 can display a user interface 1210. The user interface 1210 may include an input field 1211. The user holds the electronic device 100 with their left hand and uses their left hand to perform touch operations on the input field 1211, such as clicking. The electronic device 100 can detect that it is in left-handed mode. In left-handed mode, in response to the touch operation on the input field 1211 shown in Figure 12A, the electronic device 100 can display the user interface 1220 shown in Figure 12B.
[0257] As shown in Figure 12B, the user interface 1220 may include a keyboard 1221 and a left-hand keyboard control 1222. The keyboard 1221 can be used for text input. The left-hand keyboard control 1222 can be used to activate the left-hand keyboard. The left-hand keyboard can be the content corresponding to the keyboard 1221 in left-hand mode, facilitating touch operation of the controls on the keyboard 1221 by the user in left-hand mode.
[0258] In some embodiments, the left-hand keyboard control 1222 may be located within a comfortable zone defined by the electronic device 100 in left-handed mode. This allows the user to easily touch the left-hand keyboard control 1222 when using the electronic device 100 with one left hand, and thus perform touch operations on the left-hand keyboard control 1222.
[0259] In response to an operation of the left-hand keyboard control 1222, the electronic device 100 can adjust the keyboard 1221 shown in FIG12B to the left-hand keyboard 1223 shown in FIG12C. The left-hand keyboard 1223 is merely an illustrative example of this application and should not be construed as limiting this application.
[0260] The electronic device 100 can also display an expansion control 1224. The expansion control 1224 can be used to trigger the electronic device 100 to restore the display of the left-hand keyboard 1223 shown in FIG12C to the keyboard 1221 shown in FIG12B.
[0261] In some embodiments, if no operation on the left-hand keyboard control 1222 is detected within a certain period, the electronic device 100 may de-display the left-hand keyboard control 1222. This avoids prolonged display of the left-hand keyboard control 1222 affecting the user's use of the electronic device 100. Optionally, after de-displaying the left-hand keyboard control 1222, the electronic device 100 can still continue to detect the one-handed mode. If the one-handed mode remains unchanged, the electronic device 100 need not re-display the control used to ask the user whether to display a user interface adapted to the one-handed mode. If a change in the one-handed mode is detected, the electronic device 100 may display the control used to ask the user whether to display a user interface adapted to the changed one-handed mode. For example, if the electronic device 100 is still in left-handed mode after de-displaying the left-hand keyboard control 1222, the electronic device 100 need not re-display the left-hand keyboard control 1222. If the electronic device 100 switches from left-handed mode to right-handed mode after de-displaying the left-hand keyboard control 1222, the electronic device 100 may display a control to enable the right-hand keyboard.
[0262] As shown in Figure 12D, the user holds the electronic device 100 with their right hand. The electronic device 100 can detect that it is in right-hand mode. In right-hand mode, the electronic device 100 can display a right-hand keyboard control 1225. The right-hand keyboard control 1225 can be used to activate the right-hand keyboard. The right-hand keyboard can be the content corresponding to the keyboard 1221 in right-hand mode, so as to facilitate the user to perform touch operations on the controls of the keyboard 1221 in right-hand mode.
[0263] In some embodiments, the right-hand keyboard control 1225 may be located within a comfortable zone defined by the electronic device 100 in right-hand mode. This allows the user to easily touch and perform touch operations on the right-hand keyboard control 1225 when using the electronic device 100 with their right hand. The right-hand keyboard control 1225 can be referenced to the aforementioned description of the left-hand keyboard control 1222.
[0264] As can be seen, in text input scenarios, after the electronic device detects that it is in one-handed mode, it can ask the user whether they want to display a keyboard adapted to one-handed mode via the left-handed keyboard control 1222 or the right-handed keyboard control 1225. If the user agrees, the electronic device can display a keyboard adapted to one-handed mode, such as a left-handed keyboard or a right-handed keyboard, on the touchscreen. This better meets the user's needs and improves the user experience.
[0265] Figure 13 illustrates a flowchart of a method for adjusting the user interface in one-handed mode according to an embodiment of this application.
[0266] S1311. Display user interface 3, which includes control 2. Control 2 is used to enable one-handed mode detection.
[0267] User interface 3 can be any user interface in an electronic device, or a preset user interface.
[0268] S1312. In response to the operation on control 2, detect whether the electronic device is currently in left-handed mode or right-handed mode.
[0269] In some embodiments, the electronic device can acquire IMU data and touch data to perform one-handed mode detection, as detailed in the foregoing embodiments.
[0270] Alternatively, when the electronic device performs one-handed mode detection in response to an operation on control 2, it can detect the touch hand based solely on touch data. If the touch hand detected is left-handed, the electronic device can determine that it is in left-handed mode. If the touch hand detected is right-handed, the electronic device can determine that it is in right-handed mode.
[0271] If the electronic device is detected to be in left-handed mode, the electronic device may perform the following step S1313.
[0272] If the electronic device is detected to be in right-hand mode, the electronic device may perform the following step S1314.
[0273] S1313, Display user interface 4. User interface 4 is the user interface corresponding to user interface 3 in left-handed mode.
[0274] S1314. Display user interface 5. User interface 5 is the user interface corresponding to user interface 3 in right-hand mode.
[0275] Understandably, when a user interacts with control 2, it indicates that they are currently using the electronic device with one hand and wish the user interface to be adjusted to adapt to this one-handed mode. Therefore, in response to the interaction with control 2, the electronic device can perform one-handed mode detection and, upon detecting this mode, directly adjust the content displayed on the touchscreen to match the one-handed mode interface. The electronic device can begin one-handed mode detection only after detecting an interaction with control 2. Before detecting an interaction with control 2, the electronic device does not need to perform one-handed mode detection. This allows for meeting the user's need for one-handed device use while reducing the electronic device's power consumption.
[0276] Figures 14A to 14E illustrate some scenarios of adjusting the user interface in one-handed mode.
[0277] As shown in Figure 14A, the electronic device 100 can display a user interface 1410. The user interface 1410 may include a keyboard 1411 and a one-handed keyboard control 1412. The keyboard 1411 can be referenced to the keyboard 1221 shown in Figure 12B. The one-handed keyboard control 1412 can be used to activate the one-handed keyboard. The one-handed keyboard may include a left-handed keyboard and a right-handed keyboard. The left-handed and right-handed keyboards can be referred to the description in the foregoing embodiments.
[0278] As shown in Figure 14B, the user holds the electronic device 100 with their left hand and uses it to perform touch operations on the one-handed keyboard control 1412, such as clicking. In response to the operation on the one-handed keyboard control 1412, the electronic device 100 can perform one-handed mode detection and determine that the electronic device 100 is in left-handed mode. Specifically, the electronic device 100 can perform one-handed mode detection based on the touch data corresponding to the operation on the one-handed keyboard control 1412 as shown in Figure 14B.
[0279] Then, the electronic device 100 can display the left-hand keyboard 1413 and the expand control 1414 shown in FIG14C. This allows the user to conveniently input text using the left-hand keyboard 1413 in left-hand mode. The expand control 1414 can refer to the expand control 1224 shown in FIG12C above.
[0280] In some embodiments, after displaying the left-hand keyboard 1413 shown in FIG14C, the electronic device 100 may stop performing single-handed mode detection to reduce the power consumption of the electronic device 100.
[0281] As shown in Figure 14D, the user holds the electronic device 100 with their right hand and uses their left hand to perform touch operations on the one-handed keyboard control 1412, such as clicking. In response to the operation on the one-handed keyboard control 1412, the electronic device 100 can perform one-handed mode detection and determine that the electronic device 100 is in right-handed mode. Specifically, the electronic device 100 can perform one-handed mode detection based on the touch data corresponding to the operation on the one-handed keyboard control 1412 as shown in Figure 14D.
[0282] Then, the electronic device 100 can display the right-hand keyboard 1415 and the expand control 1416 shown in FIG14E. This allows the user to conveniently input text using the right-hand keyboard 1415 in right-hand mode. The expand control 1416 can refer to the expand control 1224 shown in FIG12C above.
[0283] In some embodiments, after displaying the right-hand keyboard 1415 shown in FIG14E, the electronic device 100 may stop performing one-handed mode detection to reduce the power consumption of the electronic device 100.
[0284] As can be seen, in text input scenarios, the electronic device detects operations used to enable one-handed mode detection, such as operations on the aforementioned one-handed keyboard control 1412. This allows for one-handed mode detection, and upon detecting the one-handed mode, it directly displays a keyboard adapted to the one-handed mode on the touchscreen, such as a left-handed keyboard or a right-handed keyboard. This reduces the power consumption of the electronic device while meeting the user's need for one-handed operation.
[0285] In some embodiments, in response to the operation of bringing up the keyboard, the electronic device 100 can detect whether the most recently determined usage mode of the electronic device 100 is a one-handed mode.
[0286] If the most recently determined usage mode of the electronic device 100 is a non-single-handed mode, the electronic device 100 may display the keyboard 1411 shown in FIG14A, but may not display the single-handed keyboard control 1412 shown in FIG14A.
[0287] If the most recently determined usage mode of electronic device 100 is one-handed mode, electronic device 100 can display the keyboard 1411 and one-handed keyboard control 1412 shown in FIG. 14A. In response to an operation on the one-handed keyboard control 1412, electronic device 100 can perform one-handed mode detection. Specifically, electronic device 100 can perform one-handed mode detection based on the touch data corresponding to the operation on the one-handed keyboard control 1412. It is understood that the usage mode of electronic device 100 may change at any time. The usage mode of electronic device 100 when it receives an operation on the one-handed keyboard control 1412 may be different from the most recently determined usage mode of electronic device 100. For example, the most recently determined usage mode of electronic device 100 may be left-handed mode, but the usage mode of electronic device 100 when it receives an operation on the one-handed keyboard control 1412 may be right-handed mode. Therefore, performing one-handed mode detection again after receiving an operation on the one-handed keyboard control 1412 can more accurately display a keyboard adapted to one-handed mode.
[0288] For example, upon receiving an operation on the one-handed keyboard control 1412, if the electronic device 100 determines that it is in left-handed mode, it can display the left-handed keyboard 1413 shown in FIG14C. Upon receiving an operation on the one-handed keyboard control 1412, if the electronic device 100 determines that it is in right-handed mode, it can display the right-handed keyboard 1415 shown in FIG14E.
[0289] In some embodiments, the one-handed keyboard control 1412 shown in FIG14A may include a close button. This close button can be used to deselect the one-handed keyboard control. Optionally, if the electronic device 100 detects that the frequency of operation on the close button exceeds a preset frequency, the electronic device 100 may not display the one-handed keyboard control 1412 when subsequently accessing the keyboard 1411. This application embodiment does not limit the preset frequency. For example, the preset frequency may be 5 times per week. That is, if the electronic device 100 detects multiple, for example, 6 times per week, operations on the close button to close the one-handed keyboard control 1412, the electronic device 100 may not display the one-handed keyboard control 1412 when subsequently accessing the keyboard 1411. This avoids interference from the one-handed keyboard control 1412 on the user's use of the electronic device 100.
[0290] In some embodiments, if no operation on the one-handed keyboard control 1412 is detected within a certain period of time, the electronic device 100 may de-display the one-handed keyboard control 1412. This avoids prolonged display of the one-handed keyboard control 1412 from affecting the user's use of the electronic device 100.
[0291] In some embodiments, when the keyboard 1411 and the one-handed keyboard control 1412 shown in FIG14A are displayed, the electronic device 100 may de-display the one-handed keyboard control 1412 when an operation on a key in the keyboard 1411 is detected.
[0292] In some embodiments, when the keyboard 1411 and the one-handed keyboard control 1412 shown in FIG14A are displayed, the electronic device 100 can cancel the display of the keyboard 1411 and the one-handed keyboard control 1412 in response to the operation of canceling the display of the keyboard.
[0293] Figure 15 is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application.
[0294] As shown in Figure 15, the electronic device 100 may include a touch unit, an inertial measurement unit, a display unit, a computing unit, and a storage unit, which can be coupled via a bus.
[0295] The touch unit can be used to collect touch data on the touch screen.
[0296] An inertial measurement unit (IMU) can be used to acquire IMU data from an electronic device. In some embodiments, the IMU may include an accelerometer and a gyroscope. Optionally, the IMU may also include a magnetometer.
[0297] The storage unit can be used to store the aforementioned touch data and IMU data. In some embodiments, the storage unit can also store models for performing single-handed mode detection, including but not limited to: the usage mode detection model shown in FIG2A, the holding hand detection model 1 and the touch hand detection model shown in FIG3A, the holding hand detection model 2 shown in FIG4A, etc. The storage unit can also be used to store the detection results of single-handed mode detection.
[0298] The computing unit can be used to detect the hand holding and the touch hand of the electronic device using IMU data and touch data, and then detect the usage mode of the electronic device based on the hand holding and the touch hand. The computing unit can also be used to determine the user interface adapted to the one-handed mode based on the one-handed mode of the electronic device, and then instruct the display unit to display the user interface adapted to the one-handed mode.
[0299] The display unit can be used to display the user interface.
[0300] Electronic device 100 can be a mobile phone, tablet computer, personal digital assistant (PDA), etc. This application embodiment does not limit the type of electronic device 100.
[0301] The structure shown in Figure 15 does not constitute a specific limitation on the electronic device 100. In some embodiments, the electronic device 100 may also include more or fewer components than those shown in Figure 15.
[0302] Figure 16 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.
[0303] As shown in Figure 16, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0304] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0305] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0306] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0307] The processor 110 may also include a memory for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or is recurring. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0308] In this application, a computer program may be stored in the memory to enable a controller or processor to implement the one-handed mode recognition method of this application through an interface or protocol. For example, the computer program stored in the memory may be used to: acquire IMU data and touch data and identify the holding hand and touch hand of the electronic device based on the IMU data and touch data; determine the usage mode of the electronic device based on the holding hand and touch hand; determine a comfort zone when the electronic device is in one-handed mode and display a user interface adapted to the one-handed mode based on the comfort zone, etc.
[0309] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback.
[0310] The charging management module 140 receives charging input from a charger, which can be a wireless charger or a wired charger. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0311] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.
[0312] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0313] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0314] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1.
[0315] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0316] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering.
[0317] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0318] In some embodiments, the display screen 194 may be a capacitive touchscreen or a resistive touchscreen. The display screen 194 may detect touch operations performed on the display screen 194 and determine touch data corresponding to the touch operations. The touch data corresponding to the touch operations may include capacitive signals or resistive signals on the display screen 194 when the touch operation is performed.
[0319] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0320] The ISP is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye.
[0321] Camera 193 is used to capture still images or videos. In some embodiments, electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0322] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0323] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0324] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0325] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a function, such as sound playback, image playback, etc. The data storage area may store data created during the use of electronic device 100, such as audio data, phonebook, etc. Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0326] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0327] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0328] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.
[0329] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a telephone call or voice message, the receiver 170B can be brought close to the ear to hear the voice.
[0330] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C.
[0331] The 170D headphone jack is used to connect wired headphones.
[0332] In this application, the speaker 170A, receiver 170B, and microphone 170C are all optional.
[0333] The sensor module 180 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, gravity sensors, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, capacitive sensors, ambient light sensors, bone conduction sensors, angle sensors, etc.
[0334] Buttons 190 include a power button, volume buttons, etc. Motor 191 can generate vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, and also to indicate messages, missed calls, notifications, etc.
[0335] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and detach from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to achieve functions such as calls and data communication. In some examples, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be removed from it.
[0336] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, can implement the steps in the above-described method embodiments.
[0337] This application also provides a computer program product, including a computer program that, when run on a processor, can implement the steps in the various method embodiments described above.
[0338] This application also provides a chip system, which includes a processing circuit and an interface circuit. The interface circuit receives code instructions and transmits them to the processing circuit. The processing circuit executes the code instructions to enable the chip system to implement the steps of any method embodiment of this application. The chip system can be a single chip or a chip module composed of multiple chips.
[0339] It is understood that the user interfaces described in the embodiments of this application are merely example interfaces and do not constitute a limitation on the solution of this application. In other embodiments, the user interface may adopt different interface layouts, may include more or fewer controls, and may add or remove other functional options, as long as they are based on the same inventive concept provided in this application, they are all within the protection scope of this application.
[0340] It should be noted that, without causing contradictions or conflicts, any feature in any embodiment of this application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of this application.
[0341] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A single-hand pattern recognition method, characterized by, The method is applied to an electronic device, the electronic device including a touch screen and an inertial measurement unit, and the method includes: The electronic device detects the user's first operation, acquires touch data on the touch screen, and acquires inertial measurement unit data through the inertial measurement unit. The inertial measurement unit data is collected within a time period determined according to the duration of the first operation. The electronic device determines the holding hand information and touch hand information of the electronic device based on the touch data and the inertial measurement unit data; Based on the grip hand information and the touch hand information, it is determined that the grip hand and the touch hand are consistent, and the electronic device is determined to be in one-handed mode.
2. The method of claim 1, wherein, The step of determining that the gripping hand and the touch hand are consistent based on the gripping hand information and the touch hand information, and determining that the electronic device is in one-handed mode, includes: Based on the gripping hand information and the touch hand information, it is determined that both the gripping hand and the touch hand are left hands, and the electronic device is determined to be in left-hand mode; Alternatively, based on the gripping hand information and the touch hand information, it can be determined that both the gripping hand and the touch hand are right-handed, thus determining that the electronic device is in right-handed mode.
3. The method according to claim 1 or 2, characterized in that, The first operation includes a first touch operation performed on the touch screen, the touch data includes first touch data corresponding to the first touch operation, and the inertial measurement unit data includes first inertial measurement unit data detected within a first time period, the first time period being determined based on the duration of the first touch operation.
4. The method of claim 3, wherein, The electronic device determines the holding hand information and touch hand information of the electronic device based on the touch data and the inertial measurement unit data, including: The electronic device determines the gripping hand information based on the data from the first inertial measurement unit and the first model; The electronic device determines the touch hand information based on the first touch data and the second model.
5. The method of claim 3, wherein, The electronic device determines the holding hand information and touch hand information of the electronic device based on the touch data and the inertial measurement unit data, including: The electronic device determines the holding hand information and the touch hand information based on the data from the first inertial measurement unit, the first touch data, and the third model.
6. The method of claim 1 or 2, wherein, The first operation includes a second touch operation and a third touch operation performed on the touchscreen. The third touch operation occurs after the second touch operation. The touch data includes second touch data corresponding to the second touch operation and third touch data corresponding to the third touch operation. The inertial measurement unit (IMU) data includes second IMU data detected within a second time period, which is the period after the second touch operation and before the third touch operation. The electronic device determines the holding hand information and touch hand information of the electronic device based on the touch data and the IMU data, including: The electronic device determines the first hand holding information of the electronic device based on the second touch data; The electronic device determines grip switching information based on the data from the second inertial measurement unit, and the grip switching information is used to indicate whether the electronic device generates a grip switching action; The electronic device determines the grip information based on the first grip information and the grip switching information; The electronic device determines the touch hand information based on the third touch data.
7. The method according to any one of claims 1 to 6, characterized in that, Before the electronic device determines the holding hand information and touch hand information of the electronic device based on the touch data and the inertial measurement unit data, the method further includes: The electronic device illuminates the touchscreen; or... The electronic device detects that it displays a first user interface; or... The electronic device receives a second operation, which is used to enable one-handed mode recognition.
8. The method according to any one of claims 1-7, characterized in that, Before the electronic device determines the holding hand information and touch hand information of the electronic device based on the touch data and the inertial measurement unit data, the method further includes: The electronic device displays a first keyboard and a first control. The first keyboard is a keyboard adapted to non-one-handed mode, and the first control is used to trigger the electronic device to display a keyboard adapted to one-handed mode. The electronic device receives an operation on the first control; After determining that the electronic device is in one-handed mode, the method further includes: The electronic device displays a second keyboard, which is adapted to the one-handed mode.
9. The method according to any one of claims 1-7, characterized in that, Before determining that the electronic device is in one-handed mode, the method further includes: The electronic device displays a first keyboard; After determining that the electronic device is in one-handed mode, the method further includes: The electronic device displays a second control; In response to an operation on the second control, the electronic device switches the first keyboard to a second keyboard, the second keyboard being a keyboard adapted to the one-handed mode.
10. The method according to claim 9, characterized in that, The single-handed mode includes either a left-handed mode or a right-handed mode; If the electronic device is in left-handed mode, the second control is located within the comfort zone of left-handed mode, and the second keyboard is a keyboard adapted to left-handed mode; If the electronic device is in right-hand mode, the second control is located within the comfort zone of right-hand mode, and the second keyboard is a keyboard adapted to right-hand mode.
11. The method according to any one of claims 1-10, characterized in that, Before determining that the electronic device is in one-handed mode, the method further includes: The electronic device displays a second user interface; After determining that the electronic device is in one-handed mode, the method further includes: The electronic device displays a one-handed mode user interface, which is the user interface corresponding to the second user interface in one-handed mode.
12. The method of claim 11, wherein, The one-handed mode includes a left-handed mode or a right-handed mode, and the electronic device displays a one-handed mode user interface, including: If the electronic device is in left-handed mode, the electronic device displays a third user interface, which is the user interface corresponding to the second user interface in the left-handed mode; If the electronic device is in right-hand mode, the electronic device displays a fourth user interface, which is the user interface corresponding to the second user interface in the right-hand mode.
13. An electronic device, comprising: The electronic device includes a touch screen, an inertial measurement unit, and a processor. The touch screen is used to detect the user's first operation and detect touch data based on the first operation; The inertial measurement unit is used to collect inertial measurement unit data, which is collected within a time period determined according to the duration of the first operation. The processor is configured to determine the gripping hand information and the touch hand information of the electronic device based on the touch data and the inertial measurement unit data, and to determine that the gripping hand and the touch hand are consistent based on the gripping hand information and the touch hand information, thereby determining that the electronic device is in a one-handed mode.
14. The electronic device of claim 13, wherein, The processor is configured to determine that the electronic device is in one-handed mode when it is determined, based on the gripping hand information and the touch hand information, that the gripping hand and the touch hand are consistent. This includes: The processor is further configured to determine that the electronic device is in left-handed mode when it is determined from the gripping hand information and the touch hand information that both the gripping hand and the touch hand are left-handed, and / or to determine that the electronic device is in right-handed mode when it is determined from the gripping hand information and the touch hand information that both the gripping hand and the touch hand are right-handed.
15. The electronic device according to claim 13 or 14, characterized by The first operation includes a first touch operation performed on the touch screen, the touch data includes first touch data corresponding to the first touch operation, and the inertial measurement unit data includes first inertial measurement unit data detected within a first time period, the first time period being determined based on the duration of the first touch operation.
16. The electronic device of claim 15, wherein, The processor is used to determine the gripping hand information and touch hand information of the electronic device based on the touch data and the inertial measurement unit data, including: The processor is configured to determine the gripping hand information based on the first inertial measurement unit data and the first model, and to determine the touch hand information based on the first touch data and the second model.
17. The electronic device of claim 15, wherein, The processor is used to determine the gripping hand information and touch hand information of the electronic device based on the touch data and the inertial measurement unit data, including: The processor is configured to determine the gripping hand information and the touch hand information based on the first inertial measurement unit data, the first touch data, and the third model.
18. The electronic device according to any one of claims 13-17, characterized in that, The touch screen is also used to display a first keyboard and a first control, wherein the first keyboard is a keyboard adapted to non-one-handed mode, and the first control is used to trigger the electronic device to display a keyboard adapted to one-handed mode; The system receives operations on the first control and displays a second keyboard, which is adapted to the one-handed mode.
19. The electronic device according to any one of claims 13-18, characterized in that, The touch screen is also used to display a second user interface; After determining that the electronic device is in one-handed mode The touchscreen is also used to display a one-handed mode user interface, which is the user interface corresponding to the second user interface in one-handed mode.
20. A computer-readable storage medium storing instructions, the instructions comprising: When the instructions are executed by the processor, they implement the method of any one of claims 1-12.
21. A computer program product, characterised in that, The computer program product includes computer instructions that, when executed by a processor, implement the method of any one of claims 1-12.