Method and system for operating a handheld device

Abstract

The invention relates to a method and a system for operating a handheld device. In a particular embodiment, a side sensor configured at a side of the handheld device captures an operational characteristic of a user's hand. When a one-hand operation mode is detected using a side sensor, the display is changed to make one-hand operation easier. Other embodiments are also provided.

Description

Background of the Invention

[0002] Over the past two decades, handheld devices such as mobile phones and small tablet computers have become ubiquitous. Handheld devices often include a touch screen that can be used as both an output display and an interface for receiving user input. While large display screens have almost always been popular, large touch screens are often difficult for users to operate, especially with one hand. There are various solutions that can make one-handed operation easier for users, but these solutions are not perfect, as described below.

[0003] Therefore, new and improved methods and systems for operating handheld devices are desired. Summary of the invention

[0004] The present invention relates to methods and systems for operating a handheld device. In a specific embodiment, a side sensor configured at the side of the handheld device captures the operating characteristics of the user's hand. When a one-handed operating mode is detected using the side sensor, the display is changed to make one-handed operation easier. There are other embodiments.

[0005] Embodiments of the present invention can be implemented in combination with existing systems and methods. For example, the device configuration and related methods according to the present invention can be used in a wide variety of handheld systems, including mobile phones, tablet computers and other mobile devices. In addition, various techniques according to the present invention can be applied to existing systems through integrated circuit manufacturing, mobile operating software and wireless communication protocols. There are other advantages.

[0006] A system of one or more computers may be configured to perform specific operations or actions by software, firmware, hardware, or a combination thereof installed on the system, which, when run, causes the system to perform the above-mentioned actions. One or more computer programs may be configured to perform specific operations or actions by including instructions, which, when executed by a data processing device, cause the device to perform the above-mentioned actions. A general aspect includes a handheld system having a housing. The system also includes a touch screen configured on the front of the housing, which may include a first one-hand display area. The system also includes a first sensor configured on the left side of the housing, the first sensor configured to generate a first sensor reading. The system also includes a second sensor configured on the right side of the housing, the second sensor configured to generate a second sensor reading. The system also includes a memory configured to store display preference data. The system also includes a processor coupled to the first sensor and the second sensor, the processor configured to: process the display preference data, select a one-hand operation mode based on at least the first sensor reading and the second sensor reading, and move the user interface to the first one-hand display area. Other embodiments of this aspect include corresponding computer systems, apparatuses, and computer programs recorded on one or more computer storage devices, each of which is configured to perform the actions of the above-described method.

[0007] Implementations may include one or more of the following features. In the handheld system, the processor may include a central processing unit and a graphics processing unit, the graphics processing unit being coupled to the touch screen. The first sensor may include a pressure sensor. The handheld system includes a first sensor, the first sensor may include a pressure sensor. The first sensor may include a capacitive sensor. The handheld system may include an accelerometer, the processor being configured to move the user interface to a second one-hand display area based on input from the accelerometer. The processor is also configured to update the display preference data based on user input received from the touch screen. The processor is also configured to select between a left-hand mode and a right-hand mode based on the first sensor reading and the second sensor reading. The touch screen may also include a second one-hand display area, the first one-hand display area being associated with the right-hand mode, and the second one-hand display area being associated with the left-hand mode. The user interface may include one or more control items. The handheld system may include a communication module configured to transmit the display preference data to a server. The processor may include a neural processing unit, the neural processing unit being configured to update the display preference data based on user input. Implementations of the described techniques may include hardware, methods or processes, or computer software on a computer-accessible medium.

[0008] One general aspect includes a method of operating a handheld system. The method includes displaying a user interface on a first area and a second area of ​​a touch screen. The method also includes receiving a first input from a first side sensor, the first side sensor being configured on a first side of a housing. The method also includes receiving a second input from a second side sensor, the second side sensor being configured on a second side of the housing. The method also includes obtaining display preference data from a memory. The method also includes processing the first input and the second input. The method also includes selecting a one-handed operation mode based on the first input and the second input. The method also includes selecting a first area of ​​the touch screen based on the one-handed operation mode and the display preference data. The method also includes removing the user interface from the second area of ​​the touch screen based on the one-handed operation mode and the display preference data. The method also includes receiving user input within the first area of ​​the touch screen. Other embodiments of this aspect include corresponding computer systems, apparatuses, and computer programs recorded on one or more computer storage devices, each of which is configured to perform the actions of the method.

[0009] Implementations may include one or more of the following features. The method may include, upon receiving an indication of a change in leveling, displaying a user interface in a first region and a second region of the touch screen. The method may include shifting or scaling the user interface to the first region of the touch screen. The method may include determining a control position on the touch screen. The method may include determining a distance between the control position and a thumb. Implementations of the described techniques may include hardware, methods or processes, or computer software on a computer accessible medium.

[0010] One general aspect includes a method for calibrating an input mode for operating a handheld device. The method also includes providing a touch screen. The method also includes displaying a calibration interface on the touch screen. The method also includes creating a display preference profile based on a predetermined template. The method also includes receiving user input in a one-handed mode on the touch screen during a first time interval. The method also includes receiving a first side sensor input from a first side sensor during the first time interval, the first side sensor being configured on a first side of the handheld device. The method also includes receiving a second side sensor input from a second side sensor during the first time interval, the second side sensor being configured on a second side of the handheld device. The method also includes updating the display preference profile using at least the first side sensor input and the second side sensor input. Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each of which is configured to perform the actions of the method.

[0011] Implementations may include one or more of the following features. The method may include updating the display preference profile based on a third side sensor input received from the first side sensor during a second time period. The method may include processing a pressure reading of a user's finger. Implementations of the described techniques may include hardware, a method or process, or computer software on a computer-accessible medium.

[0012] It will be appreciated that embodiments of the present invention have many advantages over conventional techniques. Among other things, the present invention provides a configuration and method for a handheld device that allows a user to use grip gestures to move a user interface displayed on a touch screen to position certain controls of the user interface in a more accessible location (e.g., within reach in a one-handed operation mode). In addition, the present invention implements a flexible method for configuring and calibrating display preference profiles associated with the operation of the user interface.

[0013] The present invention achieves these and other advantages in the context of known technology. However, a further understanding of the nature and advantages of the present invention may be obtained by referring to the following portions of the specification and the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 is a simplified diagram showing a handheld device configured with a side sensor according to an embodiment of the present invention.

[0015] Figure 2 is a simplified block diagram illustrating components of a handheld device according to an embodiment of the present invention.

[0016] Figure 3 is a simplified flow chart illustrating a method of operating a handheld device according to an embodiment of the present invention.

[0017] Figure 4 is a simplified flow chart illustrating a method for setting a one-handed operation mode of a handheld device according to an embodiment of the present invention.

[0018] Figure 5 is a simplified diagram showing that the display area is shifted to the left to make the control items accessible to the user according to an embodiment of the present invention.

[0019] Figure 6 is a simplified diagram showing that the display area is shifted to the bottom to make the control items accessible to the user according to an embodiment of the present invention.

[0020] Figure 7 is a simplified diagram showing that the display area is shifted to the lower left corner to make the control items accessible to the user according to an embodiment of the present invention.

[0021] Figure 8is a simplified diagram showing a mechanism by which a user activates a one-handed operation mode using a side sensor according to an embodiment of the present invention.

[0022] Fig. 9 is a simplified flow chart illustrating a process of entering a one-handed operation mode according to an embodiment of the present invention.

[0023] Fig.10 is a simplified flow chart illustrating a process of exiting a one-handed operation mode according to an embodiment of the present invention. DETAILED DESCRIPTION

[0024] The present invention relates to methods and systems for operating a handheld device. In a specific embodiment, a side sensor configured at the side of the handheld device captures the operating characteristics of the user's hand. When a one-handed operating mode is detected using the side sensor, the display is changed to make one-handed operation easier. There are other embodiments.

[0025] As described above, operating a handheld device with a large touch screen may be difficult. In particular, when a user operates a handheld device with one hand, the user's thumb is often too short to conveniently reach the opposite side of the touch screen. Therefore, the present invention provides a configuration and method for a handheld device that allows a user to use a grip gesture to move a user interface displayed on the touch screen. By doing so, certain controls (e.g., buttons, icons, text fields, interactive elements, etc.) of the user interface can be placed in a more convenient location.

[0026] Related methods and devices include using a sensor array configured in a handheld device to detect a user's grip gesture to identify one or more single-handed grip operation modes. In these modes, the grip gesture can be used to trigger a user interface movement process to facilitate thumb operation on a touch screen, or to trigger the user interface to return to a default display mode or a previous display mode (e.g., full screen mode).

[0027] For example, there are deficiencies in existing one-handed operation mechanisms, such as half-screen mode, zoomed desktop, and twisted desktop. Existing half-screen mode implementations (such as Apple, Samsung, Huawei, etc.) only utilize the lower half of the screen, and there is no option for left and right half-screen modes. Touchscreen interaction is also required to enable and disable half-screen mode with a fixed size and layout. Similarly, the implementation of zoomed desktop also requires touchscreen interaction to enable and disable its functionality. Moreover, the implementation of twisted desktop is unclear about how to trigger mode changes.

[0028] It is to be understood that embodiments of the present invention provide improved methods and systems for operating handheld devices. By using a sensor array, embodiments of the present invention can determine one or more touch points of a user's hand on a mobile phone, as well as the relative pressure of each touch point. Using these sensors configured in different parts of the device housing, the handheld device can determine various user gestures that can trigger different operating modes, such as a one-handed operating mode, so that the user's thumb can more easily access specific controls of the user interface. The handheld device may also include a horizontal sensor array, which can be used to determine the horizontal state of the mobile phone and determine a specific operating mode.

[0029] The following description is intended to enable one of ordinary skill in the art to make and use the invention and to incorporate it into the context of a particular application. Various modifications and various uses in different applications will be apparent to those skilled in the art, and the general principles defined herein may be applied to a wide range of embodiments. Therefore, the present invention is not limited to the embodiments presented, but should have the widest scope consistent with the principles and novel features disclosed herein.

[0030] In the following detailed description, many specific details are set forth to provide a more thorough understanding of the present invention. However, it is apparent to those skilled in the art that the present invention may be implemented without being limited to these specific details. In other cases, well-known structures and devices are shown in block diagram form rather than in detail to avoid obscuring the present invention.

[0031] The reader is advised that all documents and files filed simultaneously with this specification are open to the public together with this specification, and the contents of all such documents and files are incorporated herein by reference. All features disclosed in this specification (including any attached claims, abstracts and drawings) can be replaced by alternative features serving the same, equivalent or similar purpose, unless otherwise expressly stated. Therefore, unless otherwise expressly stated, each feature disclosed is only an example of a series of equivalent or similar features.

[0032] In addition, any element in a claim that does not explicitly state a “means” for performing a specified function or a “step” for performing a specified function shall not be construed as a “means” or “step” provision under 35 U.S.C. 112, paragraph 6. In particular, the use of “step” or “action” in the claims herein is not intended to invoke the provisions of 35 U.S.C. 112, paragraph 6.

[0033] It should be noted that the labels left, right, front, back, up, down, forward, backward, clockwise, and counterclockwise, if used, are for convenience only and do not represent any particular fixed direction. Instead, they are used to reflect the relative position and / or direction of various parts of an object.

[0034] Figure 1 1 is a simplified diagram showing a handheld device 100 configured with a side sensor according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0035] As shown, the device 100 can be configured within a housing 110 and can include a touch screen 120, a first sensor 131, a second sensor 132, a memory 140, and a processor 150. The touch screen 120 can be configured on the front of the housing 110, while the first sensor 131 and the second sensor 132 can be configured on the first side and the second side of the housing, respectively. The memory 140 and the processor 150 can be configured within the housing 110 (e.g., in an integrated circuit device, etc.), as shown in the dashed cross section 101. In addition, the processor 150 can be coupled to the touch screen 120, the sensors 131 and 132, and the memory 140 to communicate between these device elements.

[0036] In one example, the first sensor 131 can be configured to generate at least a first sensor reading, and the second sensor 132 can be configured to generate at least a second sensor reading. Each of the first sensor and the second sensor can include a pressure sensor, a capacitive sensor, or other touch sensor, and a combination thereof. These sensors can be used to detect and process pressure readings of a user's finger. In other cases, the device 100 may include one or more additional sensors that generate one or more additional sensor readings. The memory 140 can be configured to store display preference data. The memory 140 may include various storage devices, such as random access memory (RAM), flash memory, etc.

[0037] The processor 150 may be configured to process the display preference data, select a one-handed operation mode based on at least the first sensor reading and the second sensor reading, and move the user interface to one or more one-handed display areas. In other cases, the processor 150 may receive multiple sensor readings from multiple sensors configured at different portions of the housing 110, determine the operation mode based on the multiple sensor readings, and move the user interface from an initial display area or from a state where the user interface was not previously displayed to one or more display areas.

[0038] In a specific example, the processor 150 may be configured to select between the left-hand holding mode and the right-hand holding mode based on the first sensor reading and the second sensor reading. For example, the calibration application may prompt the user on the display of the touch screen 120 to hold the device 100 with the left hand or the right hand and operate the phone with the thumb of the hand performing the holding operation. In this case, the first sensor is configured on the left side of the housing 110, and the second sensor is configured on the right side of the housing 110. In addition, the touch screen 120 may include a first single-hand display area associated with the left-hand holding mode, and a second single-hand display area associated with the right-hand holding mode.

[0039] In addition, the processor 150 can be configured to move the user interface to one or more display areas based on one or more inputs from one or more additional sensors, such as accelerometers, gyroscopes, magnetometers, level sensors, or other sensors and combinations thereof. In other cases, the device 100 may include multiple sensors that can be configured in various parts of the housing 110 (e.g., left side, right side, top, bottom, front side, and back side). These sensors can all provide the following sensor readings, which can be used to determine the desired operating mode and move the user interface to the desired display area of ​​the touch screen, as well as other processes.

[0040] In one example, the user interface may include one or more control items, such as buttons, icons, text fields, interactive elements, etc. Depending on the operating mode, the user interface may be shifted, scaled, or otherwise transformed to a specific display area during movement. The position of one or more control items may also be used as an input to determine how to transform the user interface. For example, one or more sensors may be used to determine the distance between the user's thumb and the control item, which may be used as an input to determine the type of operating mode or the degree to which the user interface is to be transformed. Other holding gestures determined by one or more sensor inputs may also be used to trigger different operating modes in which the user interface is transformed to provide the user with more convenient access to the control items.

[0041] Figure 2 2 is a simplified block diagram showing components of a handheld device 200 according to an embodiment of the present invention. This diagram is merely an example, which should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0042] As shown, Figure 2 The invention discloses a method that can be included in a handheld device (e.g. Figure 1200). The components configured to the housing 201 may include: a central processing unit (CPU) 210 coupled to a graphics processing unit (GPU) 212, and a touch screen including a display 220 and a screen touch sensor 222. Here, the CPU 210 is coupled to the screen touch sensor 222, the auxiliary hand sensor 230, and the accelerometer 232, which can all provide sensor inputs to determine user gestures and device operating modes, as previously described. The GPU 212 can be coupled to the display 220 and the camera 250. In addition, the GPU 212 can be configured to transmit various forms of user interfaces to the display 220 depending on the operating mode.

[0043] As previously described, the CPU 210 may also be configured to update the memory based on user input received from the touch screen (see Figure 1 In a specific example, the CPU 210 is also coupled to a neural processing unit (NPU) 214 configured to update the display preference data based on user input, which can be provided by a screen touch sensor 222, or Figure 1 In a specific example, NPU 214 can be used to learn the user's holding gesture through one or more sensors in device 200. Such gesture data can also be stored in a memory (e.g. Figure 1 in the memory 140).

[0044] The device 200 may also include a communication module 240 that is coupled to the CPU 210 and configured to transmit display preference data to a server. The communication module 240 may be configured for mobile data, Wi-Fi, Bluetooth, etc. The implementation of the described technology may include hardware, methods or processes, or computer software on a computer-accessible medium. Of course, these device elements and their configurations may also have other variations, modifications, and substitutions.

[0045] Figure 3 3 is a simplified flow chart illustrating a method 300 of operating a handheld device according to an embodiment of the present invention. This diagram is merely an example, which should not unduly limit the scope of the claims. One of ordinary skill in the art will recognize many variations, alternatives, and modifications. For example, one or more steps may be added, removed, repeated, rearranged, modified, replaced, and / or overlapped, and which should not limit the scope of the claims.

[0046] As shown, method 300 includes step 302: displaying a user interface on a first area and a second area of ​​a touch screen of a handheld device. As previously described, the touch screen can be configured on the front of a housing of a handheld device (e.g., a mobile phone, a tablet computer, etc.). In a specific example, the user interface can be displayed in both the first area and the second area when an indication of a change in horizontal state is received. In addition, the user can include one or more control items (e.g., buttons, icons, text fields, interactive elements, etc.).

[0047] At step 304, the method includes receiving a first input from a first sensor; at step 306, the method includes receiving a second input from a second sensor. In one example, the first sensor may be a first side sensor disposed on a first side of the housing, and the second sensor may be a second side sensor disposed on a second side of the housing. As previously described, the handheld device may include a plurality of sensors disposed within various portions of the housing. Thus, the method may also include receiving one or more inputs from the sensors.

[0048] At step 308, the method includes obtaining display preference data from a memory of the handheld system. As previously described, the memory may include various types of storage devices configured within the housing and coupled to a processor of the handheld device. The display preference data may include the size of the display area, the type of transformation of the user interface, the detected gesture configuration, etc.

[0049] At step 310, the method includes processing a first input and a second input; at step 312, the method includes selecting a one-handed operation mode based on the first input and the second input. As described above, the processor can be configured to process the first and second inputs and any additional inputs from additional sensors to determine the one-handed operation mode. In a specific example, the method can also include processing inputs related to one or more control items, such as a control item position on a touch screen, a distance between a control item position and a user's finger (e.g., a thumb), etc.

[0050] At step 314, the method includes selecting a first area of ​​the touch screen based on the one-handed operation mode and the display preference data. Moreover, at step 316, the method includes removing the user interface from a second area of ​​the touch screen based on the one-handed operation mode and the display preference data. As previously described, the processor can be configured to select certain display areas and transform the user interface based on the selected operation mode and the display preference data. The step of removing the user interface from the second area may include transforming (e.g., shifting, scaling, etc.) the user interface to the first area. In a specific example, the transformation of the user interface can make the portion of the user interface in the second area alternatively accessible to the user in the first area.

[0051] In step 318, the method includes receiving user input within a first region of the touch screen. This step can include any user interaction with the user interface to update display preference data, execute an application, send a communication, etc. Further details will be discussed with respect to the subsequent figures.

[0052] Figure 4 is a simplified flowchart showing a method of setting a one - hand operation mode of a handheld device according to an embodiment of the present invention. This figure is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications. For example, one or more steps can be added, removed, repeated, rearranged, modified, replaced, and / or overlapped, and this should not limit the scope of the claims.

[0053] As shown, method 400 includes: at step 402, providing a touch screen, and at step 404, displaying a calibration interface on the touch screen. The touch screen can be configured on the front of the handheld device as described in the previous example. The calibration interface can be a user interface configured to receive user input to determine a display preference profile. In one example, the calibration interface can include one or more controls (e.g., buttons, software keyboards, slide controls, etc.) configured to obtain input related to the display preference profile. These controls can be displayed at different positions on the touch screen, prompting the user to operate on these controls.

[0054] In step 406, the method includes creating a display preference profile based on a predetermined template. In one example, the predetermined template can include one or more settings, configurations, or functions related to the display preference profile. The predetermined template can also include a plurality of predetermined display preference profiles. The user can provide input to one or more controls provided by the calibration interface to determine profile elements, select certain profiles, etc.

[0055] In step 408, the method includes receiving user input in one - hand mode on the touch screen during a first time period. Additionally, in step 410, the method includes receiving first side - sensor input from a first side - sensor configured on a first side of the handheld device during the first time period; and in step 412, the method includes receiving second side - sensor input from a second side - sensor configured on a second side of the handheld device during the first time period. As previously described, the method can also include receiving one or more sensor inputs from one or more sensors configured within various parts of the handheld device.

[0056] At step 414, the method includes updating the display preference profile using at least the first side sensor input and the second side sensor input. The update to the profile may include a change to one or more profile elements, a selection of another predetermined profile template, etc. In a specific example, the method may include updating the display preference profile based on a third side sensor input received from the first side sensor during the second time period. In other cases, additional sensor inputs from previous sensors or additional sensors may be used in the previous time period or in another time period to perform interaction with the user interface, display preference profile, or other related functionality.

[0057] In a specific example, the calibration application can prompt the user on the touch screen to hold the device with one hand and operate the phone with the thumb of the hand that is holding the device. The application can also prompt the user to draw the largest area on the touch screen with the user's thumb. The user can also be prompted to perform other calibration gestures. The calibration application can read data from the sensor during the user operation (i.e., the user responds to the prompt) to obtain the position and pressure of each finger, the distance between the fingers, the length and common operation area of ​​the thumb, the angle and speed of tilting the phone, etc.

[0058] Using the sensor data, the application can build an AI model / profile of the user's one-handed hand gesture (e.g., in place of the template profile creation of step 406 or as part of the profile update of step 414). This data can be used to determine the shift offset of the displayed user interface, the threshold for activating the user interface shift when the handheld device is tilted, etc. The application can also give the user the option to enable a continuous user behavior learning process in the background so that the profile continues to be updated as the user operates the device in daily activities. The NPU can be used with the calibration application to build the model / profile and for the continuous learning process.

[0059] A system of one or more computers may be configured to perform specific operations or actions by software, firmware, hardware, or a combination thereof installed on the system, which, when run, causes the system to perform the above actions. One or more computer programs may be configured to perform specific operations or actions by including instructions that, when executed by a data processing device, cause the device to perform the above actions. Those of ordinary skill in the art will recognize other variations, modifications, and alternatives to the steps described above.

[0060] Figure 51 is a simplified diagram showing a display area shifted to the left to make the control items accessible to the user according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0061] As shown, Figure 5 A handheld device 501 is shown displaying a user interface in a first state, and a handheld device 502 is shown displaying a user interface (UI) in a second state after being triggered by a user action. Devices 501 and 502 have a touch screen display 510 that displays a user interface area 520 that includes at least one control item 530 (e.g., a button, an icon, a text field, an interactive element, etc.). These devices may also include the elements discussed previously, such as the Figure 1 and Figure 2 The sensors and processors described herein. Furthermore, the user action trigger may include one or more sensor inputs received from these sensors.

[0062] In some cases, it may be difficult for a user to reach a particular control 530 when holding the device 501 / 502 with one hand. In this case, it may be difficult for a left-handed operation (i.e., using the left thumb) to reach the control 530 located in the upper right corner of the touch screen. In one example, a user action trigger causes a movement of the UI area 520, so that the control 530 moves from the right side (marked as the higher side) to the left side (marked as the lower side). The movement of the UI area 520 leaves a portion of the touch screen 510 with a blank screen area 522. An overflow UI area 524 is shown to indicate the portion of the UI area 520 that is not visible on the touch screen 510 during the user action trigger. Since the control 530 is closer to the left side of the touch screen 510, the user can more easily access the control 530 in the left-handed operation mode.

[0063] Figure 6 1 is a simplified diagram showing a display area shifted to the bottom to make the control items accessible to the user according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0064] As shown, Figure 6 A handheld device 601 is shown displaying a user interface in a first state, and a handheld device 602 is shown displaying a user interface in a second state after being triggered by a user action. Figure 5Similar to the devices of , device 601 and device 602 have a touch screen display 610 that displays a user interface area 620 that includes at least one control item 630 (e.g., a button, a text field, an icon, an interactive image, etc.). These devices may also include the elements discussed previously, such as Figure 1 and Figure 2 Furthermore, the user action trigger may include one or more sensor inputs received from these sensors.

[0065] Here, the control item 630 located at the upper right corner of the touch screen may be difficult to reach when operating with the right hand (i.e., using the right thumb). In one example, the user action triggers the movement of the UI area 620, so that the control item 630 moves from the top side (denoted as the higher side) to the bottom side (denoted as the lower side). Similar to the previous example, in this case of moving to the bottom side, the movement of the UI area 620 leaves a portion of the touch screen 610 with a blank screen area 622 and an overflow UI area 624. Since the control item 630 is closer to the bottom side of the touch screen 610, the user can more easily access the control item 630 in the right-handed operation mode.

[0066] Figure 7 1 is a simplified diagram showing a display area shifted to the lower left corner to make the control items accessible to the user according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0067] As shown, Figure 7 A handheld device 701 is shown displaying a user interface in a first state, and a handheld device 702 is shown displaying a user interface in a second state after being triggered by a user action. Figure 5 and Figure 6 Similar to the devices of , devices 701 and 702 have a touch screen display 710 that displays a user interface area 720 that includes at least one control item 630 (e.g., a button, a text field, an icon, an interactive image, etc.). These devices may also include the elements discussed previously, such as Figure 1 and Figure 2 The sensors and processors described herein. Furthermore, the user action trigger may include one or more sensor inputs received from these sensors.

[0068] Here, the control item 730 located in the upper right corner of the touch screen may be difficult to reach whether it is operated with the left hand or the right hand. In one example, the user action trigger causes the movement of the UI area 720, so that the control item 730 moves from the upper right (denoted as the higher side) to the lower left (denoted as the lower side). Similar to the previous example, in this case of moving to the lower left, the movement of the UI area 720 leaves a portion of the touch screen 710 with a blank screen area 722 and an overflow UI area 724. Since the control item 630 is closer to the center of the touch screen 610, the user can more easily access the control item 630 whether in the left-hand operation mode or the right-hand operation mode.

[0069] Figure 8 1 is a simplified diagram showing a mechanism for a user to activate a one-handed operation mode using a side sensor according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0070] In one example, the handheld device 801 exhibits a single-finger squeeze mechanism for activating a one-handed mode of operation, wherein the user interface area 820 is shifted to the right to bring the control item 830 closer to the user's thumb. The single-finger squeeze can be detected by a sensor configured within the device 801 near the middle finger shown. In other examples, the device 801 may have multiple sensors configured to detect a single-finger squeeze. Using a calibration application, these sensors can detect different pressures, areas, finger positions, etc. Moreover, the NPU can also be used to determine a user's gesture profile based on the way the user holds the device and performs gestures. For reference, the portion of the UI area that extends beyond the dotted line shows the UI overflow area that is not displayed on the touch screen 810 when the single-finger squeeze mechanism is triggered.

[0071] In one example, the handheld device 802 exhibits a multi-finger squeeze mechanism for activating a one-handed operation mode, wherein the user interface area 820 is shifted to the upper right to bring the control item 830 closer to the user's thumb. Here, the multi-finger squeeze can be detected by at least two sensors configured within the device 802 near the middle finger and ring finger shown. Similar to the previous example, multiple sensors can also be configured within the device 801 to detect multi-finger squeezes using a calibration application and / or an NPU learning process. In addition, the portion of the UI area beyond the dotted line represents the UI overflow area that is not displayed on the touch screen 810 when the multi-finger squeeze mechanism is triggered.

[0072] These finger mechanisms and other mechanisms may also be triggered by other fingers at other locations on the handheld device through one or more sensors configured in those locations. In addition, multi-finger mechanisms may include additional finger squeeze inputs (e.g., middle finger, ring finger, and pinky finger). Other mechanisms such as pan and tilt may also be used with finger squeeze inputs. Such mechanisms may be set in calibration mode, selected through a predetermined template setting or other similar configuration method.

[0073] As previously described, a calibration application and / or NPU may be used to configure the interpretation of user input and gestures (e.g., when a user's finger is not perfectly aligned with the sensor or is not consistently in the same position). For example, a calibration application may be used to set a predetermined gesture profile, or the NPU may compare future user gestures to previously recorded gesture profiles to determine the user's intended gesture. Such gesture profiles or display preference profiles may be configured as an AI model stored in the memory of the handheld device.

[0074] Fig. 9 9 is a simplified flow chart illustrating a process 900 of entering a one-handed operation mode according to an embodiment of the present invention. This diagram is merely an example, which should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications. For example, one or more steps may be added, removed, repeated, rearranged, modified, replaced, and / or overlapped, and which should not limit the scope of the claims.

[0075] As shown, the process 900 may include various user action triggers, such as: a quick shake trigger 912, a side multiple tap trigger 914, and a side finger squeeze trigger 916. As previously described, these user action triggers may be detected by receiving one or more sensor inputs from sensors configured in various parts of the handheld device. If any of these triggers are detected, the process 900 performs a series of check conditions to determine whether to enter the one-handed operation mode. The check conditions may include: a threshold level state change 922 in a time period, a sensor detection 924 of a one-handed operation, a control item 926 on the user interface, and a threshold distance 928 between the control item and the user's thumb. In an example, the order of the check conditions of the sensor detection 924 of the one-handed operation and the control item 926 on the user interface may be reversed. In an example, the threshold distance 928 between the control item and the user's thumb may range from the distance between the edge and the middle of the screen (e.g., about 3 cm) to the distance between the diagonal corners of the screen (e.g., about 17 cm). In some cases, if the user's thumb is able to reach the control item without adjusting the user interface, then a smaller threshold distance may not be useful. Moreover, in some cases, a larger threshold distance may result in a poor user experience because the mobile device is too large to be comfortably operated with one hand. If all conditions are met, the handheld device can be configured to enter a specific one-handed operation mode and move the user interface toward the user's thumb based on the sensor input and the display preference profile 932. If any of these conditions are not met, the process 900 can be configured to ignore the user action trigger 934.

[0076] Fig.10 1 is a simplified flow chart illustrating a process 1000 of exiting a one-handed operation mode according to an embodiment of the present invention. This diagram is merely an example, which should not unduly limit the scope of the claims. One of ordinary skill in the art will recognize many variations, alternatives, and modifications. For example, one or more steps may be added, removed, repeated, rearranged, modified, replaced, and / or overlapped, and which should not limit the scope of the claims.

[0077] As shown, the process 1000 may include various user action triggers, such as: a quick shake trigger 1012, a side multiple tap trigger 1014, and a side finger squeeze release (i.e., the finger no longer squeezes the side of the handheld device) trigger 1016. Similar to the previous example, these user action triggers can be detected by receiving one or more sensor inputs from sensors configured in various parts of the handheld device. If any of these triggers are detected, the process 1000 performs a series of check conditions to determine whether to exit the one-handed operation mode. The check conditions may include: a threshold horizontal state change 1022 within a time period, a sensor detection of one-handed operation 1024, a previous user interface movement 1026, and a horizontal state change 1028 opposite to the user interface movement. In an example, the order of the check conditions of the sensor detection of one-handed operation 1024 and the previous user interface movement 1026 can be reversed. If all conditions are met, the handheld device can be configured to exit the specific one-handed operation mode and restore the user interface to a default position or a previous position 1032. If any of these conditions are not met, process 1000 can be configured to ignore the user action trigger 1034.

[0078] Although specific embodiments are fully described above, various modifications, alternative constructions and equivalents may be used. Therefore, the above descriptions and illustrations should not be taken as limiting the scope of the invention, which is defined by the appended claims.

Claims

1. A handheld system, include: case; A touch screen disposed on the front side of the housing, the touch screen comprising a first one-hand display area; a first sensor disposed on a left side of the housing, the first sensor configured to generate a first sensor reading; a second sensor disposed on a right side of the housing, the second sensor configured to generate a second sensor reading; a memory configured to store display preference data; as well as a processor coupled to the first sensor and the second sensor, the processor configured to: processing the display preference data; selecting a one-handed operation mode based on at least the first sensor reading and the second sensor reading; and The user interface is moved to the first one-hand display area.

2. The handheld system of claim 1, wherein the processor comprises a central processing unit and a graphics processing unit, the graphics processing unit being coupled to the touch screen. The handheld system of claim 1 , wherein the first sensor comprises a pressure sensor. The handheld system of claim 1 , wherein the first sensor comprises a pressure sensor.

5. The handheld system of claim 1, wherein the first sensor comprises a capacitive sensor.

6. The handheld system of claim 1, further comprising an accelerometer, the processor being configured to move the user interface to a second one-hand display area based on input from the accelerometer.

7. The handheld system of claim 1, wherein the processor is further configured to update the display preference data based on user input received from the touch screen.

8. The handheld system of claim 1, wherein the processor is further configured to select between a left-hand mode and a right-hand mode based on the first sensor reading and the second sensor reading.

9. The handheld system of claim 8, wherein the touch screen further comprises a second one-hand display area, the first one-hand display area being associated with the right-hand mode, and the second one-hand display area being associated with the left-hand mode.

10. The handheld system of claim 1, wherein the user interface comprises one or more controls.

11. The handheld system of claim 1, further comprising a communication module configured to transmit the display preference data to a server.

12. The handheld system of claim 1, wherein the processor comprises a neural processing unit configured to update the display preference data based on user input.

13. A method of operating a handheld system, the method include: displaying a user interface on the first area and the second area of ​​the touch screen; receiving a first input from a first side sensor disposed on a first side of the housing; receiving a second input from a second side sensor disposed on a second side of the housing; Retrieve display preference data from storage; processing the first input and the second input; selecting a one-handed operation mode based on the first input and the second input; selecting the first area of ​​the touch screen based on the one-handed operation mode and the display preference data; removing the user interface from the second area of ​​the touch screen based on the one-handed operation mode and the display preference data; as well as User input is received within the first area of ​​the touch screen.

14. The method according to claim 13, further comprising: include: Upon receiving an indication of a change in horizontality, the user interface is displayed in the first area and the second area of ​​the touch screen.

15. The method according to claim 13, further comprising: include: The user interface is shifted or scaled to the first area of ​​the touch screen.

16. The method according to claim 13, further comprising: include: A control item position on the touch screen is determined.

17. The method according to claim 16, further comprising: include: The distance between the control location and the thumb is determined.

18. A method for calibrating an input mode for operating a handheld device, the method include: Provide touch screen; Displaying a calibration interface on the touch screen; Create display preference profiles based on pre-defined templates; receiving user input in a one-handed mode on the touch screen during a first time period; receiving a first side sensor input from a first side sensor during the first time period, the first side sensor being disposed on a first side of the handheld device; receiving a second side sensor input from a second side sensor during the first time period, the second side sensor being disposed on a second side of the handheld device; as well as The display preference profile is updated using at least the first side sensor input and the second side sensor input.

19. The method according to claim 18, further comprising: include: The display preference profile is updated based on a third side sensor input received from the first side sensor during a second time period.

20. The method according to claim 18, further comprising: include: Processes pressure readings from the user's finger.

Images