Method and system for operating a handheld device with a side sensor

Abstract

The invention relates to a handheld computing device and a method thereof. In a particular embodiment, the present invention provides a handheld device comprising two sensor matrices located on two different sides of the handheld device. Input received from the two sensor matrices is used to generate gesture input. Other embodiments are also provided.

Description

Background Art

[0001] Over the past two decades, handheld devices such as cell phones and small tablet computers have become ubiquitous. Handheld devices often include a touch screen that serves as both an output display and an interface for receiving user input. While large displays are almost always welcome, large touch screens are often difficult for users to operate, especially with one hand. Furthermore, the buttons arranged on the sides of handheld devices are not standardized between handheld devices from different manufacturers, forcing users to relearn the button locations for new devices. While various solutions exist to make one-handed operation easier for users, as described below, these solutions are far from perfect.

[0002] Therefore, there is a need for new and improved methods and systems for operating handheld devices. Summary of the invention

[0003] The present invention relates to handheld computing devices and methods thereof. In a specific embodiment, the present invention provides a handheld device comprising two sensor matrices located on two different sides of the handheld device. Inputs received from the two sensor matrices are used to generate gesture inputs. There are other embodiments.

[0004] Embodiments of the present invention can be implemented in conjunction with existing systems and processes. For example, the present device configuration and its related operating methods according to the present invention can be used in various systems, including mobile phones, tablet computers, and other mobile devices. In addition, various techniques according to the present invention can be applied to existing systems through integrated circuit manufacturing, mobile operating software, and wireless communication protocols. There are other benefits.

[0005] The system can be used to perform specific operations or behaviors by installing software, firmware, hardware, or a combination thereof on the system, which software, firmware, hardware, or a combination thereof causes the system to perform these behaviors when in operation. One or more computer programs can be used to perform specific operations or behaviors by including instructions that, when executed by a data processing device, cause the device to perform these behaviors. A general aspect includes a handheld computer device, which includes a housing, and the housing can include a front side, a first side, and a second side. The device also includes a screen configured on the front side of the housing; the screen can include a touch panel and a display. The device also includes a first sensor matrix configured on the first side; the first sensor can include a first plurality of sensors. The device also includes a second sensor matrix configured on the second side; the second sensor matrix can include a second plurality of sensors. The device also includes a memory for storing user profiles and executable instructions. The device also includes a processor coupled to the first sensor matrix and the second sensor matrix, the processor for: processing a first input received from the first sensor matrix using executable instructions, processing a second input received from the second sensor matrix using executable instructions, and determining a gesture input using at least the first input and the second input. Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each for performing the actions of the method.

[0006] Implementations may include one or more of the following features. The first side and the second side of the handheld computer device are substantially flat and free of physical buttons. The first side may include an opening for the physical buttons. The handheld computer device may include a third sensor matrix configured on a third side of the housing. The handheld computer device may include a fingerprint sensor configured on the first side. The first plurality of sensors may include a pressure sensor, the processor is used to process a pressure reading from the pressure sensor, and the gesture input is based at least on the pressure reading. The handheld computer device may include a communication module for sending user profile information generated using at least the first input and the second input. The processor is used to update the user profile based at least on the first input and the second input. The first side may include one or more physical tactile elements at a predetermined position. The handheld computer device may include a motor, the processor is used to cause the motor to vibrate in response to the first input. The processor is used to process a third input received from the first sensor matrix, the first input and the third input are separated by a time interval, and the gesture input is based at least on the time interval. Implementations of the technology may include hardware, methods or processes, or computer software on a computer-accessible medium.

[0007] One general aspect includes a method for operating a handheld computing device. The device includes receiving a first input from a first sensor matrix at a first time. The first input may include a first position value and a first duration value. The method includes receiving a second input from a second sensor matrix at a second time; the second input may include a second position value and a second duration value. The method also includes determining a first number of fingers using at least the first input. The method also includes selecting a first set of active fingers from the first number of fingers. The method also includes determining a second number of fingers using at least the second input. The method also includes selecting a second set of active fingers from the second number of fingers. The method also includes calculating a first interval between the first time and the second time. The method also includes determining a gesture based at least on the first set of active fingers, the second set of active fingers, and the first interval. Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each for performing the actions of the method.

[0008] Implementations may include one or more of the following features. The method may include processing a pressure value using at least a first input, comparing the pressure value to a predetermined threshold, and selecting a secondary gesture input mode for a pressure value below the predetermined threshold. The method may include receiving and processing a third input from a third sensor matrix, the third sensor matrix configured on the top surface. The method may include activating a motor to generate a tactile vibration. The method may include obtaining a user profile, and updating the user profile based on at least the first input and the second input. The second gesture is based on the third input. The gesture is also based on the first duration value. Implementations of the technology may include hardware, methods or processes, or computer software on a computer-accessible medium.

[0009] A general aspect includes a method for operating a handheld computing device. The device includes receiving a first input from a first sensor matrix at a first time. The first input may include a first position value and a first pressure value. The method includes receiving a second input from a second sensor matrix at a second time; the second input may include a second position value and a second pressure value. The method also includes selecting a first set of active fingers for input based at least on the first position value and the first pressure value. The method also includes filtering the second input using at least the second position value and the second pressure value. The method also includes determining a gesture based at least on the first set of active fingers and the first pressure value. Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each for performing the actions of the method.

[0010] Implementations may include one or more of the following features. The method may include comparing a first pressure value to a first threshold value, and comparing a second pressure value to a second threshold value. Implementations of the technology may include hardware, a method or process, or computer software on a computer-accessible medium.

[0011] It should be appreciated that embodiments of the present invention have many advantages over conventional techniques. In addition, the present invention provides configurations and methods for handheld devices that allow a user to use various holding gestures in addition to using a touch screen to perform functions on the device. Gesture-based functions may be particularly useful when certain portions of the touch screen are difficult to reach. In addition, the present invention implements a flexible method to configure and calibrate gestures that can be stored as user profiles. There are other benefits as well.

[0012] The present invention achieves these and other advantages in the context of known technology.However, the nature and advantages of the present invention may be further understood with reference to the latter part of the specification and the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a simplified block diagram illustrating a handheld device according to an embodiment of the present invention.

[0014] Figure 2 is a functional block diagram illustrating components of a handheld device according to an embodiment of the present invention.

[0015] Figure 3 is a simplified flow chart illustrating a method of operating a handheld device using input from multiple locations according to an embodiment of the present invention.

[0016] Figure 4 is a simplified flow chart illustrating a method of operating a handheld device using selective input according to an embodiment of the present invention.

[0017] Figure 5A is a simplified block diagram illustrating a handheld device configured with a sensor matrix according to an embodiment of the present invention.

[0018] Figure 5B is a simplified block diagram illustrating a handheld device configured with a sensor bar in accordance with an embodiment of the present invention.

[0019] Figure 6 is a simplified diagram showing a handheld computing device configured with motors and tactile features in accordance with an embodiment of the present invention.

[0020] Figures 7 to 14 is a simplified diagram illustrating operation of a handheld device using gesture input according to an embodiment of the present invention. DETAILED DESCRIPTION

[0021] The present invention relates to handheld computing devices and methods thereof. In a specific embodiment, the present invention provides a handheld device comprising two sensor matrices located on two different sides of the handheld device. Inputs received from the two sensor matrices are used to generate gesture inputs. There are other embodiments.

[0022] As described above, it may be difficult to operate a handheld device with a large touch screen. In particular, when a user operates a handheld device with one hand, the user's thumb is usually short and cannot conveniently reach the other side of the touch screen. Therefore, the present invention provides a configuration and method of a handheld device that allows a user to use a grip gesture to perform a desired function. In addition, the user can perform gesture-based functions without seeing the touch screen, which increases the flexibility of use.

[0023] It should be appreciated that embodiments of the present invention provide improved methods and systems for operating handheld devices. By using a sensor matrix, embodiments of the present invention can determine one or more touch points of a user's hand on a mobile phone and the relative pressure of each touch point. By configuring these sensors in different parts of the device housing, the handheld device can determine various user gestures that can trigger different operating modes, such as a one-handed operating mode to make it easier for the user's thumb to access specific controls of the user interface. For example, the handheld device may also include a horizontal sensor matrix that can be used to determine the horizontal state of the mobile phone and determine a specific operating mode.

[0024] The following description is provided to enable one of ordinary skill in the art to make and use the invention and to incorporate the invention into the context of a particular application. Various modifications and various uses in different applications will be apparent to those skilled in the art, and the general principles defined herein may be applied to a wide range of embodiments. Therefore, the present invention is not intended to be limited to the embodiments provided, but rather to conform to the widest scope consistent with the principles and novel features disclosed herein.

[0025] In the following detailed description, many specific details are set forth to provide a more thorough understanding of the present invention. However, it is apparent to those skilled in the art that the present invention may be practiced without being limited to these specific details. In other cases, well-known structures and devices are shown in block diagram form rather than in detail to avoid obscuring the present invention.

[0026] The reader is advised to pay attention to all papers and documents filed at the same time as this specification and disclosed with this specification, and the contents of all such papers and documents are incorporated herein by reference. Unless otherwise expressly stated, all features disclosed in this specification (including any accompanying claims, abstracts, drawings) can be replaced by alternative features serving the same, equivalent, or similar purposes. Therefore, unless otherwise expressly stated, each feature disclosed is only an example of a series of equivalent or similar features.

[0027] In addition, any element in a claim that does not explicitly state a “means” for performing a particular function or a “step” for performing a particular function should not be construed as a “means” or “step” clause as provided in 35 U.S.C. § 112, paragraph 6. In particular, the use of “step” or “act” in the claims herein is not intended to introduce the provisions of 35 U.S.C. § 112, paragraph 6.

[0028] Note that if labels such as left, right, front, back, up, down, positive, negative, clockwise, counterclockwise, etc. are used, these labels are used for convenience only and do not imply any particular fixed direction. Instead, these labels are used to reflect the relative position and / or direction of the parts of the object.

[0029] Figure 1 1 is a simplified block diagram illustrating a handheld device according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0030] As shown, device 100 can be configured in housing 110, and can include touch screen 120, first sensor 131, second sensor 132, memory 140, and processor 150. Touch screen 120 can be configured on the front of housing 110, and first sensor 131 and second sensor 132 can be configured on the first side and second side of housing respectively. These sensors can also be configured as a sensor matrix with multiple sensors. As shown in dotted cross section 101, memory 140 and processor 150 can be configured in housing 110 (for example, in integrated circuit device etc.). In addition, processor 150 can be coupled to touch screen 120, sensors 131 and 132, and memory 140 to communicate between these device elements.

[0031] In an example, the first sensor 131 can be used to generate at least a first sensor reading, and the second sensor 132 can be used to generate at least a second sensor reading. Each of the first sensor and the second sensor may include a pressure sensor, a capacitive sensor, or other touch sensors and combinations thereof. These sensors can be used to detect and process pressure readings of a user's finger. In other cases, the device 100 may include one or more additional sensors that generate one or more additional sensor readings. The memory 140 can be used to store display preference data, user profiles, executable instructions, etc. The memory 140 may include various memory devices, such as random-access memory (RAM), flash memory, etc.

[0032] The processor 150 may be used to process display preference data, select a one-handed operation mode based on at least the first sensor reading and the second sensor reading, and move the user interface to one or more one-handed display areas. The processor 150 may also be used to process one or more inputs received from the sensor matrix using executable instructions, and determine gesture input using one or more of the above inputs. In other cases, the processor 150 may receive multiple sensor inputs from multiple sensors configured in different parts of the housing 110, process the multiple sensor inputs using executable instructions, and determine gesture input using the multiple sensor inputs.

[0033] In a specific example, the processor 150 can be used to select between the left-hand holding mode and the right-hand holding mode based on the first sensor reading and the second sensor reading. For example, the calibration application can prompt the user to hold the device 100 with the left hand or the right hand on the display of the touch screen 120, and operate the phone with the thumb of the holding hand. In this case, the first sensor is configured on the left side of the housing 110, and the second sensor is configured on the right side of the housing 110. In addition, the touch screen 120 may include a first single-hand display area associated with the left-hand holding mode, and a second single-hand display area associated with the right-hand holding mode.

[0034] In addition, the processor 150 can be used to move the user interface to one or more display areas based on one or more inputs from one or more additional sensors such as an accelerometer, a gyroscope, a magnetometer, a level sensor, a fingerprint sensor, or other sensors and combinations thereof. In other cases, the device 100 may include multiple sensors or sensor matrices that can be configured in various parts of the housing 110 (e.g., the left side, right side, top, bottom, front, and back). These sensors can all provide sensor readings that can be used to determine the desired operating mode and move the user interface to the desired display area of ​​the touch screen, as well as other processes.

[0035] In an example, the user interface may include one or more controls, such as buttons, icons, text fields, interactive elements, and the like. Depending on the operating mode, the user interface may move, scale, or otherwise transform as it moves toward a particular display area. The position of one or more controls may also be used as an input to determine how the user interface transforms. For example, one or more of these sensors may be used to determine the distance from the user's thumb to the control, which may be used as an input to determine the type of operating mode or the extent to which the user interface transforms. Other holding gestures determined by one or more sensor inputs may also be used to trigger different operating modes in which the user interface transforms to provide the user with more convenient access to controls.

[0036] In an example, the handheld device 100 can be configured such that the first side and the second side are substantially flat and have no physical buttons. Alternatively, various portions of the housing 110 can have openings for one or more physical buttons. The handheld device 100 may include one or more physical tactile elements at predetermined locations. The absence of physical buttons (e.g., volume buttons, power on / off buttons, etc.) on the edge of the handheld device can reduce manufacturing costs and maintain smooth edges that are aesthetically pleasing and comfortable to hold.

[0037] Figure 2 1 is a functional block diagram illustrating components of a handheld device according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0038] As shown in the figure, Figure 2 The handheld device according to the invention is extended, for example Figure 1The device 100 of the present invention may include internal and external components. These components are configured to the housing 201 and may include a central processing unit (CPU) 210 coupled to a graphics processing unit (GPU) 212, and a touch screen including a display 220 and a screen touch sensor 222. For example, the CPU 210, the neural processing unit (NPU) 214, and the GPU 212 may be components of an integrated processor, each having multiple processing cores. Here, the CPU 210 is coupled to the screen touch sensor 222, the auxiliary hand sensor 230, and the accelerometer 232, as described above, which can provide sensor input to determine user gestures and device operation modes. In addition, the CPU 210 is coupled to the motor 234, which can be used to provide tactile feedback to the user (e.g., in response to sensor input, user gestures, etc.). In a specific embodiment, the motor 234 is used to provide directional feedback based on user input and / or hand position. The GPU 212 can be coupled to the display 220 and the camera 250. Furthermore, the GPU 212 may be used to send various forms of user interfaces to the display 220 according to the operation mode.

[0039] As previously described, the CPU 210 may also be used to update the display preference data in the memory 260 based on the user input received from the touch screen. In a specific example, the CPU 210 is also coupled to the NPU 214, which is used to update the display preference data based on the user input, which may be received through the screen touch sensor 222 or Figure 1 In a specific example, the NPU 214 can be used to learn the user's holding gesture through one or more of the sensors in the device 200. Such gesture data can also be stored in the memory 260. For example, the memory 260 can store multiple user profiles and calibrate and optimize gesture input accordingly. Here, the memory 260 is coupled to the CPU 210, the GPU 212, the NPU 214, the display 220, and the screen touch sensor 222.

[0040] Device 200 may also include a communication module 240, which is coupled to CPU 210 and is used to send display preference data to a server. This communication module 240 can be used for mobile data, Wi-Fi, Bluetooth, etc. In an example, the communication module is used to send user profile information generated using one or more inputs, and the one or more inputs come from one or more sensor matrices configured in the handheld device. The implementation of the technology may include hardware, methods or processes, or computer software on a computer-accessible medium. Of course, these device elements and their configurations may have other variations, modifications, and alternatives.

[0041] Figure 3 is a simplified flow chart illustrating a method of operating a handheld device using input from multiple locations according to an embodiment of the present invention. This figure is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications. For example, one or more steps may be added, removed, repeated, substituted, modified, rearranged, and / or overlapped, and these steps should not limit the scope of the claims.

[0042] According to an example, the handheld device may include at least a first sensor matrix configured on a first side and a second sensor matrix configured on a second side. As shown, the method 300 includes step 302, receiving a first input from the first sensor matrix at a first time. The first input includes a first position value and a first duration value. At step 304, the method includes receiving a second input from the second sensor matrix at a second time. The second input includes a second position value and a second duration value.

[0043] In steps 306 and 308, the method includes: determining a first number of fingers using at least a first input, and selecting a first set of active fingers from the first number of fingers. In steps 310 and 312, the method includes: determining a second number of fingers using at least a second input, and selecting a second set of active fingers from the second number of fingers.

[0044] The method may also include receiving and processing one or more additional inputs from additional sensor matrices that may be configured at various locations on the handheld device. These inputs may be used to determine an additional number of fingers that may be used to select an additional set of active fingers. For example, the method 300 may include receiving and processing a third input from a third sensor matrix configured on the top surface of the device that may be used to determine a third number of fingers to select a third set of active fingers.

[0045] In an example, the method may include processing one or more pressure values ​​using one or more of a sensor matrix input (e.g., a pressure sensor matrix or a sensor matrix having one or more pressure sensors). The pressure value may be compared to a predetermined threshold to determine whether to select a secondary gesture input mode (e.g., below a threshold or above a threshold).

[0046] At step 314, the method includes calculating a first interval between the first time and the second time. At step 316, the method includes determining a gesture based on at least the first set of active fingers, the second set of active fingers, and the first interval. The gesture may also be based on the first duration value, the second duration value, or both. In the case of additional sensor inputs, additional sets of active fingers, additional intervals, and additional duration values ​​may be used to determine a gesture. For example, a finger press duration value may be used to decide between a long press and a short press (or even an unintentional press).

[0047] Method 300 may include obtaining a user profile (e.g., from a memory) and updating the user profile based on one or more of the sensor matrix inputs. In a specific example, the user profile may be updated based on at least a first input and a second input. Method 300 may also include activating a motor to generate a tactile vibration. A motor configured in the handheld device may be used to cause a tactile vibration in response to one or more inputs or a determined gesture.

[0048] Figure 4 1 is a simplified flow chart illustrating a method of operating a handheld device using selective input according to an embodiment of the present invention. For example, one or more steps may be added, removed, repeated, substituted, modified, rearranged, and / or overlapped, and these steps should not limit the scope of the claims.

[0049] Similar to the previous example, the handheld device may include a first sensor matrix configured on at least a first side and a second sensor matrix configured on a second side. As shown, method 400 includes step 402, receiving a first input from the first sensor matrix at a first time. The first input includes a first position value and a first pressure value. In step 404, the method includes receiving a second input from the second sensor matrix at a second time. The second input includes a second position value and a second pressure value. In some embodiments, the sensor matrix is ​​implemented using a touch sensor, and finger movement is used as input.

[0050] At step 406, the method includes selecting a first set of active fingers for input based on at least the first position value and the first pressure value. At step 408, the method includes filtering the second input using at least the second position value and the second pressure value. At step 410, the method includes determining a gesture based on at least the first set of active fingers and the first pressure value. The method may also include comparing the first pressure value to a first threshold value, and comparing the second pressure to a second threshold value. These thresholds may be used to exclude "non-input" fingers by filtering out input from those fingers based on their pressure values.

[0051] As described in method 300, additional inputs may be obtained from additional sensor matrices configured within the handheld device. These additional inputs may be used to select additional sets of active fingers to determine a gesture. These additional inputs may also be filtered based on pressure values ​​in this manner. More details regarding these methods and handheld devices will be discussed in conjunction with subsequent figures.

[0052] Figure 5A 1 is a simplified block diagram illustrating a handheld device configured with a sensor matrix according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0053] As shown, handheld device 501 includes housing 510 and touch screen display 520. Device 501 also includes a sensor matrix arranged around the edge of the housing. The sensor matrix may include a plurality of sensors 530, which are individually arranged within the edge of the housing, or these sensors may be arranged in sensor strips arranged along the edge (see Figure 5B The sensor may include a touch sensor, a pressure sensor, a fingerprint sensor, etc., and a combination thereof.

[0054] Figure 5B is a simplified block diagram showing a handheld device configured with a sensor bar according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0055] As shown, handheld device 502 includes housing 510 and touch screen display 520. Device 502 shows an example configuration with sensor bar 531 in the edge of the housing. Devices 501 and 502 can also be configured to be similar to the handheld device examples discussed previously. According to the example, the present invention provides a handheld device with a sensor matrix configuration, which can support custom gestures to create different shortcuts when the user operates the device. Using the settings application, the user can (for example, using user profile data) add, change, or delete any gesture and its function. And, using a software development kit (SDK), developers can integrate new gestures into the application of this type of handheld device according to the example of the present invention.

[0056] Figure 6 is a simplified diagram showing a handheld computing device configured with a motor and tactile features according to an embodiment of the present invention. This diagram is merely an example and should not unduly limit the scope of the claims. Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0057] As shown, the handheld device 600 includes a housing 610 in which a vibration motor 620 is configured. In an example, one or more motors 620 can be used to provide tactile feedback to one or more areas of the housing 610. Here, there is a first vibration motor 620 configured to face the top side, and there is a second vibration motor 620 configured to face the bottom side. The first vibration motor 620 can be used to provide tactile feedback to an upward vibration area 632, and the second vibration motor 620 can be used to provide tactile feedback to a downward vibration area 634. In a specific example, these motors 620 are configured near the corners of the housing 610. In other embodiments, there may be additional motors 620, which are used to provide feedback to different parts of the housing 610 designated as separate vibration areas.

[0058] In an example, the device 600 may also include one or more sensors configured along and within the edge of the housing 610. Here, the fingerprint sensor 642 is configured toward the upper right side, while the pressure / touch sensor 644 is configured toward the lower right side. Configuring the fingerprint sensor 642 in this manner may be more advantageous than a fingerprint sensor disposed at the bottom of the touch screen, which may suffer from reduced accuracy and response time. Figure 6Also shown are sensor pins 630 connected to sensors 642 and 644. These pins 630 can be connected to other internal components of the handheld device 600, which can be configured similarly to the examples discussed previously. The housing 610 can also include one or more protrusions 652 or ridges 654 located near or overlapping one or more of the sensors. These protrusions 652 and ridges 654 can help the user locate designated areas of the housing 610 to properly position the user's fingers to perform a desired gesture.

[0059] In various embodiments, the present invention also provides methods for operating the previously discussed handheld device using various unique gestures. These gestures may include, but are not limited to, the following: pressing at multiple locations, the duration of pressing, sliding, the intensity of pressing, the duration of pressing, and combinations and sequences thereof. Figures 7 to 14 7 is a simplified diagram showing a handheld device having a housing 710 and a touch screen 720 operated using gesture input according to an embodiment of the present invention. These diagrams are merely examples and should not unduly limit the scope of the claims (e.g., a right-hand configuration may be swapped for a left-hand configuration). Those of ordinary skill in the art will recognize many variations, alternatives, and modifications.

[0060] Figure 7 An example swipe gesture that may be performed on the device 700 in the right-handed mode of operation is shown. Here, a user's thumb may perform a swipe gesture along the right side of the housing 710, while a user's index finger may perform a swipe gesture along the left side of the housing 710. In an example, swipes on different areas of the housing 710 may be specified to change setting values ​​(e.g., volume and screen brightness), move the focus of a user interface displayed on the screen, change input values ​​(e.g., fine-tune a key or scroll bar), etc.

[0061] Figure 8 An example squeeze gesture that can be performed on the device 800 in the right-handed operating mode is shown. Here, the user's thumb and index finger can perform a squeeze gesture (i.e., press simultaneously) from the left and right sides of the housing 710. In an example, the squeeze gesture can be used to perform a back action, close the current conversation, etc.

[0062] Fig. 9 An example tap gesture that can be performed on the device 900 in the right-hand operation mode is shown. Here, the user's index finger can perform a double-click gesture on the top side of the housing 710. Alternatively, the user can also perform a long press from the top side. In the example, the double-click gesture or the long press gesture can be used to launch a camera application, activate silent mode, execute a shortcut, launch a browser application, launch a video streaming application, turn off lights through a smart home application, etc.

[0063] Fig.10An example push / pull gesture on the device 1000 in a two-handed operation mode is shown. Here, the user's right hand can perform a squeeze gesture on one side of the device 1000, while the user's left hand can perform a pull gesture away from the right hand or a push gesture toward the right hand. In an example, the push / pull gesture can be used to disable airplane mode, turn on a flashlight, extract a QR code from an image, trigger a share action from an application, open a settings menu, etc.

[0064] Fig.11 An example long squeeze gesture is shown on the device 1100 in the right-handed operating mode. Here, the user's right hand can perform a squeeze gesture from the left and right sides of the housing 710 to the top corners of the device 1100. In an example, this long squeeze gesture can be used to turn the device on and off, turn the flash on and off, etc.

[0065] Fig.12 An example push / pull gesture on the device 1200 in a two-handed operation mode is shown. Here, both the right and left hands of the user can perform a squeeze gesture at different ends of the device 1200. In addition, the left or right hand can also perform a push-pull gesture. In an example, the push / pull gesture can be used to launch a camera application, enter a video capture mode, etc.

[0066] Fig.13 An example multi-press gesture on the device 1300 in the right-hand operation mode is shown. Here, the user's index finger can perform a normal press gesture on the upper left side of the housing 710, and the user's ring finger can perform a long deep press on the lower left side of the housing 710. In an example, the multi-press gesture can be used to open a pop-up menu, display a settings menu, unlock the screen mode, make an emergency call, etc.

[0067] Fig.14 An example multi-gesture sequence on device 1400 in right-handed operation mode is shown. Here, the sequence may include: (1) the user's thumb swipes down on the right side of housing 710, (2) the user's thumb double-clicks on the right side of housing 710, and the user's thumb and middle finger squeeze housing 710 from the left and right sides. These gestures are shown in FIG. Fig.14 In the example, this gesture sequence can be used to lock / unlock the screen. Any of the previous gestures and their different combinations / sequences can also be used to perform any device functions discussed previously.

[0068] While the above is a complete description of specific embodiments, various modifications, alternative constructions, and equivalents may be used. Therefore, the above descriptions and illustrations should not be taken as limiting the scope of the invention, which is defined by the appended claims.

Claims

1. A handheld computer device comprising: A housing, comprising a front side, a first side side, and a second side side; A screen disposed on the front surface of the housing, the screen comprising a touch panel and a display; a first sensor matrix disposed on the first side, the first sensor comprising a first plurality of sensors; a second sensor matrix disposed on the second side, the second sensor matrix comprising a second plurality of sensors; A memory for storing user profiles and executable instructions; as well as a processor coupled to the first sensor matrix and the second sensor matrix, the processor configured to: processing, using the executable instructions, a first input received from the first sensor matrix; processing, using the executable instructions, a second input received from the second sensor matrix; as well as A gesture input is determined using at least the first input and the second input.

2. The handheld computer device according to claim 1, wherein: The first side surface and the second side surface are substantially flat and have no physical buttons.

3. The handheld computer device of claim 1, wherein: The first side includes an opening for a physical button.

4. The handheld computer device of claim 1, further comprising a third sensor matrix disposed on a third side of the housing.

5. The handheld computer device of claim 1, further comprising a fingerprint sensor disposed on the first side.

6. The handheld computer device of claim 1, wherein: The first plurality of sensors includes a pressure sensor, the processor is configured to process pressure readings from the pressure sensor, and the gesture input is based at least on the pressure readings.

7. The handheld computer device of claim 1, further comprising a communication module for transmitting user profile information generated using at least the first input and the second input.

8. The handheld computer device of claim 1, wherein: The processor is configured to update the user profile based on at least the first input and the second input.

9. The handheld computer device of claim 1, wherein: The first side includes one or more physical tactile elements at predetermined locations.

10. The handheld computer device of claim 1, further comprising a motor, the processor being operable to cause the motor to vibrate in response to the first input.

11. The handheld computer device of claim 1, wherein: The processor is configured to process a third input received from the first sensor matrix, the first input and the third input are separated by a time interval, and the gesture input is based at least on the time interval.

12. A method for operating a handheld computing device, the handheld computing device comprising a first sensor matrix configured on a first side and a second sensor matrix configured on a second side, the method comprising: receiving a first input from the first sensor matrix at a first time, the first input comprising a first position value and a first duration value; receiving a second input from the second sensor matrix at a second time, the second input comprising a second position value and a second duration value; determining a first number of fingers using at least the first input; selecting a first set of active fingers from the first number of fingers; determining a second number of fingers using at least the second input; selecting a second set of active fingers from the second number of fingers; calculating a first interval between the first time and the second time; as well as A gesture is determined based at least on the first set of active fingers, the second set of active fingers, and the first interval.

13. The method according to claim 12, further comprising: processing the pressure value using at least said first input; comparing the pressure value with a predetermined threshold; as well as For the pressure value below the predetermined threshold, a secondary gesture input mode is selected.

14. The method of claim 12, further comprising receiving and processing a third input from a third sensor matrix disposed on the top surface.

15. The method of claim 12, further comprising activating a motor to generate haptic vibrations.

16. The method according to claim 12, further comprising: Get user profile; as well as The user profile is updated based on at least the first input and the second input.

17. The method of claim 12, further comprising receiving a third input from a touch screen, wherein: The second gesture is based on the third input.

18. The method according to claim 12, wherein: The gesture is also based on the first duration value.

19. A method for operating a handheld computing device, the handheld computing device comprising a first sensor matrix configured on a first side and a second sensor matrix configured on a second side, the method comprising: receiving a first input from the first sensor matrix at a first time, the first input comprising a first position value and a first pressure value; receiving a second input from the second sensor matrix at a second time, the second input comprising a second position value and a second pressure value; selecting a first set of active fingers for input based at least on the first position value and the first pressure value; filtering the second input using at least the second position value and the second pressure value; as well as A gesture is determined based at least on the first set of active fingers and the first pressure value.

20. The method according to claim 19, further comprising: comparing the first pressure value with a first threshold; as well as The second pressure value is compared to a second threshold value.

Images