Computer device and gesture detection method

Abstract

A computer device and a gesture detection method are provided. The computer device includes a first body, a second body and a processor. The first body includes a first lens. The second body includes a second lens and is pivotally connected to the first body through a rotating mechanism. The first lens and the second lens have different detection ranges. When the processor does not receive an input signal provided by an input unit, the processor determines to activate a gesture recognition function of at least one of the first lens and the second lens based on an angle between the first body and the second body. When the processor receives the input signal provided by the input unit, the processor turns off the gesture recognition function of at least one of the first lens and the second lens.

Description

Technical Field

[0001] This invention relates to an assistive operation technology, and more particularly to a computer device and a gesture detection method. Prior Technology

[0002] Currently, most laptop users play games using only a basic mouse and keyboard. For more immersive or realistic gaming experiences, additional hardware is required, increasing costs and reducing portability. Summary of the Invention

[0003] This invention provides a computer device and a gesture detection method that can automatically recognize the user's gestures to perform corresponding operation functions.

[0004] The computer device with gesture detection function of the present invention includes a first body, a second body, and a processor. The first body includes a first lens. The second body includes a second lens and is pivotally connected to the first body via a rotating mechanism. The first lens and the second lens have different detection ranges. The processor is coupled to the first lens, the second lens, and an input unit and is disposed in the second body. When the processor does not receive an input signal provided by the input unit, the processor determines whether to activate the gesture recognition function of at least one of the first lens and the second lens based on the angle between the first body and the second body. When the processor receives an input signal provided by the input unit, the processor deactivates the gesture recognition function of at least one of the first lens and the second lens.

[0005] The gesture detection method of the present invention is applicable to a computer device. The computer device includes a first body and a second body. The first body includes a first lens. The second body includes a second lens and is pivotally connected to the first body via a rotating mechanism. The first lens and the second lens have different detection ranges. The gesture detection method includes the following steps: determining whether an input signal provided by an input unit is received; when no input signal is received, determining to activate the gesture recognition function of at least one of the first lens and the second lens based on the angle between the first body and the second body; and when an input signal is received, deactivating the gesture recognition function of at least one of the first lens and the second lens.

[0006] Based on the above, the computer device and gesture detection method of the present invention can realize gesture recognition function based on two lenses, and can determine whether to activate the gesture recognition function of at least one of the two lenses based on the usage state of the input unit.

[0007] To make the above features and advantages of the present invention more apparent and understandable, specific embodiments are described below in conjunction with the accompanying drawings for detailed explanation. Simple Explanation of the Diagram

[0008] Figure 1 is a circuit diagram of a computer device according to an embodiment of the present invention. Figure 2 is a schematic diagram of a computer device according to an embodiment of the present invention. Figure 3 is a flowchart of a gesture detection method according to an embodiment of the present invention. Figures 4A and 4B are schematic diagrams of multiple operating states of a computer device according to an embodiment of the present invention. Figure 5 is a flowchart of a gesture detection method according to an embodiment of the present invention. Figures 6A to 6C are schematic diagrams of various operating states of a computer device according to an embodiment of the present invention. Figure 7 is a schematic diagram of the operation state of a computer device according to an embodiment of the present invention. Figures 8 to 12 are schematic diagrams of various combined operation states of a computer device according to an embodiment of the present invention. Implementation

[0009] To make the contents of this invention more readily apparent, the following specific embodiments are provided as examples on which this invention can indeed be implemented. Furthermore, wherever possible, elements / components / steps using the same reference numerals in the drawings and embodiments represent the same or similar parts.

[0010] Figure 1 is a circuit diagram of a computer device according to an embodiment of the present invention. Referring to Figure 1, the computer device 100 includes a processor 110, a first lens 120, a second lens 130, an input unit 140, and a display unit 150. The processor 110 is coupled to the first lens 120, the second lens 130, the input unit 140, and the display unit 150. In this embodiment, the processor 110 can determine whether to capture the user's gestures through at least one of the first lens 120 and the second lens 130 based on the usage state of the computer device 100 and / or the usage state of the input unit 140, and automatically recognize the user's gestures.

[0011] In this embodiment, the processor 110 may include, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microprocessors, digital signal processors (DSPs), image processing units (IPUs), graphics processing units (GPUs), programmable controllers, application-specific integrated circuits (ASICs), programmable logic devices (PLDs), other similar processing devices, or combinations thereof.

[0012] In this embodiment, the first lens 120 and the second lens 130 may each include at least one of an RGB camera, a depth camera, and an infrared (IR) camera, but this invention is not limited thereto. In this embodiment, the input unit 140 may include at least one of a keyboard, a touchpad, and a mouse. In this embodiment, the display unit 150 may be a liquid crystal display (LCD), a light-emitting diode (LED), or an organic light-emitting diode (OLED), etc., and this invention is also not limited thereto.

[0013] Figure 2 is a schematic diagram of a computer device according to an embodiment of the present invention. Referring to Figures 1 and 2, the computer device 100 may be a notebook computer. The computer device 100 includes a first body 101, a second body 102, and a rotating mechanism 103. The second body 102 is pivotally connected to the first body 101 via the rotating mechanism 103. In this embodiment, the first body 101 may include a first lens 120 and a display unit 150, and the second body 102 may include a processor 110, a second lens 130, and a touch panel 160. In one embodiment, the processor 110 may also be disposed in the first body 101. In this embodiment, the first lens 120 and the second lens 130 have different detection ranges. In one embodiment, the touch panel 160 may also include a light-emitting unit for displaying, for example, a reminder pattern.

[0014] Figure 3 is a flowchart of a gesture detection method according to an embodiment of the present invention. Referring to Figures 1 to 3, in this embodiment, the computer device 100 can execute the following steps S310 to S330. In step S310, the processor 110 can determine whether it has received an input signal provided by the input unit 140. If not, in step S320, the processor 110 can determine whether to activate the gesture recognition function of at least one of the first lens 120 and the second lens 130 based on the angle between the first body 101 and the second body 102. In this embodiment, when the processor 110 does not receive an input signal provided by the input unit 140, the processor determines whether to activate the gesture recognition function according to two scenarios. Scenario 1: When the angle between the first body 101 and the second body 102 is greater than a preset angle threshold, the processor 110 disables the gesture recognition function of at least one of the first lens 120 and the second lens 130. Scenario 2: When the angle between the first body 101 and the second body 102 is less than or equal to a preset angle threshold, the processor 110 activates the gesture recognition function of the first lens 120 and the second lens 130. If so, in step S330, the processor 110 may disable the gesture recognition function of at least one of the first lens 120 and the second lens 130.

[0015] Referring to Figures 4A and 4B below, which are schematic diagrams of multiple operating states of a computer device according to an embodiment of the present invention. Specifically, referring to Figure 4A, the first lens 120 and the second lens 130 may have different detection ranges 401 and 402, respectively. As shown in Figure 4A, when the processor 110 does not receive an input signal provided by the input unit 140, and the angle between the first body 101 and the second body 102 is greater than a preset angle threshold ϴ1, it indicates that the user is not using the input unit 140. However, because the opening range of the first body 101 is too large (the detection range 401 may deviate from the user's gesture range, and the overlap range 403 is small), the first lens 120 may not easily detect the user's gesture. In this regard, the processor 110 may turn off the first lens 120 while keeping the second lens 130 active to detect the user's gesture. Alternatively, the processor 110 may also turn off both the first lens 120 and the second lens 130 simultaneously, requiring the user to perform related operations through a mouse or keyboard.

[0016] Additionally, when the processor 110 receives an input signal from the input unit 140, and the angle between the first body 101 and the second body 102 is greater than a preset angle threshold ϴ1, it indicates that at least one of the user's hands is not performing a gesture operation, and the first body 101 also has the problem of an excessively large opening range. In response, the processor 110 can also turn off the first camera 120 while maintaining the second camera 130 to detect the user's gestures. Alternatively, the processor 110 can simultaneously turn off both the first camera 120 and the second camera 130.

[0017] As shown in Figure 4B, when the processor 110 does not receive an input signal from the input unit 140, and the angle between the first body 101 and the second body 102 is less than or equal to a preset angle threshold ϴ1 and greater than or equal to a preset angle threshold ϴ2, it indicates that the user is not using the input unit 140, and the opening range of the first body 101 is appropriate. Therefore, the processor 110 can activate the gesture recognition function of the first lens 120 and the second lens 130. Additionally, when the angle between the first body 101 and the second body 102 is less than the preset angle threshold ϴ2, the processor 110 can deactivate the first lens 120 and the second lens 130. Furthermore, in one embodiment, the preset angle threshold ϴ1 may be, for example, 120 degrees, and the preset angle threshold ϴ2 may be, for example, 90 degrees, but the present invention is not limited thereto.

[0018] It is worth noting that, within the detection range 401 excluding the overlapping range 403, the processor 110 can independently identify the user's gesture operation through the first lens 120 to generate single gesture data. In this case, the first lens 120 may not have depth sensing capabilities. Within the detection range 402 excluding the overlapping range 403, the processor 110 can independently identify the user's gesture operation through the second lens 130 to generate single gesture data. In this case, the second lens 130 must have depth sensing capabilities. The processor 110 can use the second lens 130 to identify the user's keyboard control habits and the position of their fingers within the recognition area.

[0019] Within the overlapping area 403 of detection ranges 401 and 402, the overlapping area 403 is the overlapping recognition area. Processor 110 can jointly recognize gesture operations through first lens 120 and second lens 130. First lens 120 provides a first gesture image, and second lens 130 provides a second gesture image. Processor 110 generates first gesture data and second gesture data based on the first gesture image and the second gesture image. Processor 110 can combine (perform cross-comparison) the first gesture data and the second gesture data to generate complete gesture data.

[0020] Figure 5 is a flowchart of a gesture detection method according to an embodiment of the present invention. Figures 6A to 6C are schematic diagrams of various operating states of a computer device according to an embodiment of the present invention. Referring to Figures 1, 5, and 6A to 6C, Figures 5 and 6A to 6C are used to illustrate the application flow of the computer device 100 in the usage state of Figure 4B, where the user's hand is located in the detection range 401 or overlapping range 403 as shown in Figure 4B, and the user performs a gesture operation. In this embodiment, the computer device 100 can execute the following steps S501 to S511. In step S501, the user can operate the computer device 100 to cause the processor 110 to execute an application. In this embodiment, the application may be, for example, a shooting game program, a racing game program, etc., and the present invention is not limited to game programs. In step S502, the processor 110 detects the application type. In step S503, the processor 110 determines whether a gesture operation is possible. If not, in step S504, the processor 110 performs the operation through the input unit 140. The input unit 140 is, for example, a mouse or a keyboard. If so, in step S505, the processor 110 displays a gesture operation diagram through the display unit 150. As shown in FIG6A, the input unit 140 may include a light-emitting unit, and the input unit 140 may display a gesture prompt pattern 601 to remind the user to perform relevant gesture actions. In addition, the display unit 150 may display a system-preset gesture operation diagram 602 for the user to confirm or learn to use.

[0021] In step S506, the processor 110 determines whether the user's gesture is detected (or only the first lens 120 detects it) through the first lens 120 and the second lens 130. If not, in step S507, the processor 110 maintains the display of the gesture operation diagram 602 through the display unit 150. If yes, in step S508, the processor 110 determines whether the user has modified the gesture through the first lens 120 and the second lens 130. If yes, in step S509, the processor 110 updates the operation gesture according to the user's gesture and executes step S510. If not, in step S510, the processor 110 confirms the user's gesture. In step S511, the processor 110 performs the operation according to the user's gesture and generates corresponding control commands.

[0022] In other words, when the processor 110 activates the gesture recognition function of the first camera 120 and the second camera 130, the processor 110 can display gesture operation diagrams through the display unit 150. When the processor 110 detects a user's gesture through the first camera 120 and the second camera 130 (or only the first camera 120 detects it), the processor 110 first modifies or confirms a preset gesture, and then generates control commands based on the complete gesture data. In one embodiment, the control commands may be operation commands for game software, but the present invention is not limited to this. Additionally, in one embodiment, the complete gesture data may also include single-hand gesture data or two-hand gesture data.

[0023] Specifically, as shown in Figure 6B, the processor 110 can recognize that the user's gesture 610 matches the system's preset gesture operation icon 602 through the first lens 120 and the second lens 130. Therefore, the processor 110 can confirm the user's gesture and continue with subsequent application content. Conversely, as shown in Figure 6C, the processor 110 can recognize that the user's gesture 620 does not match the system's preset gesture operation icon 602 through the first lens 120 and the second lens 130. Therefore, the processor 110 can update the gesture, and the display unit 130 can display the corresponding new gesture operation icon 603. The user can selectively update one or more gestures by operating the computer device 100.

[0024] Figure 7 is a schematic diagram of the operation state of a computer device according to an embodiment of the present invention. Referring to Figures 1 and 7, Figure 7 is used to illustrate the user's hand performing gesture operation within the detection range 402 shown in Figure 4B when the computer device 100 is in the usage state of Figure 4B. In this embodiment, the second body 102 may have a keyboard area R1 and a palm rest area R2. The processor 110 can determine whether to turn off the gesture recognition function of the second lens 130 by judging a preset distance threshold between the user's finger projection in the keyboard area R1 and the second lens 130 through the second lens 130. The finger projection is the area covered by the user's finger in the orthogonal projection direction of the keyboard area R1 and the palm rest area R2.

[0025] In this embodiment, when the distance between the finger projection in the keyboard area R1 and the second lens 130 is less than a preset distance threshold, it indicates that the user's hand is close and the user is using the keyboard. Therefore, the processor 110 can disable the gesture recognition function of the second lens 130. Conversely, when the distance between the finger projection in the keyboard area R1 and the second lens 130 is greater than or equal to the preset distance threshold, it indicates that the user's hand is far away and the user intends to perform a gesture operation. In this case, the processor 110 can activate the gesture recognition function of the second lens 130.

[0026] In response, since different users may have different hand sizes and keyboard control habits, and if it is necessary to determine whether to calculate the motion data (i.e., gesture data) of the gesture image provided by the second lens 130 before typing, the relative position of the habitual key position in the keyboard area R1 and the proportion of the user's fingers entering the keyboard area R1 can be used as the criteria for determining image recognition permissions.

[0027] For example, in the operation area 701 shown in Figure 7, the user may habitually use the ASWD keys on the keyboard (roughly located in the middle of the keyboard area R1) to control the movement direction of the game character. Therefore, whether the user uses their left hand 710 or temporarily switches to their right hand 720 to control the game, when the second camera 130 captures more than half of the finger image within the keyboard area R1, the processor 110 will not recognize the gesture through the second camera 130.

[0028] For example, in the operation area 702 shown in Figure 7, the user uses the directional keys (closer to the palm rest area R2) to control the movement direction of the game character. Therefore, whether the user uses their right hand 720 or temporarily switches to their left hand 710, when the second camera 130 captures an image of the user's first half of a finger or at least three fingers within the keyboard area R1, the processor 110 will not recognize the gesture through the second camera 130.

[0029] Figures 8 to 12 are schematic diagrams illustrating various combined operation states of a computer device according to an embodiment of the present invention. Referring to Figures 1 and 8, the user can operate the game and use the conventional ASWD keyboard keys with one hand. In this regard, the processor 110 can identify that the user's left hand 810 fingers are located within the keyboard area R1 through the second lens 130; therefore, the processor 110 does not identify the user's left hand 810 gesture data through the second lens 130. Furthermore, the processor 110 can identify that the user's right hand 820 is performing a gesture through the first lens 120 and the second lens 130, and generate corresponding gesture data. The processor 110 can then assign the current operation permission to the gesture data corresponding to the user's right hand 820.

[0030] Referring to Figures 1 and 9, the user can operate the game with one hand and use the familiar ASWD keyboard keys. To this end, the processor 110 can identify that the user's left hand 910 fingers are located within the keyboard area R1 through the second camera 130; therefore, the processor 110 does not use the second camera 130 to identify the user's left hand 910 gesture data. Furthermore, when the processor 110 receives the input signal provided by the input unit 140, the processor 110 does not use the first camera 120 or the second camera 130 to identify the user's right hand 820, thus transferring the current operation authority to the input unit 140.

[0031] Referring to Figures 1 and 10, the user can type with both hands using the keyboard. The processor 110 can identify the location of the user's left hand 1010 and right hand 1020 fingers within the keyboard area R1 via the second lens 130; therefore, the processor 110 does not need to identify the gesture data of the user's left hand 1010 and right hand 1020 via the second lens 130. The processor 110 can receive input results from the keyboard.

[0032] Referring to Figures 1 and 11, the user can operate the game using both hands and use the familiar directional keys. To this end, the processor 110 can identify the user's left hand 1110 and right hand 1120 through the first camera 120 and the second camera 130. Therefore, the processor 110 identifies the gesture data of the user's left hand 1110 and right hand 1120 through the first camera 120 and the second camera 130. Furthermore, the processor 110 can assign the current operation authority to the gesture data corresponding to the user's left hand 1110 and right hand 1120.

[0033] Referring to Figures 1 and 12, the user can operate the game with one hand and use the familiar ASWD keyboard keys. To this end, the processor 110 can use the second camera 130 to identify that the user's left hand 1210 fingers are located within the palm rest area R2, and therefore the processor 110 uses the second camera 130 to identify the gesture data of the user's left hand 1210. Furthermore, the processor 110 can use the second camera 130 to identify that only a portion of the user's right hand 1220 fingers are located within the palm rest area R2, and therefore the processor 110 does not use the second camera 130 to identify the gesture data of the user's right hand 1220. Furthermore, the processor 110 can delegate the current operation authority to the gesture data corresponding to the user's left hand 1210.

[0034] In summary, the computer device and gesture detection method of the present invention can determine whether to activate two lenses based on the opening and closing degree of the first and second bodies of the computer device, and can determine whether to use at least one of the two lenses for gesture recognition based on the relative position of the user's hand and the computer device. This avoids misjudging hand postures when operating the keyboard or mouse, reduces unnecessary gesture recognition calculations, and minimizes the impact on computer performance. Furthermore, when the user operates the input unit, the operation priority can be given to the input unit.

[0035] Although the present invention has been disclosed above by way of embodiments, it is not intended to limit the present invention. Anyone skilled in the art can make some modifications and refinements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the appended claims.

[0036] 100: Computer devices 101: The First Machine 102: Second Unit 103: Rotating mechanism 110: Processor 120: First Shot 130: Second Shot 140: Input Unit 150: Display Unit 160: Touch panel 401, 402: Detection range 403: Overlapping Range 601: Gesture Prompt Pattern 602, 603: Gesture operation illustrations 610, 620: Gestures 701, 702: Operating Area 710, 810, 910, 1010, 1110, 1210: Left hand 720, 820, 920, 1020, 1120, 1220: Right hand R1: Keyboard area R2: Palm rest area ϴ1, ϴ2: Preset angle thresholds S310, S320, S330, S501~S511: Steps

Claims

1. A computer device with gesture detection function, comprising: A first body, including a first lens; A second body includes a second lens and is pivotally connected to the first body via a rotating mechanism, wherein the first lens and the second lens have different detection ranges; and a processor coupled to the first lens, the second lens, and an input unit and disposed in the second body, wherein when the processor does not receive an input signal provided by the input unit, the processor determines to activate the gesture recognition function of at least one of the first lens and the second lens based on the angle between the first body and the second body, wherein when the processor receives the input signal provided by the input unit, the processor deactivates the gesture recognition function of at least one of the first lens and the second lens.

2. The computer device as claimed in claim 1, wherein when the processor does not receive the input signal provided by the input unit and the angle between the first body and the second body is greater than a preset angle threshold, the processor disables the gesture recognition function of at least one of the first lens and the second lens.

3. The computer device as claimed in claim 2, wherein when the processor does not receive the input signal provided by the input unit and the angle between the first body and the second body is less than or equal to the preset angle threshold, the processor activates the gesture recognition function of the first lens and the second lens.

4. The computer device as claimed in claim 3, wherein the first lens is used to provide a first gesture image and the second lens is used to provide a second gesture image, wherein the processor generates first gesture data and second gesture data based on the first gesture image and the second gesture image, and the processor combines the first gesture data and the second gesture data to generate complete gesture data.

5. The computer device as described in claim 4, further comprising: A display unit is coupled to the processor and disposed on the first body. When the processor activates the gesture recognition function of the first lens and the second lens, the processor displays a gesture operation diagram through the display unit. When the processor detects a user gesture through the first lens and the second lens, the processor first performs preset gesture modification or preset gesture confirmation, and then generates a control command based on the complete gesture data.

6. The computer device as claimed in claim 5, wherein the control instruction is an operation instruction of a game software.

7. The computer device as claimed in claim 4, wherein the complete gesture data includes single-hand gesture data or double-hand gesture data.

8. The computer device as claimed in claim 1, wherein the second body has a keyboard area and a palm rest area, and the processor determines whether to disable the gesture recognition function of the second lens by determining a preset distance threshold between a user's finger projection on the keyboard area and the second lens through the second lens.

9. The computer device of claim 8, wherein when the distance between the finger projection in the keyboard area and the second lens is less than the preset distance threshold, the gesture recognition function of the second lens is turned off, wherein when the distance between the finger projection in the keyboard area and the second lens is greater than or equal to the preset distance threshold, the gesture recognition function of the second lens is turned on.

10. The computer device as claimed in claim 1, wherein the input unit includes at least one of a keyboard, a touchpad, and a mouse.

11. A gesture detection method for a computer device, wherein the computer device includes a first body and a second body, the first body includes a first lens, the second body includes a second lens, and the second body is pivotally connected to the first body via a rotating mechanism, wherein the first lens and the second lens have different detection ranges, and the gesture detection method includes: Determine whether an input signal provided by an input unit has been received; When no input signal is received from the input unit, the gesture recognition function of at least one of the first lens and the second lens is activated based on the angle between the first body and the second body; and when the input signal is received from the input unit, the gesture recognition function of at least one of the first lens and the second lens is deactivated.

12. The gesture detection method as claimed in claim 11, wherein the step of determining to activate the gesture recognition function of at least one of the first lens and the second lens based on the angle between the first body and the second body includes: When no input signal is received from the input unit and the angle between the first body and the second body is greater than a preset angle threshold, the gesture recognition function of at least one of the first lens and the second lens is turned off.

13. The gesture detection method as claimed in claim 12, wherein the step of determining to activate the gesture recognition function of at least one of the first lens and the second lens based on the angle between the first body and the second body further includes: When no input signal is received from the input unit and the angle between the first body and the second body is less than or equal to the preset angle threshold, the gesture recognition function of the first lens and the second lens is activated.

14. The gesture detection method as described in claim 13, wherein the step of activating the gesture recognition function of the first lens and the second lens includes: A first gesture image is provided through the first lens; a second gesture image is provided through the second lens; first gesture data and second gesture data are generated based on the first gesture image and the second gesture image; and the first gesture data and the second gesture data are combined to generate complete gesture data.

15. The gesture detection method as described in claim 14, further comprising: When the gesture recognition function of the first lens and the second lens is activated, a gesture operation diagram is displayed through a display unit; When the first camera and the second camera detect a user's gesture, they first modify or confirm the preset gesture, and then generate a control command based on the complete gesture data.

16. The gesture detection method as described in claim 15, wherein the control command is an operation command of a game software.

17. The gesture detection method as described in claim 14, wherein the complete gesture data includes single-hand gesture data or double-hand gesture data.

18. The gesture detection method as described in claim 11, further comprising: The second lens determines whether to disable the gesture recognition function by judging a preset distance threshold between a user's finger projection on a keyboard area and the second lens.

19. The gesture detection method as described in claim 18, further comprising: When the distance between the finger projection in the keyboard area and the second lens is less than the preset distance threshold, the gesture recognition function of the second lens is turned off; and when the distance between the finger projection in the keyboard area and the second lens is greater than or equal to the preset distance threshold, the gesture recognition function of the second lens is turned on.

20. The gesture detection method as claimed in claim 11, wherein the input unit includes at least one of a keyboard, a touchpad, and a mouse.

Images