Notebook computer and method for obtaining input operation

Abstract

A laptop computer and a method for acquiring input operations relate to the field of terminal technology. The laptop computer includes: a processor and at least one time-of-flight ToF sensor module. The ToF sensor module includes a ToF sensor, which is used to obtain distance data from the user's hand; the inclination angle of the ToF sensor is adjustable, and the inclination angle is the angle between the ToF sensor and the plane where the screen of the laptop computer is located; the processor is used to adjust the inclination angle of the ToF sensor, and to identify the user's current gesture action based on the distance data, and to determine the input operation corresponding to the current gesture action based on the pre-established correspondence between the gesture action and the input operation. This solution solves the problem of low work efficiency caused by a laptop computer without a mouse, and solves the problem of poor convenience caused by carrying a mouse on a laptop computer. In addition, personalized gestures can be customized to enhance fun and user experience, and it has high practicality.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a notebook computer and a method for obtaining input operations. Background Art

[0002] Currently, when using a computer, users are generally accustomed to inputting information through a mouse in combination with a keyboard, and the use of a mouse can make the input operation easier and faster.

[0003] For a laptop computer, the body thereof does not have a mouse. In order not to reduce work efficiency, the user needs to carry both the laptop computer and the mouse, and when using the mouse, a wired or wireless connection needs to be established between the mouse and the laptop computer, thus reducing the portability of the laptop computer. Summary of the invention

[0004] In order to solve the above problems, the present application provides a laptop computer and a method for obtaining input operations, which solves the problem of low work efficiency caused by the laptop computer having no mouse and the problem of poor convenience caused by the laptop computer carrying a mouse.

[0005] In a first aspect, the present application provides a laptop computer, comprising: a processor and at least one time-of-flight ToF sensor module; the ToF sensor module comprises a ToF sensor, and the ToF sensor is used to obtain distance data between the ToF sensor and the user's hand; the inclination angle of the ToF sensor is adjustable, and the inclination angle is the angle between the ToF sensor and the plane where the screen of the laptop computer is located; the processor is used to adjust the inclination angle of the ToF sensor, and identify the user's current gesture action based on the distance data, and determine the input operation corresponding to the current gesture action based on a pre-established correspondence between the gesture action and the input operation.

[0006] The laptop computer of this solution is equipped with one or more ToF sensors. The processor recognizes the user's gestures and converts the gestures into corresponding mouse input operations or other customized input operations, which solves the problem of low work efficiency caused by the laptop computer without a mouse, and solves the problem of poor convenience caused by carrying a mouse on the laptop computer. In addition, personalized gestures can be customized to enhance the fun and user experience, and also provide more convenience for some users with hand disabilities. And when implementing gesture input, physical information such as user pictures will not be directly intercepted, and user personal privacy data will not be used, so there will be no privacy leakage problem, which has high practicality. In addition, the ToF sensor device has low power consumption, which is also conducive to better battery life of the laptop computer.

[0007] In one possible implementation, the processor is specifically used to adjust the tilt angle of the ToF sensor according to a pre-established correspondence between the ToF sensor and the gesture input area so that the ToF sensor faces the gesture input area; the gesture input area is an area where the user performs gesture input.

[0008] In one possible implementation, the processor is specifically used to determine the angle between the user's hand and the direction facing the ToF sensor based on the distance data, and adjust the inclination angle of the ToF sensor based on the angle so that the ToF sensor faces the user's hand.

[0009] In a possible implementation, the processor is further configured to stop adjusting the tilt angle of the ToF sensor when no gesture action is recognized for a first preset time, thereby reducing power consumption and extending the battery life of the device.

[0010] In a possible implementation, the ToF sensor module also includes: a first support member, a second support member, a first magnetic pole structure, a second magnetic pole structure, a first spring, a second spring, a first magnetic material and a second magnetic material; the first support member and the second support member are planar structures; the first magnetic pole structure is fixed to the first end of the first support member, the second magnetic pole structure is fixed to the second end of the first support member, the first magnetic material is fixed to the first end of the second support member, and the second magnetic material is fixed to the second end of the second support member; the first spring connects the first end of the first support member and the first end of the second support member; the second spring connects the second end of the first support member and the second end of the second support member; the ToF sensor is located between the first end of the first support member and the second end of the first support member; or, the ToF sensor is located between the first end of the second support member and the second end of the second support member; the processor is specifically used to control the first magnetic pole structure and the second magnetic pole structure to be energized and generate an electromagnetic field, so that a first force is generated between the first magnetic pole structure and the first magnetic material, and a second force is generated between the second magnetic pole structure and the second magnetic material, and the directions of the first force and the second force are opposite.

[0011] When the first magnetic pole is the N pole, the second magnetic pole is the S pole; when the first magnetic pole is the S pole, the second magnetic pole is the N pole.

[0012] In one possible implementation, the first magnetic pole structure includes a first variable power supply and a first solenoid, and the second magnetic pole structure includes a second variable power supply and a second solenoid; the end of the first magnetic material and the second magnetic material close to the first support member is a first magnetic pole, and the end away from the first support member is a second magnetic pole; the processor is used to control the first variable power supply to output current to the first solenoid, so that the end of the first solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole; and control the second variable power supply to output current to the second solenoid, so that the end of the second solenoid close to the second support member is the first magnetic pole, and the end away from the second support member is the second magnetic pole.

[0013] In one possible implementation, the first magnetic pole structure includes a first variable power supply and a first solenoid, and the second magnetic pole structure includes a second variable power supply and a second solenoid; the end of the first magnetic material close to the first support member is the first magnetic pole, and the end away from the first support member is the second magnetic pole; the end of the second magnetic material close to the first support member is the second magnetic pole, and the end away from the first support member is the first magnetic pole; the processor is used to control the first variable power supply to output current to the first solenoid, so that the end of the first solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole; and control the second variable power supply to output current to the second solenoid, so that the end of the second solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole.

[0014] In one possible implementation, the ToF sensor module also includes: a variable power supply; the first magnetic pole structure includes a first solenoid, and the second magnetic pole structure includes a second solenoid; the winding directions of the first solenoid and the second solenoid are different; the end of the first magnetic material and the second magnetic material close to the first support member is the first magnetic pole, and the end away from the first support member is the second magnetic pole; the processor is used to control the variable power supply to output current to the first solenoid, so that the end of the first solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole; and control the variable power supply to output current to the second solenoid, so that the end of the second solenoid close to the second support member is the first magnetic pole, and the end away from the second support member is the second magnetic pole.

[0015] In a possible implementation, the ToF sensor module also includes: a variable power supply; the first magnetic pole structure includes a first solenoid, and the second magnetic pole structure includes a second solenoid; the end of the first magnetic material close to the first support member is the first magnetic pole, and the end away from the first support member is the second magnetic pole; the end of the second magnetic material close to the first support member is the second magnetic pole, and the end away from the first support member is the first magnetic pole; the processor is used to control the variable power supply to output current to the first solenoid, so that the end of the first solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole; and control the variable power supply to output current to the second solenoid, so that the end of the second solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole.

[0016] In a possible implementation, the ToF sensor module also includes: a first arc surface support member, a second arc surface support member, a first magnetic pole structure, a second magnetic pole structure, a first spring, a second spring, a first magnetic material, and a second magnetic material; the area of ​​the first arc surface support member is greater than the area of ​​the second arc surface support member, the curvature of the first arc surface support member is less than the curvature of the second arc surface support member, and the second arc surface support member is tangent to the first arc surface support member; the first magnetic pole structure is fixed to the first end of the first arc surface support member, the second magnetic pole structure is fixed to the second end of the first arc surface support member, the first magnetic material is fixed to the first end of the second arc surface support member, and the second magnetic material is fixed to the The second end of the second arc surface support member; the first spring connects the first end of the first arc surface support member and the first end of the ToF sensor; the second spring connects the second end of the first arc surface support member and the second end of the ToF sensor; the second arc surface support member is located between the ToF sensor and the first arc surface support member, and between the first spring and the second spring; the processor is specifically used to control the first magnetic pole structure and the second magnetic pole structure to be energized and generate an electromagnetic field, so that a first force is generated between the first magnetic pole structure and the first magnetic material, and a second force is generated between the second magnetic pole structure and the second magnetic material, and the directions of the first force and the second force are opposite.

[0017] In one possible implementation, the first magnetic pole structure includes a first variable power supply and a first solenoid, and the second magnetic pole structure includes a second variable power supply and a second solenoid; the end of the first magnetic material and the second magnetic material close to the first arc surface support is a first magnetic pole, and the end away from the first arc surface support is a second magnetic pole; the processor is used to control the first variable power supply to output current to the first solenoid, so that the end of the first solenoid close to the second arc surface support is the second magnetic pole, and the end away from the second arc surface support is the first magnetic pole; and control the second variable power supply to output current to the second solenoid, so that the end of the second solenoid close to the second arc surface support is the first magnetic pole, and the end away from the second arc surface support is the second magnetic pole.

[0018] In one possible implementation, the first magnetic pole structure includes a first variable power supply and a first solenoid, and the second magnetic pole structure includes a second variable power supply and a second solenoid; the end of the first magnetic material close to the first arc surface support is the first magnetic pole, and the end away from the first arc surface support is the second magnetic pole; the end of the second magnetic material close to the first arc surface support is the second magnetic pole, and the end away from the first arc surface support is the first magnetic pole; the processor is used to control the first variable power supply to output current to the first solenoid, so that the end of the first solenoid close to the second arc surface support is the second magnetic pole, and the end away from the second arc surface support is the first magnetic pole; and control the second variable power supply to output current to the second solenoid, so that the end of the second solenoid close to the second arc surface support is the second magnetic pole, and the end away from the second arc surface support is the first magnetic pole.

[0019] In one possible implementation, the ToF sensor module also includes: a variable power supply; the first magnetic pole structure includes a first solenoid, and the second magnetic pole structure includes a second solenoid; the winding directions of the first solenoid and the second solenoid are different; the end of the first magnetic material and the second magnetic material close to the first arc surface support is the first magnetic pole, and the end away from the first arc surface support is the second magnetic pole; the processor is used to control the variable power supply to output current to the first solenoid, so that the end of the first solenoid close to the second arc surface support is the second magnetic pole, and the end away from the second arc surface support is the first magnetic pole; and control the variable power supply to output current to the second solenoid, so that the end of the second solenoid close to the second arc surface support is the first magnetic pole, and the end away from the second arc surface support is the second magnetic pole.

[0020] In a possible implementation, the ToF sensor module also includes: a variable power supply; the first magnetic pole structure includes a first solenoid, and the second magnetic pole structure includes a second solenoid; the end of the first magnetic material close to the first arc surface support is the first magnetic pole, and the end away from the first arc surface support is the second magnetic pole; the end of the second magnetic material close to the first arc surface support is the second magnetic pole, and the end away from the first arc surface support is the first magnetic pole; the processor is used to control the variable power supply to output current to the first solenoid, so that the end of the first solenoid close to the second arc surface support is the second magnetic pole, and the end away from the second arc surface support is the first magnetic pole; and control the variable power supply to output current to the second solenoid, so that the end of the second solenoid close to the second arc surface support is the second magnetic pole, and the end away from the second arc surface support is the first magnetic pole.

[0021] In one possible implementation, the laptop computer includes a first ToF sensor, and the first ToF sensor pre-establishes a correspondence with a first gesture input area; the processor is specifically used to adjust the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area; and use the distance data of the first gesture input area in the distance data acquired by the first ToF sensor to identify the user's gesture actions in the first gesture input area.

[0022] In a possible implementation, the laptop computer includes the following two ToF sensors: a first ToF sensor and a second ToF sensor; the first ToF sensor pre-establishes a corresponding relationship with a first gesture input area, and the second ToF sensor pre-establishes a corresponding relationship with a second gesture input area; the processor is specifically used to adjust the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area, and uses the distance data of the first gesture input area in the distance data obtained by the first ToF sensor to identify the gesture action of the user in the first gesture input area; and adjust the tilt angle of the second ToF sensor so that the second ToF sensor faces the second gesture input area, and uses the distance data of the second gesture input area in the distance data obtained by the second ToF sensor to identify the gesture action of the user in the second gesture input area.

[0023] In a possible implementation, the laptop computer includes the following two ToF sensors: a first ToF sensor and a second ToF sensor; the first ToF sensor and the second ToF sensor both pre-establish a corresponding relationship with the first gesture input area. The processor is specifically used to adjust the tilt angles of the first ToF sensor and the second ToF sensor so that the first ToF sensor and the second ToF sensor are both facing the first gesture input area; and use the distance data of the first gesture input area in the distance data acquired by the first ToF sensor and the distance data of the first gesture input area in the distance data acquired by the second ToF sensor to identify the gesture action of the user in the first gesture input area.

[0024] In a possible implementation, the input operation specifically includes at least one of the following: a mouse operation or a shortcut operation; the mouse operation includes one or more of a mouse single-click operation, a mouse double-click operation, a mouse right-click operation, and a mouse wheel scrolling operation; the shortcut operation includes one or more of a video / audio rewind operation, a video / audio pause operation, and a video / audio fast-forward operation.

[0025] In a second aspect, the present application further provides a method for acquiring an input operation, which is applied to a laptop computer, wherein the laptop computer includes at least one time-of-flight ToF sensor module, and the ToF sensor module includes a ToF sensor, and the method includes:

[0026] Adjusting the tilt angle of the ToF sensor, where the tilt angle is the angle between the ToF sensor and the plane where the screen of the laptop computer is located;

[0027] According to the distance data between the ToF sensor and the user's hand, the user's current gesture action is identified, and according to the pre-established correspondence between the gesture action and the input operation, the input operation corresponding to the current gesture action is determined.

[0028] The solution provided by the present application sets one or more ToF sensors on the laptop computer, uses the distance data obtained by the ToF sensor to recognize the user's gesture, and converts the gesture into a corresponding mouse input operation or other customized input operation, which solves the problem of low work efficiency caused by the laptop computer without a mouse, and solves the problem of poor convenience caused by carrying a mouse on the laptop computer. By adjusting the inclination angle of the ToF sensor, the ToF sensor is facing the user's hand or the gesture input area, which improves the accuracy of the acquired distance data, and can more comprehensively collect the distance data of the object, further improving the accuracy of gesture action recognition.

[0029] In addition, you can customize personalized gestures to enhance the fun and user experience, and also provide more convenience for some users with hand disabilities. And when implementing gesture input, it will not directly intercept user pictures and other physical information, and will not use user personal privacy data, so there will be no privacy leakage problems, which has high practicality. And the ToF sensor has low device power consumption, which is also conducive to better battery life for laptops.

[0030] In a possible implementation manner, adjusting the tilt angle of the ToF sensor specifically includes:

[0031] According to a pre-established correspondence between the ToF sensor and a gesture input area, the tilt angle of the ToF sensor is adjusted so that the ToF sensor faces the gesture input area; the gesture input area is an area where a user performs gesture input.

[0032] In a possible implementation manner, adjusting the tilt angle of the ToF sensor specifically includes:

[0033] According to the distance data, the angle between the user's hand and the facing direction of the ToF sensor is determined, and the inclination angle of the ToF sensor is adjusted according to the angle so that the ToF sensor faces the user's hand.

[0034] In a possible implementation, the method further includes:

[0035] When no gesture action is recognized for a first preset time, the adjustment of the tilt angle of the ToF sensor is stopped.

[0036] In a possible implementation, the laptop computer includes a first ToF sensor; before adjusting the tilt angle of the ToF sensor, the method further includes:

[0037] Pre-establishing a correspondence between the first ToF sensor and the first gesture input area;

[0038] The adjusting the tilt angle of the ToF sensor specifically includes:

[0039] Adjusting the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area;

[0040] The identifying the current gesture action of the user according to the distance data between the ToF sensor and the user's hand specifically includes:

[0041] The gesture action of the user in the first gesture input area is identified by using the distance data of the first gesture input area in the distance data acquired by the first ToF sensor.

[0042] In a possible implementation, the laptop computer includes the following two ToF sensors: a first ToF sensor and a second ToF sensor; before adjusting the tilt angle of the ToF sensor, the method further includes:

[0043] Pre-establishing a correspondence between the first ToF sensor and the first gesture input area, and pre-establishing a correspondence between the second ToF sensor and the second gesture input area;

[0044] The adjusting the tilt angle of the ToF sensor specifically includes:

[0045] Adjusting the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area, and adjusting the tilt angle of the second ToF sensor so that the second ToF sensor faces the second gesture input area;

[0046] The identifying the current gesture action of the user according to the distance data between the ToF sensor and the user's hand specifically includes:

[0047] Using the distance data of the first gesture input area in the distance data acquired by the first ToF sensor, identifying a gesture action of the user in the first gesture input area;

[0048] The gesture action of the user in the second gesture input area is identified by using the distance data of the second gesture input area in the distance data acquired by the second ToF sensor.

[0049] In a possible implementation, the laptop computer includes the following two ToF sensors: a first ToF sensor and a second ToF sensor; before adjusting the tilt angle of the ToF sensor, the method further includes:

[0050] Pre-establishing a correspondence between the first ToF sensor and the first gesture input area, and pre-establishing a correspondence between the second ToF sensor and the first gesture input area;

[0051] The adjusting the tilt angle of the ToF sensor specifically includes:

[0052] Adjusting the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area, and adjusting the tilt angle of the second ToF sensor so that the second ToF sensor faces the first gesture input area;

[0053] The identifying the current gesture action of the user according to the distance data between the ToF sensor and the user's hand specifically includes:

[0054] The gesture action of the user in the first gesture input area is identified by using the distance data of the first gesture input area in the distance data acquired by the first ToF sensor and the distance data of the first gesture input area in the distance data acquired by the second ToF sensor.

[0055] In a possible implementation, before adjusting the tilt angle of the ToF sensor, the method further includes: pre-establishing a correspondence between a gesture action and an input operation. In a possible implementation, the input operation specifically includes at least one of the following: a mouse operation or a shortcut operation; the mouse operation includes one or more of a mouse single-click operation, a mouse double-click operation, a mouse right-click operation, and a mouse wheel scroll operation; the shortcut operation includes one or more of a video / audio rewind operation, a video / audio pause operation, and a video / audio fast-forward operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 A schematic diagram of an application scenario of a laptop computer;

[0057] Figure 2 A schematic diagram of the structure of a laptop computer provided for this application;

[0058] Figure 3 A schematic diagram of a software system of a notebook computer according to an embodiment of the present application;

[0059] Figure 4 A schematic diagram of an application scenario provided in an embodiment of the present application;

[0060] Figure 5 A schematic diagram of another application scenario provided by an embodiment of the present application;

[0061] Figure 6 A schematic diagram of another application scenario provided in an embodiment of the present application;

[0062] Figure 7 A schematic diagram of another application scenario provided by an embodiment of the present application;

[0063] Fig. 8AA schematic diagram of a ToF sensor module provided in an embodiment of the present application;

[0064] Figure 8B A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0065] Figure 8C Provided for the embodiments of this application Figure 8B Schematic diagram of the corresponding ToF sensor deflection;

[0066] Fig. 9A A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0067] Fig. 9B A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0068] Fig. 9C A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0069] Fig.10 A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0070] Fig.11A A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0071] Fig. 11B A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0072] Fig. 11C Provided for the embodiments of this application Fig. 11B Schematic diagram of the corresponding ToF sensor deflection;

[0073] Fig. 12A A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0074] Fig. 12B A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0075] Fig. 12C A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0076] Fig.13 A schematic diagram of another ToF sensor module provided in an embodiment of the present application;

[0077] Fig.14 A flowchart of a method for obtaining an input operation provided in an embodiment of the present application;

[0078] Fig.15A A flow chart of a method for recording gesture actions and performing monitoring settings provided in an embodiment of the present application;

[0079] Fig. 15B A flowchart of another method for recording gesture actions and performing monitoring settings provided in an embodiment of the present application;

[0080] Fig.16 A schematic diagram of a laptop computer provided in an embodiment of the present application. DETAILED DESCRIPTION

[0081] In order to enable persons skilled in the art to more clearly understand the solution of the present application, the application scenario of the technical solution of the present application is first described below.

[0082] The technical solution provided in this application can be applied to laptop computers, and is described below in conjunction with specific implementation methods.

[0083] See also Figure 1 , the figure is a schematic diagram of an application scenario of a laptop computer.

[0084] When using the laptop computer 100, the user usually uses the mouse 200, otherwise some input operations cannot be performed. However, this requires the user to carry both the laptop computer and the mouse, and to establish a wired or wireless connection between the mouse and the laptop computer when using the mouse, thereby reducing the portability of the laptop computer.

[0085] In order to solve the above technical problems, the present application provides a laptop computer and a method for obtaining input operations. A ToF sensor is set on the laptop computer, and the ToF sensor is used to obtain the distance data of the user's hand, and the user's gesture action is determined based on the obtained distance data. There is a corresponding relationship between the gesture action and the specific input operation, so the laptop computer can determine the current corresponding input operation based on the gesture action. The input operation can be single-click, double-click, right-click, scroll wheel sliding and other operations, that is, the function of the mouse is realized. Using the solution of the present application, the work efficiency of the laptop computer when the mouse is not connected is improved, and since there is no need to carry and connect the mouse, the portability of the laptop computer is also improved.

[0086] The hardware structure of the notebook computer provided by this application is first described below.

[0087] See also Figure 2 , which is a schematic diagram of the structure of a laptop computer provided in this application.

[0088] The laptop computer 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna group 1, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, etc.

[0089] The sensor module 180 may include at least one ToF sensor 181. It may also include one or more of a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor.

[0090] It is understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the laptop computer 100. In other embodiments of the present application, the laptop computer 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0091] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0092] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0093] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0094] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0095] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor through the I2C interface, so that the processor 110 communicates with the touch sensor through the I2C bus interface, thereby realizing the touch function of the laptop computer 100.

[0096] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0097] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0098] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0099] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to realize the shooting function of the laptop computer 100. The processor 110 and the display screen 194 communicate via the DSI interface to realize the display function of the laptop computer 100.

[0100] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0101] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the laptop computer 100, and can also be used to transfer data between the laptop computer 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other laptop computers, such as AR devices, etc.

[0102] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the notebook computer 100. In other embodiments of the present application, the notebook computer 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0103] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the laptop computer 100. While the charging management module 140 is charging the battery 142, it may also power the laptop computer through the power management module 141.

[0104] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0105] The wireless communication function of the notebook computer 100 can be realized through the antenna group 1 and the wireless communication module 160 and the like.

[0106] The antenna group 1 is used to transmit and receive electromagnetic wave signals. Each antenna in the laptop computer 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization rate of the antennas. The antenna can be used in combination with a tuning switch.

[0107] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the laptop computer 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna group 1, modulates the frequency of the electromagnetic wave signal and performs filtering processing, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna group 1.

[0108] The laptop computer 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0109] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Mini-LED, Micro-LED, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the laptop computer 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0110] The laptop computer 100 can realize the shooting function through an image signal processor (ISP), a camera 193, a video codec, a GPU, a display screen 194 and an application processor.

[0111] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0112] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the laptop computer 100 may include 1 or N cameras 193, where N is a positive integer greater than 1. This application does not limit the specific number of cameras.

[0113] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the laptop computer 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0114] Video codecs are used to compress or decompress digital videos. The laptop computer 100 may support one or more video codecs. Thus, the laptop computer 100 may play or record videos in various coding formats, such as moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0115] NPU is a neural network (NN) computing processor, which can quickly process input information and continuously self-learn by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain. NPU can realize applications such as intelligent cognition of the notebook computer 100, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0116] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the notebook computer 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0117] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data (such as audio data) created during the use of the laptop computer 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the laptop computer 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0118] The notebook computer 100 can implement audio functions such as music playing and recording through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0119] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0120] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The notebook computer 100 can listen to music through the speaker 170A.

[0121] The receiver 170B, also called the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also called the "microphone" or "microphone", is used to convert sound signals into electrical signals. In other embodiments, the laptop computer 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize the noise reduction function. In other embodiments, the laptop computer 100 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, and identification of sound sources, and realize directional recording functions, etc.

[0122] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0123] Next, the functions of various sensors that may be included in the notebook computer 100 will be described.

[0124] Time of flight (ToF) sensors use tiny transmitters to emit infrared light or lasers, which reflect from objects and return to the ToF sensor. Based on the time difference between the emission of light and the time it reflects off the object and returns to the sensor, the ToF sensor can measure the distance between the object and the sensor.

[0125] The ToF sensor 181 may specifically be a dToF sensor or an iToF sensor, which is not specifically limited in the embodiment of the present application.

[0126] Among them, the dToF sensor, the full name of which is direct time of flight sensor, is also a direct light flight time sensor. The dToF sensor directly measures the flight time. The dToF principle is to emit light pulses to the object to be measured, and directly calculate the distance between the object to be measured and the sensor by measuring the time interval between the reflected and emitted light pulses.

[0127] The full name of iToF sensor is indirect time of flight sensor, which is also an indirect light flight time sensor. The principle of iToF sensor is to modulate the emitted light into a periodic signal of a certain frequency, measure the phase difference between the emitted signal and the signal reflected back to the receiving end after reaching the measured object, and indirectly calculate the flight time. That is, the flight time of light is indirectly measured by measuring the phase shift difference, rather than directly measuring the flight time of light.

[0128] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be set on the display screen 194. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor, the capacitance between the electrodes changes. The laptop computer 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the laptop computer 100 detects the intensity of the touch operation based on the pressure sensor. The laptop computer 100 can also calculate the touch position based on the detection signal of the pressure sensor. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.

[0129] The fingerprint sensor is used to collect fingerprints. The notebook computer 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc.

[0130] The temperature sensor is used to detect temperature. In some embodiments, the laptop computer 100 uses the temperature detected by the temperature sensor to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor exceeds a threshold, the laptop computer 100 reduces the performance of the processor located near the temperature sensor to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the laptop computer 100 heats the battery 142 to avoid abnormal shutdown of the laptop computer 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the laptop computer 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.

[0131] The touch sensor is also called a "touch control device". The touch sensor can be arranged on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor can also be arranged on the surface of the laptop computer 100, which is different from the position of the display screen 194.

[0132] The key 190 includes a power button, a volume button, etc. The key 190 can be a mechanical key or a touch key. The notebook computer 100 can receive key input and generate key signal input related to user settings and function control of the notebook computer 100.

[0133] Motor 191 can generate vibration prompts. For example, touch operations acting on different applications (such as games, audio playback, etc.) can correspond to different vibration feedback effects. Motor 191 can also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194. Different application scenarios (such as time reminders, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0134] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0135] The software system of the laptop computer provided by this application is described below.

[0136] See also Figure 3 , which is a schematic diagram of the software system of the laptop computer according to an embodiment of the present application.

[0137] The software system of the notebook computer 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention takes the layered architecture as an example to exemplify the software structure of the notebook computer 100.

[0138] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, they are the application layer, the application framework layer, the system library layer, and the kernel layer.

[0139] The application layer can include a series of application packages.

[0140] like Figure 3 As shown, the application package may include applications such as calendar, WLAN, Bluetooth, music, etc. In order to achieve linkage with the ToF sensor, the solution of the embodiment of the present application also includes a ToF application component and performs corresponding user experience (UX) design. Users can use the ToF application component on the laptop to achieve function switches, usage guidance, gesture entry and other functions.

[0141] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0142] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, and an algorithm framework, etc.

[0143] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0144] Content providers are used to store and retrieve data and make it accessible to applications. The data may include video, image, audio, etc.

[0145] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. The display interface can be composed of one or more views.

[0146] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0147] The notification manager allows applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, and the indicator light flashes.

[0148] The algorithm framework includes recognition and decision-making algorithms, which identify user intentions based on data captured by the ToF sensor, and then determine the user's gestures, converting the gestures into mouse-like operations and inputting them into the system to complete the mouse operations.

[0149] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0150] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0151] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0152] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0153] A 2D graphics engine is a drawing engine for 2D drawings.

[0154] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver. The technical solution provided in the embodiment of the present application needs to be applied to the ToF sensor to obtain data, so the sensor driver also includes the ToF sensor driver.

[0155] The solution of this application is explained below in conjunction with specific implementation methods.

[0156] For those skilled in the art, it should be known that, the upper surface of a current laptop computer when in a closed state is called the "A side" of the laptop computer, and the bottom surface is called the "D side" of the laptop computer; when the laptop computer is in an open state, the side where the screen is located is called the "B side" of the laptop computer, and the side where the keyboard is located is called the "C side" of the laptop computer, which will not be described separately in the following description.

[0157] The terms "first", "second", etc. in the following description are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0158] In the present application, unless otherwise clearly specified and limited, the term "connection" should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection or an indirect connection through an intermediate medium.

[0159] See also Figure 4 , which is a schematic diagram of an application scenario provided in an embodiment of the present application.

[0160] Figure 4 First, a laptop computer including a ToF sensor 181 is used as an example for explanation.

[0161] The ToF sensor 181 is disposed at the top position of the B surface of the laptop computer, and may be specifically located on the left or right side of the camera 193 of the laptop computer 100 , which is not specifically limited in the embodiment of the present application. Figure 4 The ToF sensor 181 is located on the right side of the camera 193 as an example for explanation.

[0162] The ToF sensor 181 is used to emit infrared light or laser light, wherein the generated light is reflected from the object and returns to the ToF sensor. Based on the time difference between the emission of the light and the light being reflected by the object and returning to the sensor, the ToF sensor 181 can measure the distance between the object and the ToF sensor 181.

[0163] After the user opens the laptop computer 100, the user can control the hand to move. The ToF sensor 181 measures the distance between the user's hand and the ToF sensor 181 in real time to obtain distance data. The ToF sensor 181 transmits the distance data to the processor, so that the processor determines the gesture input by the user according to the distance data and determines the input operation corresponding to the gesture.

[0164] In one possible implementation, when the function of the ToF sensor 181 is turned on, the ToF sensor 181 can obtain the distance data within the detection range facing the user side, and determine whether there is a gesture input at this time based on the distance data. The size of the detection range is related to the device parameters of the ToF sensor 181. For example, the ToF sensor 181 can obtain the distance data between 0° and 180° on the side of the screen facing the user, that is, the ToF sensor 181 has a data distance collection range of 180°; for another example, the ToF sensor 181 can obtain the distance data between 45° and 135° on the side of the screen facing the user, that is, the ToF sensor 181 has a distance data collection range of 90°. The above data collection range is only a schematic description and does not constitute a limitation on the technical solution of the present application.

[0165] In another possible implementation, considering the actual scenario, when the user uses gestures to input instructions, he generally uses the same input habits as using a mouse. That is, when the user uses his left hand to control the mouse, he is generally accustomed to using his left hand to input instructions, and when the user uses his right hand to control the mouse, he is generally accustomed to using his right hand to control the mouse. Therefore, in the solution of the present application, the ToF sensor 181 may not monitor the collected data obtained within the full angle range in real time, but instead monitors the area on the left side of the keyboard and / or the area on the right side of the keyboard as gesture input areas for targeted monitoring, which are explained separately below.

[0166] Continue to see Figure 4 In the figure, the first gesture input area 301 is located on the right side of the notebook computer 100 as an example.

[0167] When the laptop computer 100 is placed on the desktop, the user can use the ToF application component on the laptop computer 100 to set the right side of the laptop computer 100 as the first gesture input area 301. At this time, the ToF sensor 181 mainly determines whether there is a gesture input based on the collected data in the first gesture input area 301, and the collected data in other areas can be ignored.

[0168] The technical effect of this is to prevent other interfering objects in the surrounding environment from moving and causing the ToF sensor 181 to misjudge gesture input. That is, the setting of the first gesture input area 301 caters to the user's input habits and improves the user experience, and on the other hand, reduces environmental interference and improves accuracy.

[0169] See also Figure 5 , which is a schematic diagram of another application scenario provided in an embodiment of the present application.

[0170] Figure 5 The diagram shows the implementation method when the second gesture input area 302 is on the left side of the notebook computer 100. At this time, the ToF sensor 181 mainly determines whether there is a gesture input based on the collected data in the second gesture input area 302, and ignores the collected data in other areas.

[0171] In a possible implementation, the user can use the ToF application component on the notebook computer 100 to set the currently activated gesture input area. Figure 4 The first gesture input area 301 in the Figure 5 The second gesture input area 302 in the input area can be adapted to one's own input habits.

[0172] See also Figure 6 , which is a schematic diagram of another application scenario provided in an embodiment of the present application.

[0173] In another possible implementation, the user can set the first gesture input area 301 and the second gesture input area 302 to be started simultaneously through the ToF application component on the laptop computer 100. Further, it can be set that when it is determined that there is gesture input in the first gesture input area 301 and the second gesture input area 302 at the same time, the input operation corresponding to the gesture input in one of the gesture input areas is performed first, that is, the priority order of multiple gesture input areas is set.

[0174] The following describes the implementation method when a laptop computer has multiple ToF sensors. The following description takes a laptop computer with two ToF sensors as an example.

[0175] See also Figure 7 , which is a schematic diagram of another application scenario provided in an embodiment of the present application.

[0176] At this time, the laptop computer 100 includes a ToF sensor 181 and a ToF sensor 182. In actual applications, the ToF sensor 181 and the ToF sensor 182 generally adopt the same model and specifications.

[0177] The ToF sensor 181 and the ToF sensor 182 are symmetrically distributed on both sides of the camera 193 .

[0178] When the laptop computer 100 is provided with two ToF sensors 181, the gesture input area can still be Figure 4 , one is provided and is located on the right side of the notebook computer 100; or Figure 5 , one is provided and is located on the left side of the notebook computer; or Figure 7 There are two of them, which are located on the left and right sides of the notebook computer 100, and this application does not make any specific limitation.

[0179] In one possible implementation, two ToF sensors can be set through the ToF application component on the laptop computer 100 to simultaneously monitor the currently enabled gesture input area. Through redundant design, two-way distance data can be obtained, and the gesture input can be determined based on the two-way distance data, thereby improving the accuracy of gesture input determination.

[0180] In addition, in a possible implementation, the ToF application component on the laptop computer 100 can be used to set the ToF sensor 181 to determine whether there is currently a gesture input based on the collected data in the first gesture input area 301, and the collected data in other areas can be ignored and discarded, and set the ToF sensor 182 to determine whether there is currently a gesture input based on the collected data in the second gesture input area 302, and the collected data in other areas can be ignored and discarded.

[0181] The following describes the implementation of the ToF sensor and related modules on a laptop computer. In the following description, the facing direction of the ToF sensor refers to the direction perpendicular to the ToF sensor and toward the measurement area of ​​the ToF sensor.

[0182] See also Fig. 8A , which is a schematic diagram of a ToF sensor module provided in an embodiment of the present application.

[0183] Taking the module corresponding to the ToF sensor 181 as an example, the ToF sensor module includes: a first support member 81, a second support member 82, a first magnetic pole structure 83, a second magnetic pole structure 84, a first magnetic material 85, a second magnetic material 86, a first spring 87, a second spring 88 and the ToF sensor 181.

[0184] The first support member 81 and the second support member 82 are planar structures. Fig. 8A In the illustrated implementation, the first magnetic pole structure 83 , the second magnetic pole structure 84 and the ToF sensor 181 are fixed on the first support member 81 ; the first magnetic material 85 and the second magnetic material 86 are fixed on the second support member 82 .

[0185] The first spring 87 and the second spring 88 are used to connect the first support member 81 and the second support member 82 , and the connection positions of the first spring 87 and the second spring 88 and the first support member 81 are respectively located on opposite sides of the ToF sensor 181 .

[0186] The processor 110 is used to control the first magnetic pole structure 83 and the second magnetic pole structure 84 to be energized and generate an electromagnetic field, thereby generating a first force between the first magnetic pole structure 83 and the first magnetic material 85, and generating a second force between the second magnetic pole structure 84 and the second magnetic material 86. The directions of the first force and the second force are opposite, and at this time, one spring is compressed and the other spring is stretched, so that the first support member 81 is tilted, thereby driving the ToF sensor 181 to tilt.

[0187] When the first support member 81 is not tilted, the ToF sensor 181 is facing the front of the screen of the notebook computer. Figure 7 For example, when the first gesture input area 301 in the image is enabled, the ToF sensor 181 is not facing the first gesture input area 301. In actual applications, when the ToF sensor 181 faces an object, the distance data obtained is more accurate, and the contact area between the emitted infrared light or laser and the object is relatively large, so the distance data of the object can be collected more comprehensively.

[0188] Therefore, at this time, the processor 110 can control the first magnetic pole structure 83 and the second magnetic pole structure 84 to deflect the angle of the ToF sensor 181 so that the ToF sensor 181 can face the first gesture input area 301, thereby improving the accuracy of the acquired distance data and being able to more comprehensively collect the distance data of the object, further improving the accuracy of gesture action recognition.

[0189] The following describes in detail various implementation methods of the ToF sensor module.

[0190] See also Figure 8B , which is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0191] Figure 8B The first magnetic pole structure 83 includes a variable power supply 831 and a solenoid T1, and the second magnetic pole structure 84 includes a variable power supply 841 and a solenoid T2. The end of the first magnetic material 85 facing the first support member 81 is an N pole, and the end of the first magnetic material 85 away from the first support member 81 is an S pole; the end of the second magnetic material 86 facing the first support member 81 is an N pole, and the end of the second magnetic material 86 away from the first support member 81 is an S pole.

[0192] The variable power supplies 831 and 841 can be implemented by variable power supply chips in the current technology, and the specific implementation method thereof will not be repeated here. Since the solenoid T1 and the solenoid T2 are wound in the same manner, the direction of the current output by the variable power supply 831 to the solenoid T1 is opposite to the direction of the current output by the variable power supply 841 to the solenoid T2.

[0193] When the processor 110 needs to control the ToF sensor 181 to deflect, the processor 110 sends a control signal to the variable power supply 831 to control the variable power supply 831 to output current to the solenoid T1, so that the solenoid T1 generates an electromagnetic field. At this time, the end of the solenoid T1 close to the first support member 81 is equivalent to the S pole, and the end away from the first support member 81 is equivalent to the N pole. The solenoid T1 and the first magnetic material 85 attract each other, thereby compressing the first spring 87.

[0194] At the same time, the processor 110 sends a control signal to the variable power supply 841 to control the variable power supply 841 to output current to the solenoid T2, so that the solenoid T2 generates an electromagnetic field. At this time, the end of the solenoid T2 close to the first support member 81 is equivalent to the N pole, and the end away from the first support member 81 is equivalent to the S pole. The solenoid T1 and the first magnetic material 85 repel each other, thereby stretching the second spring 88.

[0195] The processor 110 deflects the ToF sensor 181 through the above control.

[0196] See also Figure 8C , which is provided in the embodiment of the present application Figure 8B Schematic diagram of the corresponding ToF sensor deflection.

[0197] It can be found that at this time, the first spring 87 is compressed and the second spring 88 is stretched, and the two cooperate with each other to cause the ToF sensor 181 to deflect to the left side as shown in the figure.

[0198] In some embodiments, the ToF sensor 181 may have a certain tracking capability. In this case, the corresponding relationship between the deflection angle of the ToF sensor 181 and the output current of the variable power supply is pre-calibrated by testing and stored, for example, in the form of a data table. The processor obtains the distance data sent by the ToF sensor 181 in real time, and determines the angle between the facing direction of the ToF sensor and the user's hand, and determines the output current of the variable power supply based on the corresponding relationship and the angle. The processor deflects the ToF sensor 181 by controlling the variable power supply, thereby making the angle zero. That is, the ToF sensor is facing the user's hand. When the tilt angle of the ToF sensor is not adjusted, the ToF sensor is parallel to the screen of the laptop computer, and the facing direction of the ToF sensor is also perpendicular to the screen.

[0199] It is understandable that the deflection adjustment capability of the ToF sensor 181 may be limited. If the angle between the direction facing the ToF sensor and the user's hand is too large, it has exceeded the deflection adjustment capability of the ToF sensor 181. At this time, the processor controls the variable power supply to deflect the ToF sensor 181, thereby reducing the angle as much as possible, that is, making the ToF sensor face the user's hand as directly as possible.

[0200] In some other embodiments, the ToF sensor 181 is facing the front of the laptop screen when not enabled, that is, the first support member 81 and the second support member 82 remain horizontal. And the ToF sensor 181 does not track the user's hand, but remains facing the gesture input area. Figure 4 , the corresponding relationship between the deflection angle of the ToF sensor 181 and the output current of the variable power supply is pre-calibrated by testing, and stored, for example, in the form of a data table. At this time, there are only two groups of data corresponding to each ToF sensor. Taking the ToF sensor 181 as an example, when the first gesture input area 301 is started, the processor controls the variable power supply according to the corresponding relationship between the first group of deflection angles and the output current of the variable power supply, so that the ToF sensor 181 faces the first gesture input area 301; see Figure 5 When the second gesture input area 302 is activated, the processor controls the variable power supply according to the correspondence between the second set of deflection angles and the output current of the variable power supply so that the ToF sensor 181 faces the second gesture input area 302.

[0201] See also Fig. 9A , this figure is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0202] Fig. 9A The ToF sensor module shown is Figure 8B The difference is that the solenoid T1 and the solenoid T2 are powered by the same variable power supply 89. The solenoid T1 and the solenoid T2 use different winding methods to generate electromagnetic fields in different directions. The variable power supply 89 outputs the same current to the solenoid T1 and the solenoid T2.

[0203] At this time, the end of the solenoid T1 close to the first support member 81 is equivalent to the S pole, and the end away from the first support member 81 is equivalent to the N pole. The solenoid T1 and the first magnetic material 85 attract each other, thereby compressing the first spring 87; the end of the solenoid T2 close to the first support member 81 is equivalent to the N pole, and the end away from the first support member 81 is equivalent to the S pole. The solenoid T1 and the first magnetic material 85 repel each other, thereby stretching the second spring 88. The cooperation between the two causes the ToF sensor 181 to deflect to the left side of the figure.

[0204] Sharing a variable power supply can reduce hardware costs and reduce the size of the ToF sensor module, facilitating miniaturization design.

[0205] See also Fig. 9B , this figure is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0206] Fig. 9B The ToF sensor module shown is Figure 8B The difference is that the end of the second magnetic material 86 facing the first support member 81 is the S pole, and the end of the second magnetic material 86 away from the first support member 81 is the N pole.

[0207] At this time, the processor 110 sends a control signal to the variable power supply 831, controlling the variable power supply 831 to output current to the solenoid T1, so that the solenoid T1 generates an electromagnetic field, and the end of the solenoid T1 close to the first support member 81 is equivalent to the S pole, and the end away from the first support member 81 is equivalent to the N pole. The solenoid T1 and the first magnetic material 85 attract each other, thereby compressing the first spring 87.

[0208] At the same time, the processor 110 sends a control signal to the variable power supply 841 to control the variable power supply 841 to output current to the solenoid T2, so that the solenoid T2 generates an electromagnetic field. At this time, the end of the solenoid T2 close to the first support member 81 is equivalent to the S pole, and the end away from the first support member 81 is equivalent to the N pole. The solenoid T1 and the first magnetic material 85 repel each other, thereby stretching the second spring 88. The two cooperate with each other to deflect the ToF sensor 181 to the left side of the figure.

[0209] See also Fig. 9C , which is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0210] Fig. 9C The ToF sensor module shown is Fig. 9B The difference is that the solenoid T1 and the solenoid T2 are powered by the same variable power supply 89. The solenoid T1 and the solenoid T2 use the same winding method to generate electromagnetic fields in the same direction. The variable power supply 89 outputs the same current to the solenoid T1 and the solenoid T2.

[0211] Sharing a variable power supply can reduce hardware costs and reduce the size of the ToF sensor module, facilitating miniaturization design.

[0212] See also Fig.10 , this figure is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0213] Fig.10 The ToF sensor module shown is Figures 8A-9CThe difference is that: the first magnetic material 85 , the second magnetic material 86 and the ToF sensor 181 are fixed on the first support member 81 ; the first magnetic pole structure 83 and the second magnetic pole structure 84 are fixed on the second support member 82 .

[0214] The processor 110 is used to control the first magnetic pole structure 83 and the second magnetic pole structure 84 to be energized and generate an electromagnetic field, thereby generating a first force between the first magnetic pole structure 83 and the first magnetic material 85, and generating a second force between the second magnetic pole structure 84 and the second magnetic material 86. The directions of the first force and the second force are opposite, and at this time, one spring is compressed and the other spring is stretched, so that the first support member 81 is tilted, thereby driving the ToF sensor 181 to tilt.

[0215] When using Fig.10 For details about the implementation of the ToF sensor module, please refer to Figures 8A-9C The only difference is that the relative positions of the magnetic material and the magnetic pole structure are swapped, which will not be repeated here.

[0216] Other implementations of ToF sensors and related modules are described below.

[0217] See also Fig.11A , this figure is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0218] Continuing with the module corresponding to the ToF sensor 181 as an example, the ToF sensor module now includes: a first arc surface support 91, a second arc surface support 92, a first magnetic pole structure 83, a second magnetic pole structure 84, a first magnetic material 85, a second magnetic material 86, a first spring 87, a second spring 88 and the ToF sensor 181.

[0219] The area of ​​the first arc surface support member 91 is larger than that of the second arc surface support member 92, and the curvature of the first arc surface support member 91 is smaller than that of the second arc surface support member 92. The first arc surface support member 91 is in contact with and tangent to the second arc surface support member 92, but is not fixed.

[0220] The first magnetic pole structure 83 and the second magnetic pole structure 84 are fixed on the second arc surface support member 92; the first magnetic material 85 and the second magnetic material 86 are fixed on the first arc surface support member 91. The first spring 87 and the second spring 88 are used to connect the first arc surface support member 91 and the ToF sensor 181, and the first spring 87 and the second spring 88 are fixed to the opposite ends of the ToF sensor 181 respectively.

[0221] The processor 110 is used to control the first magnetic pole structure 83 and the second magnetic pole structure 84 to be energized and generate an electromagnetic field, thereby generating a first force between the first magnetic pole structure 83 and the first magnetic material 85, and generating a second force between the second magnetic pole structure 84 and the second magnetic material 86. The first force and the second force are in opposite directions, causing one end of the second arc support member 92 to tilt and the other end to fall back, thereby causing one spring to be compressed and the other spring to be stretched, driving the ToF sensor 181 to tilt.

[0222] When the second curved support member 92 is not tilted, the ToF sensor 181 is facing the front of the laptop screen. Figure 7 Taking the first gesture input area 301 in FIG. 1 as an example, the ToF sensor 181 is not facing the first gesture input area 301 .

[0223] The processor 110 can control the first magnetic pole structure 83 and the second magnetic pole structure 84 to deflect the angle of the ToF sensor 181 so that the ToF sensor 181 can face the first gesture input area 301, thereby improving the accuracy of the acquired distance data and being able to more comprehensively collect the distance data of the object, further improving the accuracy of gesture action recognition.

[0224] The following describes in detail various implementation methods of the ToF sensor module.

[0225] See also Fig. 11B , which is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0226] Fig. 11B The first magnetic pole structure 83 includes a variable power supply 831 and a solenoid T1, and the second magnetic pole structure 84 includes a variable power supply 841 and a solenoid T2. The end of the first magnetic material 85 facing the second arc surface support 92 is an N pole, and the end of the first magnetic material 85 away from the second arc surface support 92 is an S pole; the end of the second magnetic material 86 facing the second arc surface support 92 is an N pole, and the end of the second magnetic material 86 away from the second arc surface support 92 is an S pole.

[0227] The variable power supplies 831 and 841 can be implemented by variable power supply chips in the current technology, and the specific implementation method thereof will not be repeated here. Since the solenoid T1 and the solenoid T2 are wound in the same manner, the direction of the current output by the variable power supply 831 to the solenoid T1 is opposite to the direction of the current output by the variable power supply 841 to the solenoid T2.

[0228] When the processor 110 needs to control the ToF sensor 181 to deflect, the processor 110 sends a control signal to the variable power supply 831 to control the variable power supply 831 to output current to the solenoid T1, so that the solenoid T1 generates an electromagnetic field. At this time, the end of the solenoid T1 close to the first arc surface support member 91 is equivalent to the S pole, and the end away from the first arc surface support member 91 is equivalent to the N pole. The solenoid T1 and the first magnetic material 85 attract each other, so that the left side of the second arc surface support member 92 is forced to fall back, thereby compressing the first spring 87.

[0229] At the same time, the processor 110 sends a control signal to the variable power supply 841 to control the variable power supply 841 to output current to the solenoid T2, so that the solenoid T2 generates an electromagnetic field. At this time, the end of the solenoid T2 close to the first arc surface support member 91 is equivalent to the N pole, and the end away from the first arc surface support member 91 is equivalent to the S pole. The solenoid T1 and the first magnetic material 85 repel each other, so that the right side of the second arc surface support member 92 is tilted by force, thereby stretching the second spring 88.

[0230] The processor 110 deflects the ToF sensor 181 through the above control.

[0231] FIG. 8A to FIG. 10 The two sides of the ToF sensor are symmetrical structures, which can work together to adjust the tilt angle of the ToF sensor. In other embodiments, one side of the ToF sensor can adopt a fixed structure, and the other side can adopt the structure in the above embodiments, for example, retaining the first magnetic pole structure, the first spring and the first magnetic material, and not setting the second magnetic pole structure and the second magnetic material on the other side, and replacing the second spring with a non-deformable bracket. In this case, the tilt angle of the ToF sensor is adjusted only by the deformation of the first spring.

[0232] See also Fig. 11C , which is provided in the embodiment of the present application Fig. 11B Schematic diagram of the corresponding ToF sensor deflection.

[0233] It can be found that at this time, the first spring 87 is compressed and the second spring 88 is stretched, and the two cooperate with each other to cause the ToF sensor 181 to deflect to the left side as shown in the figure.

[0234] In some embodiments, the ToF sensor 181 may have a certain tracking capability. In this case, the corresponding relationship between the deflection angle of the ToF sensor 181 and the output current of the variable power supply is pre-calibrated by testing and stored, for example, in the form of a data table. The processor obtains the distance data sent by the ToF sensor 181 in real time, and determines the angle between the facing direction of the ToF sensor and the user's hand, and determines the output current of the variable power supply based on the corresponding relationship and the angle. The processor controls the variable power supply to deflect the ToF sensor 181, thereby making the angle zero. That is, the ToF sensor is facing the user's hand.

[0235] It is understandable that the deflection adjustment capability of the ToF sensor 181 may be limited. If the angle between the direction facing the ToF sensor and the user's hand is too large, it has exceeded the deflection adjustment capability of the ToF sensor 181. At this time, the processor controls the variable power supply to deflect the ToF sensor 181, thereby reducing the angle as much as possible, that is, making the ToF sensor face the user's hand as directly as possible.

[0236] In some other embodiments, the ToF sensor 181 is facing the front of the laptop screen when not enabled, that is, the first support member 81 and the second support member 82 remain horizontal. And the ToF sensor 181 does not track the user's hand, but remains facing the gesture input area. Figure 4 , the corresponding relationship between the deflection angle of the ToF sensor 181 and the output current of the variable power supply is pre-calibrated by testing, and stored, for example, in the form of a data table. At this time, there are only two groups of data corresponding to each ToF sensor. Taking the ToF sensor 181 as an example, when the first gesture input area 301 is started, the processor controls the variable power supply according to the corresponding relationship between the first group of deflection angles and the output current of the variable power supply, so that the ToF sensor 181 faces the first gesture input area 301; see Figure 5 When the second gesture input area 302 is activated, the processor controls the variable power supply according to the correspondence between the second set of deflection angles and the output current of the variable power supply so that the ToF sensor 181 faces the second gesture input area 302.

[0237] See also Fig. 12A , this figure is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0238] Fig. 12A The ToF sensor module shown is Fig. 11BThe difference is that the solenoid T1 and the solenoid T2 are powered by the same variable power supply 89. The solenoid T1 and the solenoid T2 use different winding methods to generate electromagnetic fields in different directions. The variable power supply 89 outputs the same current to the solenoid T1 and the solenoid T2.

[0239] At this time, the end of the solenoid T1 close to the first arc surface support member 91 is equivalent to the S pole, and the end away from the first arc surface support member 91 is equivalent to the N pole. The solenoid T1 and the first magnetic material 85 attract each other, so that the left side of the second arc surface support member 92 is forced to fall back, thereby compressing the first spring 87; the end of the solenoid T2 close to the first arc surface support member 91 is equivalent to the N pole, and the end away from the first arc surface support member 91 is equivalent to the S pole. The solenoid T1 and the first magnetic material 85 repel each other, so that the right side of the second arc surface support member 92 is forced to tilt up, thereby stretching the second spring 88. The two cooperate with each other to deflect the ToF sensor 181 to the left side of the figure.

[0240] Sharing a variable power supply can reduce hardware costs and reduce the size of the ToF sensor module, facilitating miniaturization design.

[0241] See also Fig. 12B , this figure is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0242] Fig. 12B The ToF sensor module shown is Fig. 11B The difference is that the end of the second magnetic material 86 facing the second arc surface support member 92 is the S pole, and the end of the second magnetic material 86 away from the second arc surface support member 92 is the N pole.

[0243] At this time, the processor 110 sends a control signal to the variable power supply 831, controlling the variable power supply 831 to output current to the solenoid T1, so that the solenoid T1 generates an electromagnetic field, and the end of the solenoid T1 close to the first arc surface support member 91 is equivalent to the S pole, and the end away from the first arc surface support member 91 is equivalent to the N pole. The solenoid T1 and the first magnetic material 85 attract each other, so that the left side of the second arc surface support member 92 is forced to fall back, thereby compressing the first spring 87.

[0244] At the same time, the processor 110 sends a control signal to the variable power supply 841 to control the variable power supply 841 to output current to the solenoid T2, so that the solenoid T2 generates an electromagnetic field. At this time, the end of the solenoid T2 close to the first arc surface support member 91 is equivalent to the S pole, and the end away from the first arc surface support member 91 is equivalent to the N pole. The solenoid T1 and the first magnetic material 85 repel each other, so that the right side of the second arc surface support member 92 is tilted by force, thereby stretching the second spring 88. The two cooperate with each other to deflect the ToF sensor 181 to the left side of the figure.

[0245] See also Fig. 12C , which is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0246] Fig. 12C The ToF sensor module shown is Fig. 12B The difference is that the solenoid T1 and the solenoid T2 are powered by the same variable power supply 89. The solenoid T1 and the solenoid T2 use the same winding method to generate electromagnetic fields in the same direction. The variable power supply 89 outputs the same current to the solenoid T1 and the solenoid T2.

[0247] Sharing a variable power supply can reduce hardware costs and reduce the size of the ToF sensor module, facilitating miniaturization design.

[0248] See also Fig.13 , this figure is a schematic diagram of another ToF sensor module provided in an embodiment of the present application.

[0249] Fig.13 The ToF sensor module shown is Figures 11A-12C The difference is that the first magnetic material 85 and the second magnetic material 86 are fixed on the first arc surface support member 91; the first magnetic pole structure 83 and the second magnetic pole structure 84 are fixed on the second arc surface support member 92.

[0250] The processor 110 is used to control the first magnetic pole structure 83 and the second magnetic pole structure 84 to be energized and generate an electromagnetic field, thereby generating a first force between the first magnetic pole structure 83 and the first magnetic material 85, and generating a second force between the second magnetic pole structure 84 and the second magnetic material 86. The directions of the first force and the second force are opposite, and at this time, one spring is compressed and the other spring is stretched, so that one end of the second arc support member 92 falls back. The other end tilts up, thereby driving the ToF sensor 181 to tilt.

[0251] When using Fig.13 For details about the implementation of the ToF sensor module, please refer to Figures 11A-12C The only difference is that the relative positions of the magnetic material and the magnetic pole structure are swapped, which will not be repeated here.

[0252] The above embodiments illustrate the working principle of the ToF sensor and related modules on the laptop computer. The following specifically describes the specific process of using gestures to implement the mouse operation function.

[0253] See also Fig.14 , which is a flowchart of a method for obtaining an input operation provided in an embodiment of the present application.

[0254] The method comprises the following steps:

[0255] S10: Perform monitoring settings and record gesture actions.

[0256] The solution of the present application aims to implement mouse input operations through gesture actions, so there is a corresponding relationship between gesture actions and input operations, and the corresponding relationship needs to be entered in the ToF application component on the laptop computer 100 in advance.

[0257] The input operations of the mouse mainly include: single-level operation, double-click operation, scroll wheel sliding operation and right-click operation, etc. The user needs to enter the corresponding gesture actions for the above operations in advance. The embodiment of the application does not limit the specific gesture actions, which can be determined according to the user's own input habits.

[0258] In addition, monitoring settings are required, and the monitoring equipment may include but is not limited to one or more of the following: setting an enabled ToF sensor, setting an enabled gesture input area, setting the detection sensitivity of gesture actions, and setting the correspondence between the activated ToF sensor and the enabled gesture input area.

[0259] Among them, the detection sensitivity represents the sensitivity of the ToF sensor in detecting gesture input. When the detection sensitivity of gesture actions is set high, the processor will recognize and judge hand movements with smaller amplitudes; when the detection sensitivity of gesture actions is set low, the processor will recognize and judge hand movements with larger amplitudes, and hand movements with smaller amplitudes will be considered as interference movements and discarded.

[0260] For more information about the correspondence between the enabled ToF sensor and the enabled gesture input area, see the above Figures 4 to 7 The relevant descriptions in the embodiments of the present application will not be repeated here.

[0261] S20: Detect the user's gesture and obtain distance data.

[0262] S30: Send the distance data to the processor.

[0263] The ToF sensor sends the acquired distance data to the processor, which then recognizes the gesture.

[0264] S40: Identify the user's current gesture action according to the acquired distance data.

[0265] The laptop processor determines the user's gesture based on the distance data obtained by the ToF sensor and its own recognition algorithm. The recognition algorithm recognizes the user's intention based on the captured distance data. Because the users of laptops are relatively fixed, big data learning can be performed based on the user's gesture habits, so the accuracy will be higher and higher.

[0266] S50: Determine the input operation corresponding to the current gesture action and input it to the system.

[0267] The processor converts the gesture action of the current user into a corresponding input operation according to the correspondence between the gesture action and the input operation recorded in S10 and inputs the corresponding input operation to the system, thereby realizing input by using gesture action instead of mouse.

[0268] The process of performing monitoring settings and recording gesture actions in S10 is described in detail below.

[0269] See also Fig.15A , which is a flow chart of a method for recording gesture actions and performing monitoring settings provided in an embodiment of the present application.

[0270] The process includes the following steps:

[0271] S11: Set the detection sensitivity of gesture actions.

[0272] Detection sensitivity represents the sensitivity of the ToF sensor in detecting gesture input. When the detection sensitivity of gesture actions is set high, the processor will recognize and judge hand movements with smaller amplitudes; when the detection sensitivity of gesture actions is set low, the processor will recognize and judge hand movements with larger amplitudes, and hand movements with smaller amplitudes will be considered as interference movements and discarded.

[0273] The detection sensitivity may include multiple sensitivity levels, and the user may set the levels according to the gesture input habits.

[0274] S12: Set the enabled ToF sensor and enabled gesture input area.

[0275] Continue to see Figure 7 When two ToF sensors are included on the laptop computer, the user may set at least one of the ToF sensor 181 and the ToF sensor 182 to be turned on.

[0276] And at least one of the first gesture input area 301 and the second gesture input area 302 is selected and enabled.

[0277] S13: Setting a correspondence between an enabled ToF sensor and an enabled gesture input area.

[0278] In some embodiments, the user enables the ToF sensor 181 and the ToF sensor 182 at the same time, and enables the first gesture input area 301 and the second gesture input area 302 at the same time. At this time, the user can set the ToF sensor 181 to correspond to the first gesture input area 301, so that the processor processes the distance data in the first gesture input area 301, and discards other distance data obtained by the ToF sensor 181; and set the ToF sensor 182 to correspond to the second gesture input area 302, so that the processor processes the distance data in the second gesture input area 301, and discards other distance data obtained by the ToF sensor 182.

[0279] In actual applications, the distance data acquired by the ToF sensor carries direction information, that is, each distance data includes distance information and direction information. The processor can determine whether the distance data is distance data collected in the gesture input area based on the direction information.

[0280] In other embodiments, the user enables both the ToF sensor 181 and the ToF sensor 182, and only enables one gesture input area, for example, the first gesture input area 301. In this case, the user can set the ToF sensor 181 and the ToF sensor 182 to correspond to the first gesture input area 301 at the same time to achieve redundant detection and improve accuracy.

[0281] In some other embodiments, the user enables one ToF sensor, for example, the ToF sensor 181, and only enables one gesture input area, for example, the first gesture input area 301. At this time, the user can set the ToF sensor 181 to correspond to the first gesture input area 301.

[0282] S14: Save the settings and start gesture setting.

[0283] After the user completes the settings in the ToF application component, the user saves the settings and enters the gestures.

[0284] S15: Adjust the monitoring range of the enabled ToF sensor.

[0285] At this time, the processor adjusts the monitoring range of the enabled ToF sensor according to the user's settings in S12-S13, that is, adjusts the deflection angle of the enabled ToF sensor.

[0286] For the implementation and working principle of the ToF sensor module, please refer to the above FIG. 8A to FIG. 13 The description in the embodiments of the present application will not be repeated here.

[0287] In some embodiments, see Figure 7, the user enables the ToF sensor 181 and the ToF sensor 182 at the same time, and enables the first gesture input area 301 and the second gesture input area 302 at the same time. When the user sets the ToF sensor 181 to correspond to the first gesture input area 301, and sets the ToF sensor 182 to correspond to the second gesture input area 302, the processor controls the ToF sensor 181 to deflect so that the ToF sensor 181 faces the first gesture input area 301 as much as possible; and the processor controls the ToF sensor 182 to deflect so that the ToF sensor 182 faces the second gesture input area 302 as much as possible. This improves the accuracy of the distance data obtained, and can more comprehensively collect the distance information of the object, further improving the accuracy of gesture action recognition.

[0288] In other embodiments, the user enables both the ToF sensor 181 and the ToF sensor 182 at the same time, and only enables one gesture input area, for example, the first gesture input area 301. When the user sets the ToF sensor 181 and the ToF sensor 182 to correspond to the first gesture input area 301 at the same time, the processor controls the ToF sensor 181 to deflect so that the ToF sensor 181 faces the first gesture input area 301 as much as possible; and controls the ToF sensor 182 to deflect so that the ToF sensor 182 faces the first gesture input area 301 as much as possible.

[0289] In some other embodiments, the user enables one ToF sensor, such as the ToF sensor 181, and only enables one gesture input area, such as the first gesture input area 301. After the user sets the ToF sensor 181 to correspond to the first gesture input area 301, the processor controls the ToF sensor 181 to deflect so that the ToF sensor 181 faces the first gesture input area 301 as much as possible.

[0290] In actual applications, since the processor consumes power to control the deflection of the ToF sensor, when the user does not input gestures in the gesture input area for a long time, maintaining the deflection of the ToF sensor will bring unnecessary power consumption. Therefore, when the processor does not recognize the gesture action for a first preset time, it will stop controlling the deflection of the ToF sensor, so that the ToF sensor returns to the position facing the screen to reduce power consumption.

[0291] The first preset time can be set according to actual conditions, and is not specifically limited in the embodiment of the present application. For example, it can be set to 5 minutes. The user can set it on the ToF application component. When the processor recognizes that the user begins to input gestures in the gesture input area based on the distance data of the ToF sensor, the ToF sensor is controlled to deflect again.

[0292] In some embodiments, after the processor completes adjusting the tilt angle of the ToF sensor, it maintains the tilt angle of the ToF sensor so that when the user subsequently completes all gesture recording and monitoring setting steps and performs gesture input, the ToF sensor is still facing the gesture input area.

[0293] S16: The user performs gesture input in the enabled gesture input area.

[0294] S17: Acquire distance data and transmit the distance data to the processor.

[0295] The ToF sensor acquires distance data and transmits the distance data to the processor.

[0296] S18: The processor identifies the characteristics of the gesture action and determines that the current gesture action entry is completed.

[0297] S19: Setting the input operation corresponding to the gesture action.

[0298] The input operation includes the input operation of the mouse. After the corresponding relationship between the gesture action and the input operation is saved, the conversion relationship between the gesture action and the input operation of the mouse is recorded. For example, a single click of the index finger can correspond to a single click operation of the mouse, two clicks of the index finger can correspond to a double click operation of the mouse, a single click of the middle finger can correspond to a right click operation of the mouse, and two-finger sliding of the index and middle fingers can correspond to a scrolling operation of the mouse wheel, etc.

[0299] Input operations may also include other operations besides mouse input operations, that is, gesture actions can not only realize the functions of the mouse, but also realize other functions, such as using the left swipe of the palm to rewind the video / audio, using the up swipe of the palm to pause the video / audio, and using the right swipe of the palm to fast forward the video / audio, etc.

[0300] In addition, the input operation may also include other quick operations, such as copying, pasting and other functions, which will not be described in detail in the implementation of this application.

[0301] The above is only an example and does not constitute a limitation on the technical solution of the present application. The correspondence between gesture actions and input operations can be customized according to the user's habits and preferences to achieve personalization and increase fun.

[0302] Among them, S16-S19 can be executed repeatedly, and a set of corresponding relationships between gesture actions and input operations is recorded each time, until the user has recorded all the corresponding relationships between gesture actions and input operations that he wants to use. And each time a set of corresponding relationships between gesture actions and input operations is recorded, S16-S17 can be performed multiple times, that is, the user can perform multiple gesture inputs in the gesture input area until the processor recognizes the characteristics of the gesture action.

[0303] The division of the above steps does not constitute a limitation on the technical solution of the present application. In practical applications, the order of the steps can be adjusted. For example, the step of gesture recording can be performed first, and then the steps related to monitoring settings can be performed. For another example, the order of the steps related to monitoring settings can be swapped, and the step of detecting sensitivity in S11 can be deleted.

[0304] In a possible implementation, when the processor determines that the laptop computer is connected to the mouse, the gesture recognition function may be controlled to be automatically disabled to reduce power consumption.

[0305] The following is another process for setting up monitoring and recording gestures. Fig.15A The same steps are not repeated here.

[0306] See also Fig.15A , which is a flow chart of a method for recording gesture actions and performing monitoring settings provided in an embodiment of the present application.

[0307] The process includes the following steps:

[0308] S11: Set the detection sensitivity of gesture actions.

[0309] S12: Set the enabled ToF sensor and enabled gesture input area.

[0310] S13: Setting a correspondence between an enabled ToF sensor and an enabled gesture input area.

[0311] S14: Save the settings and start gesture setting.

[0312] After the user completes the settings in the ToF application component, the user saves the settings and enters the gestures.

[0313] S15′: The user performs gesture input in the enabled gesture input area.

[0314] S16': Acquire distance data and transmit the distance data to the processor.

[0315] The ToF sensor acquires distance data and transmits the distance data to the processor.

[0316] S17': According to the distance data, adjust the monitoring range of the enabled ToF sensor.

[0317] The distance data acquired by the ToF sensor includes direction information and distance information. The processor can determine the angle between the direction facing the ToF sensor and the user's hand based on the direction information. Then the processor can determine the output current of the variable power supply based on the correspondence between the deflection angle of the ToF sensor and the output current of the variable power supply stored in advance. The processor controls the variable power supply to deflect the ToF sensor, thereby making the angle zero, or as close to zero as possible. That is, the ToF sensor is facing the user's hand as much as possible.

[0318] For the implementation and working principle of the ToF sensor module, please refer to the above FIG. 8A to FIG. 13 The description in the embodiments of the present application will not be repeated here.

[0319] In actual applications, since the processor consumes power to control the deflection of the ToF sensor, when the user does not input gestures in the gesture input area for a long time, maintaining the deflection of the ToF sensor will bring unnecessary power consumption. Therefore, when the processor does not recognize the gesture action for a first preset time, it will stop controlling the deflection of the ToF sensor, so that the ToF sensor returns to the position facing the screen to reduce power consumption.

[0320] The first preset time can be set according to actual conditions, and is not specifically limited in the embodiment of the present application. For example, it can be set to 5 minutes. The user can set it on the ToF application component. When the processor recognizes that the user begins to input gestures in the gesture input area based on the distance data of the ToF sensor, the ToF sensor is controlled to deflect again.

[0321] S18': The processor identifies the characteristics of the gesture action and determines that the current gesture action entry is completed.

[0322] S19': Set the input operation corresponding to the gesture action.

[0323] Among them, S16'-S19' can be executed repeatedly, and a set of corresponding relationships between gesture actions and input operations is recorded each time, until the user has recorded all the corresponding relationships between gesture actions and input operations that the user wants to use. And each time a set of corresponding relationships between gesture actions and input operations is recorded, S16'-S17' can be performed multiple times, that is, the user can perform multiple gesture inputs in the gesture input area until the processor recognizes the characteristics of the gesture action.

[0324] In summary, by using the solution provided by the embodiment of the present application, by setting a ToF sensor on the laptop computer, and combining algorithms and / or big data to accurately identify the user's gestures, the gestures are converted into corresponding mouse input operations or other customized input operations, thereby solving the problem of low work efficiency caused by the laptop computer without a mouse, and solving the problem of poor convenience caused by carrying a mouse on the laptop computer. In addition, personalized gestures can be customized to enhance the fun and user experience, and more convenience is provided for some users with hand disabilities. Furthermore, based on the working principle of the ToF sensor, when implementing gesture input, physical information such as user pictures will not be directly intercepted, and user personal privacy data will not be used. Therefore, there will be no privacy leakage problem, and it has high practicality.

[0325] Based on the method for obtaining input operations provided in the above embodiments, the embodiment of the present application further provides a laptop computer, which is described in detail below with reference to the accompanying drawings.

[0326] See also Fig.16 , which is a schematic diagram of a laptop computer provided in an embodiment of the present application.

[0327] The laptop computer 100 provided in the embodiment of the present application includes at least one ToF sensor. For the specific implementation method and working principle of the ToF sensor, please refer to the description in the above embodiment, and the embodiment of the present application will not be repeated here.

[0328] Fig.16 In the example, the laptop computer 100 includes two ToF sensors, wherein the ToF sensor 181 is located on the right side of the camera 193 , and the ToF sensor 181 is located on the left side of the camera 193 .

[0329] ToF sensors 181 and 182 are used to emit infrared light or laser light, wherein the generated light is reflected from the object and returns to the ToF sensor. Based on the time difference between the emission of light and the return of light to the sensor after being reflected by the object, ToF sensors 181 and 182 can measure the distance data between the object and itself.

[0330] The ToF sensors 181 and 182 send the acquired distance data to the processor of the notebook computer 100. For the hardware architecture of the notebook computer 100, please refer to Figure 2 The corresponding related descriptions are not repeated here; the software architecture of the notebook computer 100 can be found in Figure 3 The corresponding related instructions will not be repeated here.

[0331] The laptop computer 100 not only adds a ToF sensor in hardware, but also includes a ToF application component at the application level, which is used to realize gesture entry, turning on and off the gesture recognition function, setting and using guidance, etc.

[0332] In summary, the laptop computer provided in the embodiment of the present application is provided with one or more ToF sensors, and combines algorithms and / or big data to accurately identify the user's gestures, and converts the gestures into corresponding mouse input operations or other customized input operations, which solves the problem of low work efficiency caused by the laptop computer without a mouse, and solves the problem of poor convenience caused by carrying a mouse on the laptop computer. In addition, personalized gestures can be customized to enhance the fun and user experience, and also provide more convenience for some users with hand disabilities.

[0333] Furthermore, based on the working principle of ToF sensors, when implementing gesture input, physical information such as user pictures will not be directly intercepted, and user personal privacy data will not be used, so there will be no privacy leakage problem, which has high practicality. In addition, the device power consumption of ToF sensors is low, which is also conducive to better battery life for laptops.

[0334] It is understandable that the solution of the embodiment of the present application enables the laptop computer to implement mouse input operations through gestures when there is no mouse, but when the laptop computer and the mouse establish a wired or wireless connection, it does not affect or limit the input operation through the mouse. In a possible implementation, when the processor determines that the laptop computer and the mouse are connected, the gesture recognition function can be controlled to be automatically turned off to reduce power consumption.

[0335] In some embodiments, the processor of the laptop computer controls the ToF sensor to face the gesture input area as much as possible, and the processor recognizes the user's current gesture action only based on the distance data of the gesture input area, which can improve the accuracy of recognizing the user's current gesture action and reduce interference from the surrounding environment.

[0336] In other embodiments, the processor of the laptop computer recognizes gestures based on the distance data within the entire detection range obtained by the ToF sensor. When the processor determines that a gesture is recognized, it controls the ToF sensor to rotate to face the user's hand. This implementation method is more flexible and does not require the user to input in the gesture input area.

[0337] In addition, an embodiment of the present application further provides a readable storage medium on which a program is stored. When the program is executed by a processor of a laptop computer, the method for obtaining the input operation provided in the above embodiment is implemented.

[0338] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices and program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by program instructions. These program instructions can be provided to a processor of a programmable data processing device to generate a machine, so that the instructions executed by the processor of the programmable data processing device generate instructions for implementing the processes in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0339] Readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of storage media include, but are not limited to, phase change random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), etc.

[0340] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0341] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A notebook computer, characterized in that: The laptop computer includes: a processor and at least one time-of-flight ToF sensor module; The ToF sensor module includes a ToF sensor, a first support member, a second support member, a first magnetic pole structure, a second magnetic pole structure, a first spring, a second spring, a first magnetic material, and a second magnetic material; The first support member and the second support member are planar structures; The first magnetic pole structure is fixed to the first end of the first support member, and the second magnetic pole structure is fixed to the second end of the first support member. The first magnetic material is fixed to the first end of the second support member, and the second magnetic material is fixed to the second end of the second support member; The first spring connects the first end of the first support member and the first end of the second support member; The second spring connects the second end of the first support member and the second end of the second support member; The ToF sensor is located between the first end of the first support member and the second end of the first support member; or, the ToF sensor is located between the first end of the second support member and the second end of the second support member; The processor is used to control the first magnetic pole structure and the second magnetic pole structure to be energized and generate an electromagnetic field according to a pre-established correspondence between the ToF sensor and the gesture input area, thereby generating a first force between the first magnetic pole structure and the first magnetic material, and generating a second force opposite to the first force between the second magnetic pole structure and the second magnetic material, and one of the first spring and the second spring is compressed and the other spring is stretched, driving the ToF sensor to tilt so that the ToF sensor faces the gesture input area; and identifying the user's current gesture action according to the distance data obtained by the ToF sensor, and determining the input operation corresponding to the current gesture action according to the pre-established correspondence between the gesture action and the input operation, the gesture input area is an area where the user performs gesture input, and the input operation includes a mouse operation, and the mouse operation includes one or more of a mouse single-click operation, a mouse double-click operation, a mouse right-click operation, and a mouse wheel scrolling operation.

2. The notebook computer according to claim 1, characterized in that: The processor is further configured to stop adjusting the tilt angle of the ToF sensor when no gesture action is recognized for a first preset time.

3. The notebook computer according to claim 1, characterized in that: The first magnetic pole structure includes a first variable power supply and a first solenoid, and the second magnetic pole structure includes a second variable power supply and a second solenoid; One end of the first magnetic material and the second magnetic material close to the first support member is a first magnetic pole, and one end away from the first support member is a second magnetic pole; The processor is used to control the first variable power supply to output current to the first solenoid so that the end of the first solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole; and control the second variable power supply to output current to the second solenoid so that the end of the second solenoid close to the second support member is the first magnetic pole, and the end away from the second support member is the second magnetic pole.

4. The notebook computer according to claim 1, characterized in that: The first magnetic pole structure includes a first variable power supply and a first solenoid, and the second magnetic pole structure includes a second variable power supply and a second solenoid; One end of the first magnetic material close to the first support member is a first magnetic pole, and one end away from the first support member is a second magnetic pole; One end of the second magnetic material close to the first support member is the second magnetic pole, and one end away from the first support member is the first magnetic pole; The processor is used to control the first variable power supply to output current to the first solenoid so that the end of the first solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole; and control the second variable power supply to output current to the second solenoid so that the end of the second solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole.

5. The notebook computer according to claim 1, characterized in that: The ToF sensor module further includes: a variable power supply; the first magnetic pole structure includes a first solenoid, and the second magnetic pole structure includes a second solenoid; the winding directions of the first solenoid and the second solenoid are different; One end of the first magnetic material and the second magnetic material close to the first support member is a first magnetic pole, and one end away from the first support member is a second magnetic pole; The processor is used to control the variable power supply to output current to the first solenoid so that the end of the first solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole; and control the variable power supply to output current to the second solenoid so that the end of the second solenoid close to the second support member is the first magnetic pole, and the end away from the second support member is the second magnetic pole.

6. The notebook computer according to claim 1, characterized in that: The ToF sensor module further includes: a variable power supply; the first magnetic pole structure includes a first solenoid, and the second magnetic pole structure includes a second solenoid; One end of the first magnetic material close to the first support member is a first magnetic pole, and one end away from the first support member is a second magnetic pole; One end of the second magnetic material close to the first support member is the second magnetic pole, and one end away from the first support member is the first magnetic pole; The processor is used to control the variable power supply to output current to the first solenoid so that the end of the first solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole; and control the variable power supply to output current to the second solenoid so that the end of the second solenoid close to the second support member is the second magnetic pole, and the end away from the second support member is the first magnetic pole.

7. The notebook computer according to claim 1, characterized in that: The laptop computer includes a first ToF sensor, and a correspondence relationship between the first ToF sensor and a first gesture input area is pre-established; The processor is specifically used to adjust the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area; and use the distance data of the first gesture input area in the distance data acquired by the first ToF sensor to identify the gesture action of the user in the first gesture input area.

8. The notebook computer according to claim 1, characterized in that: The laptop computer includes the following two ToF sensors: a first ToF sensor and a second ToF sensor; the first ToF sensor pre-establishes a corresponding relationship with a first gesture input area, and the second ToF sensor pre-establishes a corresponding relationship with a second gesture input area; The processor is specifically used to adjust the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area, and use the distance data of the first gesture input area in the distance data obtained by the first ToF sensor to identify the gesture actions of the user in the first gesture input area; and adjust the tilt angle of the second ToF sensor so that the second ToF sensor faces the second gesture input area, and use the distance data of the second gesture input area in the distance data obtained by the second ToF sensor to identify the gesture actions of the user in the second gesture input area.

9. The notebook computer according to claim 1, characterized in that: The laptop computer includes the following two ToF sensors: a first ToF sensor and a second ToF sensor; the first ToF sensor and the second ToF sensor both pre-establish a corresponding relationship with a first gesture input area; The processor is specifically used to adjust the tilt angles of the first ToF sensor and the second ToF sensor so that the first ToF sensor and the second ToF sensor are both facing the first gesture input area; and use the distance data of the first gesture input area in the distance data obtained by the first ToF sensor, and the distance data of the first gesture input area in the distance data obtained by the second ToF sensor, to identify the gesture actions of the user in the first gesture input area.

10. The notebook computer according to claim 1, characterized in that: The input operation also includes a shortcut operation; the shortcut operation includes: one or more of a video / audio rewind operation, a video / audio pause operation, and a video / audio fast forward operation.

11. A notebook computer, characterized in that: The laptop computer includes: a processor and at least one time-of-flight ToF sensor module; The ToF sensor module includes a ToF sensor, a first arc surface support, a second arc surface support, a first magnetic pole structure, a second magnetic pole structure, a first spring, a second spring, a first magnetic material, and a second magnetic material; The area of ​​the first arc surface support component is greater than that of the second arc surface support component, the curvature of the first arc surface support component is smaller than that of the second arc surface support component, and the second arc surface support component is tangent to the first arc surface support component; The first magnetic pole structure is fixed to the first end of the first arc surface support member, and the second magnetic pole structure is fixed to the second end of the first arc surface support member. The first magnetic material is fixed to the first end of the second arc surface support member, and the second magnetic material is fixed to the second end of the second arc surface support member; The first spring connects the first end of the first arc surface support member and the first end of the ToF sensor; The second spring connects the second end of the first arc surface support member and the second end of the ToF sensor; The second arc surface support member is located between the ToF sensor and the first arc surface support member, and between the first spring and the second spring; The processor is used to control the first magnetic pole structure and the second magnetic pole structure to be energized and generate an electromagnetic field according to a pre-established correspondence between the ToF sensor and the gesture input area, thereby generating a first force between the first magnetic pole structure and the first magnetic material, and generating a second force opposite to the direction of the first force between the second magnetic pole structure and the second magnetic material, one end of the second arc surface support member is tilted up and the other end falls back, one of the first spring and the second spring is compressed, and the other spring is stretched, driving the ToF sensor to tilt so that the ToF sensor faces the gesture input area; and identifying the user's current gesture action according to the distance data obtained by the ToF sensor, and determining the input operation corresponding to the current gesture action according to the pre-established correspondence between the gesture action and the input operation, the gesture input area is an area where the user performs gesture input, and the input operation includes a mouse operation, and the mouse operation includes one or more of a mouse single-click operation, a mouse double-click operation, a mouse right-click operation, and a mouse wheel scrolling operation.

12. The notebook computer according to claim 11, characterized in that: The processor is further configured to stop adjusting the tilt angle of the ToF sensor when no gesture action is recognized for a first preset time.

13. The notebook computer according to claim 11, characterized in that: The first magnetic pole structure includes a first variable power supply and a first solenoid, and the second magnetic pole structure includes a second variable power supply and a second solenoid; One end of the first magnetic material and the second magnetic material close to the first arc surface support member is a first magnetic pole, and one end away from the first arc surface support member is a second magnetic pole; The processor is used to control the first variable power supply to output current to the first solenoid so that the end of the first solenoid close to the second arc surface support member is the second magnetic pole, and the end away from the second arc surface support member is the first magnetic pole; and control the second variable power supply to output current to the second solenoid so that the end of the second solenoid close to the second arc surface support member is the first magnetic pole, and the end away from the second arc surface support member is the second magnetic pole.

14. The notebook computer according to claim 11, characterized in that: The first magnetic pole structure includes a first variable power supply and a first solenoid, and the second magnetic pole structure includes a second variable power supply and a second solenoid; One end of the first magnetic material close to the first arc surface support member is a first magnetic pole, and one end away from the first arc surface support member is a second magnetic pole; One end of the second magnetic material close to the first arc surface support member is the second magnetic pole, and one end away from the first arc surface support member is the first magnetic pole; The processor is used to control the first variable power supply to output current to the first solenoid so that the end of the first solenoid close to the second arc surface support member is the second magnetic pole, and the end away from the second arc surface support member is the first magnetic pole; and control the second variable power supply to output current to the second solenoid so that the end of the second solenoid close to the second arc surface support member is the second magnetic pole, and the end away from the second arc surface support member is the first magnetic pole.

15. The notebook computer according to claim 13, characterized in that: The ToF sensor module further includes: a variable power supply; the first magnetic pole structure includes a first solenoid, and the second magnetic pole structure includes a second solenoid; the winding directions of the first solenoid and the second solenoid are different; One end of the first magnetic material and the second magnetic material close to the first arc surface support member is a first magnetic pole, and one end away from the first arc surface support member is a second magnetic pole; The processor is used to control the variable power supply to output current to the first solenoid so that the end of the first solenoid close to the second arc surface support member is the second magnetic pole, and the end away from the second arc surface support member is the first magnetic pole; and control the variable power supply to output current to the second solenoid so that the end of the second solenoid close to the second arc surface support member is the first magnetic pole, and the end away from the second arc surface support member is the second magnetic pole.

16. The notebook computer according to claim 11, characterized in that: The ToF sensor module further includes: a variable power supply; the first magnetic pole structure includes a first solenoid, and the second magnetic pole structure includes a second solenoid; One end of the first magnetic material close to the first arc surface support member is a first magnetic pole, and one end away from the first arc surface support member is a second magnetic pole; One end of the second magnetic material close to the first arc surface support member is the second magnetic pole, and one end away from the first arc surface support member is the first magnetic pole; The processor is used to control the variable power supply to output current to the first solenoid so that the end of the first solenoid close to the second arc surface support member is the second magnetic pole, and the end away from the second arc surface support member is the first magnetic pole; and control the variable power supply to output current to the second solenoid so that the end of the second solenoid close to the second arc surface support member is the second magnetic pole, and the end away from the second arc surface support member is the first magnetic pole.

17. The notebook computer according to claim 11, characterized in that: The laptop computer includes a first ToF sensor, and a correspondence relationship between the first ToF sensor and a first gesture input area is pre-established; The processor is specifically used to adjust the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area; and use the distance data of the first gesture input area in the distance data acquired by the first ToF sensor to identify the gesture action of the user in the first gesture input area.

18. The notebook computer according to claim 11, characterized in that: The laptop computer includes the following two ToF sensors: a first ToF sensor and a second ToF sensor; the first ToF sensor pre-establishes a corresponding relationship with a first gesture input area, and the second ToF sensor pre-establishes a corresponding relationship with a second gesture input area; The processor is specifically used to adjust the tilt angle of the first ToF sensor so that the first ToF sensor faces the first gesture input area, and use the distance data of the first gesture input area in the distance data obtained by the first ToF sensor to identify the gesture actions of the user in the first gesture input area; and adjust the tilt angle of the second ToF sensor so that the second ToF sensor faces the second gesture input area, and use the distance data of the second gesture input area in the distance data obtained by the second ToF sensor to identify the gesture actions of the user in the second gesture input area.

19. The notebook computer according to claim 11, characterized in that: The laptop computer includes the following two ToF sensors: a first ToF sensor and a second ToF sensor; the first ToF sensor and the second ToF sensor both pre-establish a corresponding relationship with a first gesture input area; The processor is specifically used to adjust the tilt angles of the first ToF sensor and the second ToF sensor so that the first ToF sensor and the second ToF sensor are both facing the first gesture input area; and use the distance data of the first gesture input area in the distance data obtained by the first ToF sensor, and the distance data of the first gesture input area in the distance data obtained by the second ToF sensor, to identify the gesture actions of the user in the first gesture input area.

20. The notebook computer according to claim 11, characterized in that: The input operation also includes a shortcut operation; the shortcut operation includes: one or more of a video / audio rewind operation, a video / audio pause operation, and a video / audio fast forward operation.

Images