Electronic equipment and control method of electronic equipment

Abstract

The invention discloses electronic equipment and a control method of the electronic equipment. The electronic equipment comprises an equipment body; the first induction module is arranged on the equipment body and comprises a plurality of touch electrodes, a first induction area is formed on the first side of the equipment body, and a first induction signal can be generated after an operation body enters the first induction area; the second induction module is arranged on the equipment body, a second induction area is formed on the first side of the second induction module, a second induction signal can be generated after the operation body enters, and the maximum induction distance of the second induction area in the first direction is larger than the maximum induction distance of the first induction area in the first direction; the first direction is perpendicular to the first side; and the controller is arranged on the equipment body and is in signal connection with the first induction module and the second induction module, and the controller can control the electronic equipment to execute a corresponding response action based on the first induction signal and / or the second induction signal.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to an electronic device and a method for controlling the electronic device. Background Technology

[0002] Currently, touchpads deploy tactile sensors on printed circuit boards, which can capture finger movements within a space of up to 2 centimeters above the touchpad. Summary of the Invention

[0003] In view of the above, this application provides an electronic device and a method for controlling the electronic device, as follows:

[0004] An electronic device, comprising:

[0005] Equipment body;

[0006] A first sensing module is disposed on the device body. The first sensing module includes a plurality of touch electrodes and a first sensing area is formed on a first side of the device body, which can generate a first sensing signal after the operating object enters.

[0007] The second sensing module is disposed on the main body of the device. The second sensing module forms a second sensing area on the first side and can generate a second sensing signal after the operating object enters. The maximum sensing distance of the second sensing area in the first direction is greater than the maximum sensing distance of the first sensing area in the first direction. The first direction is perpendicular to the first side.

[0008] A controller is disposed on the device body and is signal-connected to the first sensing module and the second sensing module. The controller can control the electronic device to perform corresponding response actions based on the first sensing signal and / or the second sensing signal.

[0009] Preferably, in the above-mentioned electronic device, the device body includes a touch display portion disposed on the first side, the first sensing module is a touch module disposed on the touch display portion, and the first sensing signal is a capacitive sensing signal;

[0010] The second sensing module includes a sensor array disposed on the touch display portion, the sensor array being capable of detecting position data of the operator relative to the touch display portion within the second sensing area;

[0011] Wherein, the maximum projected area of ​​the second sensing area on the display surface of the touch display portion is the same as or different from the area of ​​the display surface, and / or, the maximum projected area of ​​the first sensing area of ​​the touch module on the display surface is the same as or different from the maximum projected area of ​​the second sensing area on the display surface.

[0012] or,

[0013] The device body includes a touch panel disposed on the first side, the first sensing module is the touch control module of the touch panel, and the first sensing signal is a capacitive sensing signal;

[0014] The second sensing module includes a sensor array disposed between the touch module and the touch surface of the touchpad, the sensor array being capable of detecting position data of the operator relative to the touch surface within the second sensing area;

[0015] Wherein, the maximum projected area of ​​the second sensing area on the touch surface is the same as or different from the area of ​​the touch surface, and / or, the maximum projected area of ​​the first sensing area of ​​the touch module on the touch surface is the same as or different from the maximum projected area of ​​the second sensing area on the touch surface.

[0016] Preferably, in the above-mentioned electronic device, the device body includes a display part and a host part rotatably connected. The host part is further provided with a touchpad and / or a touch display screen. The first sensing module is a touch module provided on the touchpad and / or the touch display screen. The second sensing module includes a sensor array provided on the touchpad and / or the touch display screen. The electronic device is able to detect the position data of the operating body relative to the touchpad or the touch display screen through the sensor array and / or the touch module.

[0017] And / or,

[0018] The controller is capable of recognizing the gestures and / or operational behaviors of the operator based on the first sensing signal and / or the second sensing signal, and controlling the target component of the electronic device to perform corresponding interactive feedback in response to the gestures and / or operational behaviors. The target component includes at least one of software applications, hardware components, system components, driving components, or artificial intelligence models.

[0019] Preferably, in the above-mentioned electronic device, the controller is also capable of controlling the second sensing module to switch from an enabled state to an enabled state when a first gesture and / or a first operation is detected based on the first sensing signal, and / or controlling the second sensing module to switch from an enabled state to an disabled state when a second gesture and / or a second operation is detected based on the second sensing signal.

[0020] And / or,

[0021] A third sensing area is formed between the first sensing area and the second sensing area. When the controller detects that the operator is located in the third sensing area, it performs gesture and / or operation behavior recognition by splicing the first operator feature identified based on the first sensing signal and the second operator feature identified based on the second sensing signal.

[0022] Preferably, the electronic device further includes at least one processing model that can run on the controller to perform actions that identify gestures and / or operational behaviors represented by the first sensing signal and / or the second sensing signal, and / or generate control commands based on the gestures and / or operational behaviors to control the target component to perform corresponding interactive feedback.

[0023] And / or,

[0024] The electronic device can also generate user profile data based on the user's usage data of the touchpad and / or touch display screen of the electronic device, and optimize the processing model for recognizing the user's gestures and / or operating behaviors based on the user profile data.

[0025] A method for controlling an electronic device, comprising:

[0026] In response to the electronic device entering a first usage mode, the second sensing module of the electronic device is controlled to switch from a disabled state to an enabled state; and

[0027] The electronic device is controlled to perform corresponding response actions based on a first sensing signal generated by a first sensing module and / or a second sensing signal generated by a second sensing module.

[0028] The first sensing module includes several touch electrodes and a first sensing area is formed on the first side of the device body of the electronic device, which can generate a first sensing signal after the operating object enters.

[0029] The second sensing module has a second sensing area formed on the first side, which can generate a second sensing signal after the operating body enters;

[0030] The maximum sensing distance of the second sensing area in the first direction is greater than the maximum sensing distance of the first sensing area in the first direction, and the first direction is perpendicular to the first side.

[0031] Preferably, in the above method, controlling the electronic device to perform a corresponding response action based on the first sensing signal generated by the first sensing module of the electronic device and / or the second sensing signal generated by the second sensing module includes:

[0032] The gestures and / or operational behaviors of the operator represented by the first sensing signal and / or the second sensing signal are identified, wherein the first sensing signal is a capacitive sensing signal generated by the touch module.

[0033] When the operator is detected to have made a target gesture and / or target operation, the target component of the electronic device is controlled to perform corresponding interactive feedback. The target component includes at least one of a software application, a hardware component, a system component, a driver component, or an artificial intelligence model.

[0034] Preferably, in the above method, the identification of the gestures and / or operational behaviors of the operator represented by the first sensing signal and / or the second sensing signal includes at least one of the following:

[0035] When the operator is detected to be within the first sensing area, the gesture and / or operation behavior of the operator represented by the capacitive sensing signal is identified.

[0036] When the operator is detected to be located within the second sensing area, the gesture and / or operation behavior of the operator represented by the second sensing signal is identified, wherein the second sensing signal includes a light wave signal;

[0037] When the operator is detected to be located in a third sensing area formed between the first sensing area and the second sensing area, the first operator feature identified based on the capacitive sensing signal and the second operator feature identified based on the light wave signal are spliced ​​together to perform the recognition of gestures or operation behaviors.

[0038] The above method, preferably, includes the following steps in response to the electronic device entering a first usage mode:

[0039] If a first gesture and / or a first operation is detected based on the first sensing signal, the electronic device is controlled to enter a first usage mode so that the second sensing module switches from a disabled state to an enabled state.

[0040] And / or,

[0041] The method further includes: when a second gesture and / or a second operation is detected based on the second sensing signal, controlling the second sensing module to switch from an enabled state to an disabled state, so that the electronic device enters a second usage mode.

[0042] The above method, preferably, involves controlling the target component of the electronic device to perform corresponding interactive feedback, including:

[0043] When the target component is used to output three-dimensional display content, a spatial mapping relationship is constructed between the three-dimensional display content and the first sensing area and the second sensing area;

[0044] When a sensing signal is generated in the first sensing area and / or the second sensing area, the target portion of the three-dimensional display content is controlled to perform a display change corresponding to the sensing signal based on the spatial mapping relationship.

[0045] As can be seen from the above technical solutions, in the electronic device and its control method disclosed in this application, two sensing modules with different sensing distances are set on the device body, thereby using a controller to control the electronic device to perform corresponding response actions based on the sensing signals generated by the two sensing modules for the operating object entering the sensing area. It is evident that this application can utilize sensing modules with different sensing distances to achieve sensing of operating objects over a wider space, thereby improving the user experience of the electronic device. Attached Figure Description

[0046] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0047] Figure 1 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0048] Figure 2 , Figure 3 , Figure 4 , Figure 5 , Figure 6 , Figure 7 , Figure 8 , Figure 9 , Figure 10 , Figure 11 , Figure 12 , Figure 13 , Figure 14 , Figure 15 , Figure 16 , Figure 17 , Figure 18 , Figure 19 , Figure 20 , Figure 21 , Figure 22 , Figure 23 , Figure 24 , Figure 25 , Figure 26 and Figure 27 These are example diagrams of electronic devices in the embodiments of this application;

[0049] Figure 28 A flowchart illustrating a control method for an electronic device provided in an embodiment of this application;

[0050] Figure 29 This is a partial flowchart of a control method for an electronic device provided in an embodiment of this application;

[0051] Figure 30 , Figure 31 , Figure 32 , Figure 33 , Figure 34 , Figure 35 , Figure 36 , Figure 37 , Figure 38 , Figure 39 and Figure 40 These are example diagrams illustrating scenarios where this application is applicable to laptops with touchpads. Detailed Implementation

[0052] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0053] refer to Figure 1 The diagram shown is a structural schematic of an electronic device provided in an embodiment of this application. This electronic device can be a touch-sensitive device, such as a laptop or tablet with a touchscreen. The technical solution in this embodiment is mainly used to improve the user experience of the electronic device.

[0054] Specifically, the electronic device in this embodiment may include the following structure:

[0055] Equipment body 101;

[0056] The first sensing module 102 is disposed on the device body 101. The first sensing module 102 includes several touch electrodes and a first sensing area 121 is formed on the first side of the device body 101. It can generate a first sensing signal after the operating object enters.

[0057] In this first sensing module 102, the touch electrode can be a self-capacitive sensing electrode, which may include a transmitting electrode and a receiving electrode. The transmitting electrode in the self-capacitive sensing electrode is used to receive a driving signal, and the receiving electrode in the self-capacitive sensing electrode is used to generate a sensing signal based on the driving signal. Alternatively, the touch electrode in the first sensing module 102 can be a mutual capacitive electrode. Correspondingly, the first sensing signal can be a capacitive sensing signal.

[0058] It should be noted that the first side of the device body 101 can be the side where the touch surface a is located in the device body 101, such as... Figure 2 As shown, the touch surface can be the touch surface of the touchpad in the device body or the touch surface of the touch display screen. The first sensing area 121 refers to the touch sensing area formed by the first sensing module 102. When the operator enters the first sensing area 121, the first sensing module 102 can generate a first sensing signal through the touch electrodes.

[0059] The object that enters the first sensing area can be any type of object, such as the user's hand, stylus, or mouse.

[0060] A second sensing module 103 is disposed on the device body 101. The second sensing module 103 has a second sensing area 131 formed on the first side. It can generate a second sensing signal after the operating object enters. The maximum sensing distance of the second sensing area 131 in the first direction is greater than the maximum sensing distance of the first sensing area in the first direction. Here, the first direction is perpendicular to the first side, such as... Figure 2 As shown in the image.

[0061] The second sensing module 103 can be an infrared (IR) module, a time-of-flight (TOF) module, or a proximity sensor (P-Sensor). In other embodiments, the second sensing module 103 can also be a radar, but the mounting surface or working surface of the device body needs to have an opening so that the second sensing signal (radar signal) generated by the radar can be transmitted. Accordingly, the second sensing signal can be an infrared sensing signal, a light pulse signal, or a radar signal.

[0062] In a specific implementation, the second sensing module 103 can perform operator sensing based on light wave signals to generate a second sensing signal. Based on this, the second sensing signal can be an electrical signal calculated based on the time of flight of the light wave signal.

[0063] In one implementation, the maximum sensing distance of the second sensing module 103 is greater than the maximum sensing distance of the first sensing module 102, such that if the first sensing module 102 and the second sensing module 103 are deployed at the same position on the device body 101 in the first direction, the maximum sensing distance of the second sensing area 131 in the first direction is greater than the maximum sensing distance of the first sensing area in the first direction. That is, the area height b2 of the second sensing area 131 in the first direction is greater than the area height b1 of the first sensing area in the first direction. Figure 3 As shown in the image.

[0064] In practice, the deployment area (radiation area of ​​the sensing region) of the first sensing module 102 and the second sensing module 103 in the device body 101 can be the same or different.

[0065] For example, such as Figure 4 As shown, the deployment area of ​​the first sensing module 102 and the second sensing module 103 in the device body 101 can be the same, and the maximum projected area of ​​the first sensing area 121 and the second sensing area 131 on the display surface (touch surface a) of the device body 101 is the same. In this case, the projected areas of the first sensing area 121 and the second sensing area 131 on the display surface overlap; as shown Figure 5 As shown, the deployment area of ​​the first sensing module 102 in the device body 101 is smaller than the deployment area of ​​the second sensing module 103 in the device body 101, and the first sensing area 121 is located within the second sensing area 131; as Figure 6 As shown, the deployment area of ​​the first sensing module 102 in the device body 101 is larger than the deployment area of ​​the second sensing module 103 in the device body 101, and the second sensing area 131 is located within the first sensing area 121.

[0066] The controller 104 is disposed on the device body 101 and is signal-connected to the first sensing module 102 and the second sensing module 103. The controller 104 can control the electronic device to perform corresponding response actions based on the first sensing signal and / or the second sensing signal.

[0067] The controller 104 can be a Touch IC (Touch Integrated Circuit), a separate microcontroller unit (MCU), or a central processing unit (CPU).

[0068] It should be noted that signal connection means that the first sensing module 102 can send a first sensing signal to the controller 104, and the second sensing module 103 can send a second sensing signal to the controller 104.

[0069] In one implementation, the controller 104 determines the specific position of the operator in the first sensing area and / or the second sensing area based on the sensing signal, and then controls the electronic device to perform the corresponding response action based only on the first sensing signal, or controls the electronic device to perform the corresponding response action based only on the second sensing signal, or performs the corresponding response action based on both the first and second sensing signals.

[0070] For example, if the controller 104 determines that the operator is in the first sensing area when it only receives the first sensing signal, then it controls the electronic device to perform the corresponding response action based only on the first sensing signal; if the controller 104 determines that the operator is in the second sensing area when it only receives the second sensing signal, then it controls the electronic device to perform the corresponding response action based only on the second sensing signal; if the controller 104 determines that the operator is in both the first and second sensing areas when it receives both the first and second sensing signals, then it performs the corresponding response action based on both the first and second sensing signals.

[0071] As can be seen from the above technical solutions, in the electronic device provided in this application embodiment, two sensing modules with different sensing distances are set on the device body, thereby using a controller to control the electronic device to perform corresponding response actions based on the sensing signals generated by the two sensing modules for the operating object entering the sensing area. It is evident that this application can utilize sensing modules with different sensing distances to achieve the sensing of operating objects within a larger space, thereby enabling the electronic device to make richer responses and improving the user experience of the electronic device.

[0072] In one implementation, the device body 101 includes a touch display portion 111 disposed on a first side. For example, the touch display portion can be a touch screen in a mobile phone, tablet device, or touch display. Correspondingly, the first sensing module 102 can be a touch module 122 disposed on the touch display portion 111. For example, the first sensing module can be a touch module disposed in the display area of ​​the touch display, such as touch electrodes disposed in the printed circuit board (PCBA) of a laptop's touch display. Figure 7 As shown in the figure. The touch module 122 can detect the position data of the operator relative to the touch display portion within the first sensing area 121. Accordingly, the first sensing signal is a capacitive sensing signal.

[0073] The second sensing module 103 includes a sensor array 132 disposed in the touch display portion 111. For example, the sensor array 132 can be an array composed of multiple IR modules, multiple TOF modules, or multiple P-sensors. The sensor array 132 is capable of detecting the position data of the operator relative to the touch display portion within the second sensing area 131.

[0074] In practice, the second sensing module 103 can be deployed based on the device type of the touch display portion 111, such as external or embedded. The placement of the second sensing module 103 relative to the touch module varies depending on the device type of the touch display portion 111.

[0075] For example, if the touch display portion 111 is external, then the second sensing module 103 can be located on the side of the touch module 122 facing away from the display surface a (i.e., the glass cover) of the touch display portion (the first side), such as... Figure 8 As shown in the diagram; if the touch display portion is embedded, such as an on-cell or in-cell structure, then the second sensing module 103 can be disposed between the touch module and the display surface a, as shown in the diagram. Figure 9 As shown in the image.

[0076] It should be noted that the position data of the operator relative to the touch display part may include: the height or distance of each position on the operator relative to the touch display part. These heights or distances constitute the point cloud coordinates of the operator relative to the touch display part. The point cloud coordinates can characterize the three-dimensional contour or three-dimensional shape of the operator, and thus the point cloud coordinates can be used to obtain the three-dimensional gestures of the operator.

[0077] Based on the above implementation, the maximum projected area of ​​the second sensing area on the display surface of the touch display portion may be the same as or different from the area of ​​the display surface. For example, as Figure 10 As shown, the second sensing module 103 is deployed along the display surface a of the touch display portion, covering the entire display surface a. Therefore, the maximum projected area of ​​the second sensing area 131 on the display surface a of the touch display portion is the same as the area of ​​the display surface; for example, as... Figure 11 As shown, to improve the sensitivity and completeness of the operator detection, the second sensing module 103 is deployed around the display surface a of the touch display portion, covering the entire display surface a while redundantly deployed at the edges of the display surface. Therefore, the maximum projected area of ​​the second sensing region 131 on the display surface a of the touch display portion is greater than the area of ​​the display surface; for example, as... Figure 12 As shown, in order to reduce the cost of electronic devices, the second sensing module 103 is deployed according to the display surface a of the touch display portion, covering the middle part of the display surface a. As a result, the maximum projected area of ​​the second sensing area 131 on the display surface a of the touch display portion is smaller than the area of ​​the display surface.

[0078] Furthermore, the maximum projected area of ​​the first sensing area 121 of the touch module on the display surface may be the same as or different from the maximum projected area of ​​the second sensing area 131 on the display surface. The touch module is disposed in the touch display section, thus the maximum projected area of ​​the first sensing area 121 of the touch module on the display surface is the same as the area of ​​the display surface. Based on this, the maximum projected area of ​​the first sensing area 121 on the display surface may be the same as or different from the maximum projected area of ​​the second sensing area on the display surface, such as... Figure 10 , Figure 11 and Figure 12As shown, the first sensing area 121 overlaps with the second sensing area 131, or the first sensing area 121 is within the second sensing area 131, or the second sensing area 131 is within the first sensing area 121.

[0079] It should be noted that the area of ​​the display surface can be the area of ​​the display area that the touch display part can output content, or the area of ​​the display surface can be the maximum area of ​​the touch display part (touch screen), and the area of ​​the display area is less than or equal to the maximum area of ​​the touch display part.

[0080] In one implementation, the device body 101 may include a touchpad 112 disposed on a first side. For example, the touchpad may be a portion of a touchpad device such as a graphics tablet or laptop capable of collecting touch sensing signals. The first sensing module 102 may be a touch module 123 of the touchpad 112. For example, the first sensing module 102 may be a touch module disposed in the touch area of ​​the touchpad device, such as the touch electrodes disposed in a laptop touchpad. Figure 13 As shown in the diagram, the touch module can detect the position data of the operator relative to the touch display portion within the first sensing area 121. Accordingly, the first sensing signal is a capacitive sensing signal.

[0081] The second sensing module 103 includes a sensing array 133, such as an array of multiple P-sensors, disposed between the touch module 123 (the first sensing module 102) and the touch surface c of the touchpad 112. If the sensor array is a radar array, an opening d can be made in the touch surface c to allow the light wave signal (i.e., radar signal) output by the sensor array 133 to be used for sensing the input object. The touch surface c of the touchpad 112 can be the glass cover of the touchpad, such as... Figure 14 As shown in the diagram, the sensor array 133 is capable of detecting the position data of the operator relative to the touch surface c within the second sensing area 131.

[0082] Based on the above implementation, the maximum projected area of ​​the second sensing area on the touch surface may be the same as or different from the area of ​​the touch surface. For example, as Figure 15 As shown, the second sensing module 103 is deployed according to the touch surface, covering the entire touch surface c, so that the maximum projected area of ​​the second sensing area 131 on the touch surface c is the same as the area of ​​the touch surface c; for example, as... Figure 16 As shown, to improve the sensitivity and completeness of the operator detection, the second sensing module 103 is deployed around the touch surface c, covering the entire touch surface c while redundantly deployed at the edges of the touch surface. Therefore, the maximum projected area of ​​the second sensing region 131 on the touch surface c is greater than the area of ​​the touch surface c; for example, as... Figure 17As shown, in order to reduce the cost of electronic devices, the second sensing module 103 is deployed according to the touch surface c, covering the middle part of the touch surface c, so that the maximum projected area of ​​the second sensing area 131 on the touch surface c is smaller than the area of ​​the touch surface.

[0083] Furthermore, the maximum projected area of ​​the first sensing area 121 of the touch module on the touch surface may be the same as or different from the maximum projected area of ​​the second sensing area 131 on the touch surface. The touch module is mounted on the touchpad, thus the maximum projected area of ​​the first sensing area 121 on the touch surface is the same as the area of ​​the touch surface. Based on this, the maximum projected area of ​​the first sensing area 121 on the touch surface may be the same as or different from the maximum projected area of ​​the second sensing area 131 on the touch surface, such as... Figure 15 , Figure 16 and Figure 17 As shown, the first sensing area 121 overlaps with the second sensing area 131, or the first sensing area 121 is within the second sensing area 131, or the second sensing area 131 is within the first sensing area 121.

[0084] It should be noted that the area of ​​the touch surface can be the area of ​​the touch area in the touchpad that can collect touch sensing signals, or the area of ​​the touch surface can be the maximum area of ​​the touchpad, and the area of ​​the touch area is less than or equal to the maximum area of ​​the touchpad.

[0085] In one implementation, the device body 101 may include a display portion 113 and a host portion 114 that are rotatably connected, such as... Figure 18 As shown in the diagram. The display section is used for outputting content; it can also be a touchscreen display, such as the touchscreen display on the B-side of a laptop. The main unit is used for processing content, such as the processor section with a keyboard on the C-side of a laptop.

[0086] Specifically, the main unit also includes a touchpad and / or a touchscreen display. For example, the touchpad is located next to the keyboard on the C-side of a laptop. Figure 19 As shown in the image; for example, a touchscreen display is deployed on the C-side of a laptop, such as... Figure 20 As shown in the image; for example, the keyboard, touchpad, and touchscreen are deployed on the C-side of a laptop, such as... Figure 21 As shown in the image.

[0087] Based on this, the first sensing module 102 is a touch module disposed on the touchpad and / or touch display screen, while the second sensing module 103 includes a sensor array disposed on the touchpad and / or touch display screen. The electronic device can detect the position data of the operator relative to the touchpad or touch display screen, that is, the position data of the operator relative to the host unit, through the sensor array and / or touch module.

[0088] For example, such as Figure 22 As shown, the operator moves in the space above the host part of the C side of the laptop. The touch module and / or sensor array deployed in the host part of the C side of the laptop can generate corresponding sensing signals in response to the operator's movement, such as a first sensing signal and a second sensing signal. The electronic device controls the electronic device to perform corresponding response actions based on the first sensing signal and / or the second sensing signal.

[0089] In one implementation, the controller 104 is able to recognize the gestures and / or operational behaviors of the operator based on a first sensing signal and / or a second sensing signal, and control the target component of the electronic device to perform corresponding interactive feedback in response to the gestures and / or operational behaviors.

[0090] The target component includes at least one of the following: software application, hardware component, system component, driver component, or artificial intelligence model. For example, the software application can be a specific application in an electronic device, such as a chat application. Based on this, in this embodiment, the chat application can be started or closed in response to the operator's gestures and / or actions. The hardware component can be a specific piece of hardware in an electronic device, such as a display screen or a speaker. Based on this, in this embodiment, the display screen brightness can be increased or decreased, or the speaker volume can be increased or decreased, in response to the operator's gestures and / or actions. The system component can be a functional module within the operating system of an electronic device, such as settings, screenshot, or task manager functions. Based on this, in this embodiment, screenshots can be taken, or the task manager can be invoked, in response to the operator's gestures and / or actions. The driver component can be a driver program for specific hardware in an electronic device, such as a camera driver. Based on this, in this embodiment, the camera driver can be updated, in response to the operator's gestures and / or actions. The artificial intelligence model can be a model deployed in an electronic device capable of providing corresponding intelligent services. Based on this, in this embodiment, image generation or text reasoning functions in the artificial intelligence model can be quickly activated, in response to the operator's gestures and / or actions.

[0091] It should be noted that the gestures of the operator can be formed by a single finger or multiple fingers and the palm, such as the gesture of closing or opening the five fingers; the operation of the operator can be the operation made by a single finger or multiple fingers and the palm, such as drawing a circle with a single finger.

[0092] Based on the above implementation, at least one processing model can also be deployed in the electronic device. These processing models can run on the controller 104 to perform actions that identify gestures and / or operational behaviors represented by the first sensing signal and / or the second sensing signal, and / or these processing models can run on the controller 104 to generate control instructions based on gestures and / or operational behaviors. The control instructions are used to control the target component to perform corresponding interactive feedback.

[0093] For example, a gesture recognition model can be deployed in a laptop and run on a controller 104. The gesture recognition model can recognize the gestures and / or operating behaviors of the operator based on a first sensing signal and / or a second sensing signal, such as the operation of drawing a circle with one finger or the gesture of closing five fingers. The gesture recognition model can also control the target component to perform corresponding interactive feedback based on the recognized gestures and / or operating behaviors of the operator. For example, the operation of drawing a circle with one finger can be used to start a chat application; or the operation of closing five fingers can be used to close a chat application.

[0094] Furthermore, in this embodiment, the electronic device can also generate user profile data based on the user's usage data of the touchpad and / or touch display screen of the electronic device, and optimize the processing model for recognizing the user's gestures and / or operating behaviors based on the user profile data.

[0095] For example, in this embodiment, during the user's use of the electronic device's touchpad and / or touch display screen, the electronic device collects and analyzes the user's usage data, such as the user's body characteristics and operating habits. Then, based on these body characteristics and operating habits, it establishes the user's personal knowledge base (database) and optimizes the recognition algorithm for gestures and operating behaviors of the processing model. As a result, with the optimization of the processing model, the processing model's recognition of the operator's gestures and / or operating behaviors becomes more accurate, thereby further improving the user's experience of using the electronic device.

[0096] In one implementation, the controller 104 can also control the second sensing module 103 to switch from a disabled state to an enabled state when a first gesture and / or a first operation is detected based on the first sensing signal. Conversely, it can control the second sensing module 103 to switch from an enabled state to a disabled state when a second gesture and / or a second operation is detected based on the second sensing signal.

[0097] For example, if a user moves within the first sensing area and makes a first gesture and / or a first operation before the second sensing module 103 is enabled, then in this embodiment, the second sensing module 103 is enabled in response to the recognized first gesture and / or first operation. At this time, the electronic device can be controlled to perform the corresponding response action based on the first sensing signal and / or the second sensing signal.

[0098] After the second sensing module 103 is enabled, if the user's body moves within the second sensing area and makes a second gesture and / or a second operation, then in this embodiment, in response to the recognized second gesture and / or second operation, the second sensing module 103 is disabled. At this time, the electronic device no longer controls the electronic device to perform the corresponding response action based on the first sensing signal and / or the second sensing signal, but may only control the electronic device to perform the corresponding response action based on the first sensing signal.

[0099] In this embodiment, the function of controlling the electronic device through the first sensing module 102 and / or the second sensing module 103 can be enabled or disabled in the operating system of the electronic device. Alternatively, in this embodiment, the function of controlling the electronic device through the first sensing module 102 and / or the second sensing module 103 can be enabled or disabled when a specific input gesture is sensed in the touchpad area.

[0100] For example, in this embodiment, when a circular finger gesture is detected on the touchpad or a control is selected in the operating system's settings interface, the function of controlling the electronic device through the first sensing module 102 and / or the second sensing module 103 is enabled. Therefore, the second sensing module 103 will only switch from an enabled state to an enabled state when a first gesture and / or first operation is detected based on the first sensing signal, and will switch from an enabled state to an disabled state when a second gesture and / or second operation is detected based on the second sensing signal. As another example, in this embodiment, when a three-finger vertical line gesture is detected on the touchpad or a close control is selected in the operating system's settings interface, the function of controlling the electronic device through the first sensing module 102 and / or the second sensing module 103 is disabled. In this case, the second sensing module 103 is no longer enabled in response to the detected first gesture and / or first operation.

[0101] It should be noted that the input gestures for enabling and disabling this function can be set by the user of the electronic device according to their business needs.

[0102] In one implementation, a third sensing area 132 is formed between the first sensing area 121 and the second sensing area 131. When the controller 104 detects that the operator is located in the third sensing area, it performs gesture and / or operation behavior recognition by splicing the first operator feature identified based on the first sensing signal and the second operator feature identified based on the second sensing signal.

[0103] The third sensing region 132 can be understood as: a portion of the region that belongs to the first sensing region but not to the second sensing region, a portion of the region that belongs to the second sensing region but not to the first sensing region, and a portion of the region that belongs to both the first and second sensing regions. That is, in the merged region of the first and second sensing regions, there are overlapping areas and non-overlapping areas between the first and second sensing regions.

[0104] It should be noted that while the operating body is located in the third sensing area, it is also located in both the first and second sensing areas.

[0105] For example, such as Figure 23 As shown, in a first direction on a first side of the device body 101, the outer edge of the first sensing area 121 facing away from the device body 101 is line 1, the inner edge of the first sensing area 121 near the device body 101 is line 2, the outer edge of the second sensing area 131 facing away from the device body 101 is line 3, and the inner edge of the second sensing area 131 near the device body 101 is line 4. Based on the sensing principle of the second sensing module, line 4 is a broken line (the radiation range of the driving signal and sensing signal of each sensor forms the edge of the broken line). There is a sensing dead zone of the second sensing module between line 2 and line 4 (the area where the operating body cannot generate the second sensing signal when entering), but the sensing dead zone of the second sensing module is within the first sensing area. At the same time, there is a sensing dead zone of the first sensing module between line 1 and line 3 (the area where the operating body cannot generate the first sensing signal when entering), but the sensing dead zone of the first sensing module is within the second sensing area. The third sensing area includes the area between line 2 and line 3.

[0106] Therefore, if the operating body is simultaneously located in the area between line 3 and line 1, and in the area between line 2 and line 4 (and possibly also in the area between line 1 and line 4), such as Figure 24 As shown, or, the control panel is simultaneously located in the area between line 1 and line 4 and the area between line 3 and line 1, as... Figure 25 As shown, the controller 104 first splices together the first operating body features identified based on the first sensing signal (including the first operating body features identified by the sensing signal in the region between line 2 and line 4, and the first operating body features identified by the sensing signal in the region between line 4 and line 1) and the second operating body features identified based on the second sensing signal (including the second operating body features identified by the sensing signal in the region between line 3 and line 1, and the second operating body features identified by the sensing signal in the region between line 1 and line 4). Then, it identifies gestures and / or operating behaviors according to the spliced ​​features, and finally controls the target component of the electronic device to perform corresponding interactive feedback according to the identified gestures and / or operating behaviors.

[0107] The second operating body feature identified by the sensing signal in the region between line 1 and line 4 is the same as the first operating body feature identified by the sensing signal in the region between line 4 and line 1.

[0108] Based on the above implementation, to avoid a dead zone between line 1 and line 4 (the area where the first sensing module 102 cannot generate the first sensing signal and the second sensing module 103 cannot generate the second sensing signal after the operator enters), such as... Figure 26 As shown in the diagram, in this embodiment, the deployment interval between adjacent sensors in the sensor array can be determined based on the radiation range of the light wave signal from the second sensing module 103. The smaller the deployment interval, the smaller or even non-existent the dead zone. Figure 24 and Figure 25 As shown in the image.

[0109] Furthermore, to improve reliability, this embodiment incorporates redundancy in the deployment interval. The plane e, where the intersection of the outer edges of the sensor's light wave signal radiation range lies, is located between the inner edge 2 and the outer edge 1 of the first sensing area 121 in the first direction, and is at a first distance x from the outer edge 1 of the first sensing area 121, thus forming a redundant region. Figure 27 As shown in the image.

[0110] refer to Figure 28 This is a flowchart illustrating the implementation of a control method for an electronic device provided in this application. This method is applicable to electronic devices capable of touch sensing, such as laptops and tablets equipped with touchscreens. Figures 1 to 27 The electronic device shown is illustrated. The technical solution in this embodiment is mainly used to improve the user experience of the electronic device.

[0111] Specifically, the control method for the electronic device in this embodiment may include the following steps:

[0112] Step 2801: In response to the electronic device entering the first usage mode, control the second sensing module of the electronic device to switch from the disabled state to the enabled state.

[0113] The first usage mode can refer to a usage mode in which electronic devices are controlled through the first sensing module and / or the second sensing module, such as a three-dimensional touch mode.

[0114] Step 2802: Control the electronic device to perform corresponding response actions based on the first sensing signal generated by the first sensing module of the electronic device and / or the second sensing signal generated by the second sensing module.

[0115] The first sensing module includes several touch electrodes and forms a first sensing area on a first side of the electronic device body, capable of generating a first sensing signal upon the entry of an object. The second sensing module forms a second sensing area on the first side, capable of generating a second sensing signal upon the entry of an object. The maximum sensing distance of the second sensing area in a first direction is greater than the maximum sensing distance of the first sensing area in the first direction, and the first direction is perpendicular to the first side. Figure 2 and Figure 3 As shown in the image.

[0116] As can be seen from the above technical solutions, in the control method for an electronic device provided in this application embodiment, two sensing modules with different sensing distances are set in the electronic device. In response to the electronic device entering a first usage mode, the electronic device executes corresponding response actions based on the sensing signals generated by each of the two sensing modules for an operating object entering the sensing area. Therefore, this application can utilize sensing modules with different sensing distances to achieve sensing of operating objects within a larger space, thereby enabling the electronic device to make richer responses and improving the user experience.

[0117] The specific implementation methods of the first sensing module and the second sensing module in the electronic device can be referred to in the preceding text. Figures 4 to 27 The structure shown will not be described in detail here.

[0118] In one implementation, step 2802 can be implemented in the following way, such as... Figure 29 As shown:

[0119] Step 2901: Identify the gestures and / or operational behaviors of the operator represented by the first sensing signal and / or the second sensing signal.

[0120] The first sensing module is either a touch module in the touch display part of an electronic device or a touch module in the touchpad of an electronic device. Correspondingly, the first sensing signal is a capacitive sensing signal generated by the touch module (first sensing module).

[0121] Specifically, in this embodiment, a processing model deployed in the electronic device can identify the gestures and / or operational behaviors of the operator represented by the first sensing signal and / or the second sensing signal. The processing model can be optimized based on user profile data generated from the operator's usage data of the electronic device's touchpad and / or touch display screen.

[0122] Step 2902: When the target gesture and / or target operation behavior is detected by the operator, the target component of the electronic device is controlled to perform the corresponding interactive feedback.

[0123] The target component includes at least one of the following: software application, hardware component, system component, driving component, or artificial intelligence model.

[0124] Specifically, in this embodiment, the identified gesture of the operator can be compared with a preset gesture template in the database to identify whether the operator has made the target gesture; and / or, in this embodiment, the identified operation behavior of the operator can be compared with a threshold behavior template in the database to identify whether the operator has made the target operation behavior. Accordingly, in this embodiment, when the operator is identified to have made the target gesture and / or the target operation behavior, the target component is controlled to perform the corresponding function, such as launching an application, adjusting the speaker volume, updating the camera driver, or launching an artificial intelligence model to generate images.

[0125] Different target gestures result in different interactive responses from the target components. For example, ... Figure 30 As shown, the database defines multiple gesture templates, such as gesture models like "waving your palm from left to right", "waving your palm from right to left", "waving your palm from top to bottom", and "waving your palm from bottom to top". Each gesture template corresponds to a function (interactive feedback), such as "next page / scroll down", "previous page / scroll up", "screenshot", and "switch from desktop to return to desktop, or switch from desktop to lock screen".

[0126] As can be seen, in this embodiment, the operator can trigger quick operations or rapid function control through target gestures and / or target operation behaviors.

[0127] In one implementation, this embodiment identifies the gestures and / or operational behaviors of the operator represented by the first sensing signal and / or the second sensing signal, including at least one of the following:

[0128] When the operator is detected to be within the first sensing area, the gesture and / or operation behavior of the operator represented by the capacitive sensing signal (first sensing signal) is identified.

[0129] When the operator is detected to be located within the second sensing area, the gesture and / or operation behavior of the operator represented by the second sensing signal is identified. The second sensing signal includes a light wave signal (the second sensing module can sense the operator based on the light wave signal to generate the second sensing signal. Based on this, the second sensing signal can be an electrical signal calculated based on the time of flight of the light wave signal).

[0130] When the operator is detected to be located in a third sensing area formed between the first sensing area and the second sensing area, the first operator feature identified based on the capacitive sensing signal and the second operator feature identified based on the light wave signal are spliced ​​together to perform the recognition of gestures or operation behaviors.

[0131] In one implementation, the response of the electronic device to enter the first usage mode in this embodiment may include the following implementation:

[0132] When a first gesture and / or first operation is detected based on a first sensing signal, the electronic device is controlled to enter a first usage mode so that the second sensing module switches from a disabled state to an enabled state.

[0133] Furthermore, in this embodiment, when a second gesture and / or a second operation are detected based on the second sensing signal, the second sensing module can be controlled to switch from an enabled state to a disabled state, so that the electronic device enters a second usage mode.

[0134] In one implementation, this embodiment controls the target component of the electronic device to perform corresponding interactive feedback, specifically as follows:

[0135] When the target component is used to output three-dimensional display content, a spatial mapping relationship is established between the three-dimensional display content and the first sensing area and the second sensing area; then, when the first sensing area and / or the second sensing area generates a sensing signal, based on the spatial mapping relationship, the target part of the three-dimensional display content is controlled to perform a display change corresponding to the sensing signal.

[0136] The 3D display content can be a 3D model, such as 3D image data, 3D video data, or 3D virtual image of a specific product. In other embodiments, the 3D display content can also serve as a virtual intelligent assistant for interaction with the user.

[0137] It should be noted that the spatial mapping relationship can be a spatial coordinate mapping between the first sensing area (capacitive sensing area) and the 3D display content; or, a spatial mapping relationship can be a spatial coordinate mapping between the second sensing area and the 3D display content; or, a spatial mapping relationship can be a spatial coordinate mapping between the overall sensing area formed by the first and second sensing areas and the 3D display content. Based on this, in this embodiment, based on the spatial mapping relationship, the target portion of the 3D display content can be controlled to perform corresponding display changes according to the sensing signals generated by the corresponding sensing areas, such as the pet waving its front paw or raising its hind paw. Figure 31 As shown in the image.

[0138] The generation of sensing signals by the first sensing area and / or the second sensing area can include the following situations:

[0139] Only the first sensing area generates a sensing signal, i.e., the first sensing signal;

[0140] Only the second sensing area generates a sensing signal, i.e., the second sensing signal;

[0141] Both the first sensing area and the second sensing area generate sensing signals, namely the first sensing signal and the second sensing signal.

[0142] Based on this, if the user's operating object appears only in the first sensing area, only the first sensing area generates a sensing signal. In this embodiment, based on the spatial mapping relationship between the first sensing area and the three-dimensional display content, the target part of the three-dimensional display content is controlled to perform a display change corresponding to the first sensing signal. If the user's operating object appears only in the second sensing area, only the second sensing area generates a sensing signal. In this embodiment, based on the spatial mapping relationship between the second sensing area and the three-dimensional display content, the target part of the three-dimensional display content is controlled to perform a display change corresponding to the second sensing signal. If the user's operating object appears simultaneously in the first and second sensing areas, a first sensing signal is generated in the first sensing area and a second sensing signal is also generated in the second sensing area. In this embodiment, based on the spatial mapping relationship between the overall sensing area formed by the first and second sensing areas and the three-dimensional display content, the target content of the three-dimensional display content is controlled to perform a display change corresponding to the first and second sensing signals.

[0143] In this specific implementation, the target portion of the 3D display content corresponding to the location of the operator can be calculated through spatial mapping, so as to at least cause the display content of the target portion to send corresponding changes, thereby realizing interactive control. For example, through spatial mapping, it is determined that the operator is located in the upper half of the second sensing area. Thus, the upper half of the second sensing area corresponds to the head of the virtual 3D (3Dimensions) image. In this embodiment, based on the spatial mapping and the gestures or operation behaviors corresponding to the second sensing signals, the head of the virtual 3D image can be controlled to perform display changes such as scaling, tapping, and rotating the viewing angle, thereby realizing interactive control of the virtual 3D image.

[0144] It should be noted that in this embodiment, the target part of the three-dimensional display content can be controlled to perform display changes according to the gestures and / or operation behaviors identified by the sensing signals.

[0145] Specifically, when the gesture identified by the sensing signal matches the target gesture and / or the operation behavior identified by the sensing signal matches the target operation behavior, the target part of the 3D display content is controlled to perform a display change. For example, if the target gesture is a 3D gesture, the corresponding target part of the 3D display content is the head or feet of a virtual 3D character, such as the front or hind paws of a virtual pet. Based on this, in this embodiment, the head of the virtual 3D character can be controlled to shake according to the 3D gesture to achieve interactive feedback.

[0146] For example, such as Figure 32As shown, for 3D models such as virtual pets, if the operator makes the target gesture "palm expansion", then in this embodiment the 3D model (projection) area is enlarged; if the operator makes the target gesture "palm folding", then in this embodiment the 3D model (projection) area is reduced; if the operator makes the target gesture "palm pulling up", then in this embodiment the 3D model (vertical) height is stretched; if the operator makes the target gesture "palm pressing down", then in this embodiment the 3D model (vertical) height is compressed; and so on.

[0147] Taking the deployment of a keyboard and touchpad on the C-side of a laptop as an example, the technical solution of this application is illustrated below:

[0148] This application integrates several P-sensors between the PCBA and the glass layer, based on the structure of a touchpad. Utilizing the advantage of P-sensors' detection distance of over 10cm, it overcomes the limitation of capacitive touchpads with a detection distance of less than 2cm in the Z-direction. By combining P-sensor detection with capacitive detection, continuous 3D spatial operations within a certain distance range from the touchpad surface to above the touchpad can be achieved, such as... Figure 33 As shown in the image.

[0149] The specific plan is as follows:

[0150] 1. Several P-sensors are integrated on the touchpad's PCBA. The P-sensors are mounted on the PCBA using surface mount technology (SMT), such as... Figure 34 As shown, the P-sensor is small in size, or a larger P-sensor is embedded in an opening in the PCBA. An IR-transmitting ink is silkscreened directly above the P-sensor to allow the P-sensor to detect IR light passing through. Each P-sensor (P-sensor1 to P-sensor4, etc.) acts as a slave device to the Touch IC in the laptop, having a different address. The Touch IC, as the host device, connects to each P-sensor via I2C, controlling the touch module (touch sensor) and the P-sensors, as shown... Figure 35 As shown, TouchIC connects to the laptop's operating system system via I2C.

[0151] 2. Because the IR beam emitted by the P-sensor has an angle Θ (e.g., 120°), such as Figure 34 and Figure 36As shown, there is a detection dead zone between adjacent P-sensors. To improve the accuracy of 3D gesture recognition, the touchpad must avoid detection dead zones within its detectable range. Therefore, the layout of the P-sensor array must satisfy the condition that the dead zone-free boundary (e.g., line 5) is lower than the upper limit of the touchpad's self-capacity detection. Line 5 is the plane e formed by the intersection of the outer edges of the radiation range of the IR beams of each P-sensor, and line 5 is lower than line 1. To retain some redundancy, a height is selected between the upper limit of the touchpad's self-capacity detection (line 1) and the lower limit of the P-sensor array's dead zone-free boundary (line 4 (line 5)). Line 6 serves as the boundary between self-capacity detection (first sensing area) and P-sensor detection (second sensing area), defined as the CP boundary.

[0152] 3. A large AI (Artificial Intelligence) model is built into the Touch IC. This model contains pre-trained appearance feature parameters of various operating objects such as fingers / palms, including but not limited to appearance data under various flip and tilt angles of the fingers / palms. In other words, hand templates and behavior templates are set in the database. When the user begins to operate, i.e., when the finger is placed on the Touchpad operating area, such as... Figure 37 As shown, the processing flow is as follows:

[0153] 1) Touchpad recognizes the shape of the operating object;

[0154] 2) The shape is sent to the large model and compared with the built-in feature data (hand templates and behavior templates in the database) to determine whether the feature is a finger or a palm, and whether it is a single finger, two fingers or multiple fingers;

[0155] 3) After judging the features, if it contains fingers (single finger / two fingers / three fingers, etc.), then continue to identify the feature action, whether it is a single finger movement or a two-finger movement, whether it is a single finger click or a two-finger zoom, etc.

[0156] 4) Report the corresponding gesture to complete the operation interaction.

[0157] 4. 3D touch applications (the applications implementing this application) can be turned on and off by inputting specific gesture definitions through Windows system settings or touchpad area, such as drawing a circle with a finger on the touchpad surface to turn on the application, making a fist above the touchpad to turn off the application, or other suitable gesture definitions to turn 3D functions on and off (users can customize).

[0158] 5. The division of labor between the self-capacitance and P-sensor array, along with the TouchIC's feature and gesture integration and judgment capabilities, ensures the smoothness of user gestures in the 3D operating area. The main steps and logic of 3D gesture recognition from the moment a finger enters the 3D Touchpad operating area are as follows: Figure 38 As shown:

[0159] 1) When a finger is below the CP boundary, the touch IC detects the finger's shape and compares it with feature data in the large model to determine if it is a finger, and whether it is a single finger or multiple fingers. After determining the finger features, finger movement, fingertip taps, and two-finger opening / closing will all cause changes in the touch IC data. For example, fingertip taps will gradually increase the touch IC data because the distance between the fingertip and the touchpad surface is close. The Touch IC analyzes and compares the gestures to make a final judgment and reports the gesture.

[0160] 2) When a finger moves to the CP boundary, that is, part of the finger is below the CP line and part of the finger is above the CP line, the part below the CP line recognizes the characteristics and gestures, the P-sensor recognizes the features and gestures above the CP line, and then summarizes them to the Touch IC for feature and feature action splicing. After splicing, the Touch IC performs gesture analysis and judgment.

[0161] 3) Move your finger to the CP line and be located at... Figure 36 Below the midline 3, the shape and movement of the operation features are all completed by the P-sensor array. The P-sensor array combination can integrate the shape of features such as fingers and compare them with features in the large model. At the same time, it can recognize the 3D spatial movement of features. TouchIC performs gesture analysis and judgment based on gesture features and feature movement operations.

[0162] 6. In addition to recognizing common touch gestures such as cursor movement / click / zoom in 3D space, this application can also be used in scenarios such as 3D modeling and keyboard shortcuts:

[0163] 1) 3D modeling interaction: By using features such as the palm to gather / expand / pull / press down, the 3D spatial model can be reduced / enlarged / stretched / compressed, as shown in 31, thus expanding human-computer interaction applications and improving user experience.

[0164] 2) Keyboard shortcuts: For example, defining a horizontal swipe of the palm from top to bottom on the touchpad enables the lock screen function instead of Win+L, and a swipe from top to bottom enables the screenshot function instead of Alt+PrtSc or Win+Shift+S, such as... Figure 30 As shown, this can significantly improve operational efficiency, thereby enhancing the user's human-computer interaction experience.

[0165] 7. The Touchpad in this application has AI learning capabilities: such as... Figure 39 As shown, this involves collecting and analyzing user data during usage, such as body appearance features and operational habits. Based on these features and habits, a personal database is built, and the gesture recognition algorithm is optimized to improve accuracy and usability with continued use, thus enhancing the user experience. Figure 40 The image shows an AI learning process based on a touchpad:

[0166] First, during the user's use of the laptop, the self-capacitance and / or P-sensor generate sensing signals. In this embodiment, the spatial location of the operator's gesture is identified based on the sensing signals generated by the self-capacitance and / or P-sensor, and the corresponding sensing signals are segmented. Then, the gesture feature values ​​represented by the segmented sensing signals are extracted according to expert-defined rules. By inputting the gesture feature values ​​into an artificial intelligence model for gesture recognition, the artificial intelligence model infers the gesture type. Based on the inference result of the artificial intelligence model, i.e., the gesture type, the gesture recognition algorithm is optimized. Specifically, in this embodiment, the gesture recognition algorithm can be optimized through firmware. The firmware can be the firmware of the Touch IC, the firmware of the MCU, the firmware of the CPU, the firmware of the Basic Input Output System (BIOS), etc.

[0167] In summary, the technical solution of this application has the following advantages:

[0168] a) This application integrates several P-sensors on the PCBA of the Touchpad. By combining the P-sensors with the self-capacitance (mutual capacitance electrode) detection of the Touchpad, it can accurately identify user operation gestures within a certain distance above the Touchpad and realize the corresponding gesture functions. This achieves true three-dimensional 3D spatial control above the Touchpad and greatly enriches the application scenarios.

[0169] b) In addition to recognizing basic touch gestures in three-dimensional space, this application can also be used for three-dimensional modeling. By using actions such as gathering / expanding / pulling up / pressing down the palm, the three-dimensional model can be reduced / expanded / stretched / compressed, thus expanding the scope of human-computer interaction applications and improving user experience.

[0170] c) This application can implement shortcut key functions by defining three-dimensional 3D gestures, such as defining a horizontal waving of the palm from top to bottom of the touchpad as locking the screen, and a horizontal waving of the palm from top to bottom of the touchpad as taking a screenshot, which can significantly improve operating efficiency and thus enhance the user's human-computer interaction experience.

[0171] d) The 3D contactless control implemented in this application can, to some extent, solve the problem of cross-infection of equipment, especially public equipment, in special scenarios such as epidemics / flu, while reducing dirt on the touchpad surface;

[0172] e) The Touchpad in this application has AI learning capabilities. It can build a personal database based on the user's body characteristics (finger shape) and gesture operation habits, and optimize the gesture recognition algorithm in a timely manner so that the more the user uses the gesture recognition, the more accurate it becomes, thereby improving the user experience.

[0173] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0174] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0175] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0176] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An electronic device, comprising: Equipment body; A first sensing module is disposed on the device body. The first sensing module includes a plurality of touch electrodes and a first sensing area is formed on a first side of the device body, which can generate a first sensing signal after the operating object enters. The second sensing module is disposed on the main body of the device. The second sensing module forms a second sensing area on the first side and can generate a second sensing signal after the operating object enters. The maximum sensing distance of the second sensing area in the first direction is greater than the maximum sensing distance of the first sensing area in the first direction. The first direction is perpendicular to the first side. A controller is disposed on the device body and is signal-connected to the first sensing module and the second sensing module. The controller can control the electronic device to perform corresponding response actions based on the first sensing signal and / or the second sensing signal.

2. The electronic device according to claim 1, wherein the device body includes a touch display portion disposed on the first side, the first sensing module is a touch module disposed on the touch display portion, and the first sensing signal is a capacitive sensing signal; The second sensing module includes a sensor array disposed on the touch display portion, the sensor array being capable of detecting position data of the operator relative to the touch display portion within the second sensing area; in, The maximum projected area of ​​the second sensing area on the display surface of the touch display portion is the same as or different from the area of ​​the display surface, and / or, the maximum projected area of ​​the first sensing area of ​​the touch module on the display surface is the same as or different from the maximum projected area of ​​the second sensing area on the display surface; or, The device body includes a touch panel disposed on the first side, the first sensing module is the touch control module of the touch panel, and the first sensing signal is a capacitive sensing signal; The second sensing module includes a sensor array disposed between the touch module and the touch surface of the touchpad, the sensor array being capable of detecting position data of the operator relative to the touch surface within the second sensing area; Wherein, the maximum projected area of ​​the second sensing area on the touch surface is the same as or different from the area of ​​the touch surface, and / or, the maximum projected area of ​​the first sensing area of ​​the touch module on the touch surface is the same as or different from the maximum projected area of ​​the second sensing area on the touch surface.

3. The electronic device according to claim 1, wherein the device body comprises a display portion and a host portion rotatably connected, the host portion further comprising a touchpad and / or a touch display screen, the first sensing module being a touch module disposed on the touchpad and / or the touch display screen, the second sensing module comprising a sensor array disposed on the touchpad and / or the touch display screen, and the electronic device being capable of detecting position data of an operating body relative to the touchpad or the touch display screen through the sensor array and / or the touch module; And / or, The controller is capable of recognizing the gestures and / or operational behaviors of the operator based on the first sensing signal and / or the second sensing signal, and controlling the target component of the electronic device to perform corresponding interactive feedback in response to the gestures and / or operational behaviors. The target component includes at least one of software applications, hardware components, system components, driving components, or artificial intelligence models.

4. The electronic device according to claim 1, wherein the controller is further capable of controlling the second sensing module to switch from an enabled state to an enabled state when a first gesture and / or a first operation is detected based on the first sensing signal, and / or controlling the second sensing module to switch from an enabled state to an disabled state when a second gesture and / or a second operation is detected based on the second sensing signal. And / or, A third sensing area is formed between the first sensing area and the second sensing area. When the controller detects that the operator is located in the third sensing area, it performs gesture and / or operation behavior recognition by splicing the first operator feature identified based on the first sensing signal and the second operator feature identified based on the second sensing signal.

5. The electronic device according to claim 1, wherein the electronic device further comprises at least one processing model, the at least one processing model being capable of running on the controller to perform actions that identify gestures and / or operational behaviors characterized by the first sensing signal and / or the second sensing signal, and / or, based on the gestures and / or operational behaviors, generate control instructions for the target component to perform corresponding interactive feedback. And / or, The electronic device can also generate user profile data based on the user's usage data of the touchpad and / or touch display screen of the electronic device, and optimize the processing model for recognizing the user's gestures and / or operating behaviors based on the user profile data.

6. A control method for an electronic device, comprising: In response to the electronic device entering the first usage mode, the second sensing module of the electronic device switches from the disabled state to the enabled state. as well as, The electronic device is controlled to perform corresponding response actions based on a first sensing signal generated by a first sensing module and / or a second sensing signal generated by a second sensing module. The first sensing module includes several touch electrodes and a first sensing area is formed on the first side of the device body of the electronic device, which can generate a first sensing signal after the operating object enters. The second sensing module has a second sensing area formed on the first side, which can generate a second sensing signal after the operating body enters; The maximum sensing distance of the second sensing area in the first direction is greater than the maximum sensing distance of the first sensing area in the first direction, and the first direction is perpendicular to the first side.

7. The method according to claim 6, wherein controlling the electronic device to perform a corresponding response action based on the first sensing signal generated by the first sensing module of the electronic device and / or the second sensing signal generated by the second sensing module includes: The gestures and / or operational behaviors of the operator represented by the first sensing signal and / or the second sensing signal are identified, wherein the first sensing signal is a capacitive sensing signal generated by the touch module. When the operator is detected to have made a target gesture and / or target operation, the target component of the electronic device is controlled to perform corresponding interactive feedback. The target component includes at least one of a software application, a hardware component, a system component, a driver component, or an artificial intelligence model.

8. The method according to claim 7, wherein identifying the gesture and / or operational behavior of the operator represented by the first sensing signal and / or the second sensing signal includes at least one of the following: When the operator is detected to be within the first sensing area, the gesture and / or operation behavior of the operator represented by the capacitive sensing signal is identified. When the operator is detected to be located within the second sensing area, the gesture and / or operation behavior of the operator represented by the second sensing signal is identified, wherein the second sensing signal includes a light wave signal; When the operator is detected to be located in a third sensing area formed between the first sensing area and the second sensing area, the first operator feature identified based on the capacitive sensing signal and the second operator feature identified based on the light wave signal are spliced ​​together to perform the recognition of gestures or operation behaviors.

9. The method according to claim 6, wherein, In response to an electronic device entering a first usage mode, including: If a first gesture and / or a first operation is detected based on the first sensing signal, the electronic device is controlled to enter a first usage mode so that the second sensing module switches from a disabled state to an enabled state. And / or, The method further includes: when a second gesture and / or a second operation is detected based on the second sensing signal, controlling the second sensing module to switch from an enabled state to an disabled state, so that the electronic device enters a second usage mode.

10. The method according to claim 7, wherein, Controlling the target component of the electronic device to perform corresponding interactive feedback includes: When the target component is used to output three-dimensional display content, a spatial mapping relationship is constructed between the three-dimensional display content and the first sensing area and the second sensing area; When a sensing signal is generated in the first sensing area and / or the second sensing area, the target portion of the three-dimensional display content is controlled to perform a display change corresponding to the sensing signal based on the spatial mapping relationship.

Images