Gesture recognition method, electronic equipment and storage medium

Abstract

The invention provides a gesture recognition method, electronic equipment and a storage medium. The method comprises the steps that a damaged area and a virtual hot area of a touch screen are determined; when the user carries out a downward sliding operation by taking the damaged area as a starting point, in response to the detected operation of the user in the virtual hot area, compensating a starting point coordinate corresponding to the operation in the virtual hot area, so that the compensated starting point coordinate is located in the reference hot area; and reporting the compensated starting point coordinates to an upper layer, wherein the compensated starting point coordinates are used for gesture recognition. According to the method provided by the invention, the gesture of the user can be effectively recognized under the condition that the edge of the screen of the electronic equipment is damaged.

Description

Technical Field

[0001] This application relates to the field of smart terminals, and more particularly to a gesture recognition method, electronic device, and storage medium. Background Technology

[0002] Gesture operation is a common operation for users on electronic devices. Users can use their fingers to perform gestures such as swiping down, swiping sideways, or swiping up on electronic devices to activate corresponding tasks.

[0003] Since the touch control of electronic device touch screens relies on the horizontal and vertical electrical signal channels on the touch screen, when the edge of the electronic device touch screen is damaged, the channel is prone to breakage, which will cause abnormal signal on the channel and make it impossible to effectively detect the user's finger touch, thus causing the user's gesture operation to fail.

[0004] In related technologies, there is a lack of technical means to effectively recognize user gestures when the screen edge of an electronic device is damaged. Summary of the Invention

[0005] This application provides a gesture recognition method, an electronic device, and a storage medium, which helps to effectively recognize user gestures even when the screen edge of an electronic device is damaged.

[0006] In a first aspect, embodiments of this application provide a gesture recognition method applied to an electronic device, the electronic device including a touch screen, the method comprising: determining a damaged area and a virtual hot zone of the touch screen; when a user performs a swipe-down operation starting from the damaged area, in response to detecting the user's operation in the virtual hot zone, compensating the starting coordinates of the operation corresponding to the operation in the virtual hot zone, such that the compensated starting coordinates are located within a reference hot zone; and reporting the compensated starting coordinates to an upper layer, the compensated starting coordinates being used for gesture recognition.

[0007] In related technologies, when the screen edge of an electronic device is damaged and the user's gestures cannot be recognized, the user needs to perform relatively complicated operations to bypass the damaged area of ​​the screen in order to recognize the user's gestures. The technical solution of this application can effectively recognize the user's gestures even when the screen edge of the electronic device is damaged without changing the user's usage habits, and is imperceptible to the user.

[0008] In one possible implementation, determining the damaged area of ​​the touchscreen includes: acquiring screen data at least once; and determining the damaged area of ​​the touchscreen in response to an anomaly in the at least once screen data.

[0009] In this embodiment of the application, the accuracy of bad sector determination can be improved by repeatedly detecting screen data.

[0010] In one possible implementation, the compensation of the starting coordinates of the operation in the virtual hot zone in response to detecting a user's operation in the virtual hot zone includes: in response to detecting a user's operation in the virtual hot zone, and the damaged area range being greater than or equal to the reference hot zone range, compensating the starting coordinates of the operation in the virtual hot zone; or, in response to detecting a user's operation in the virtual hot zone, and the damaged area exceeding the reference hot zone range being less than a preset range threshold, compensating the starting coordinates of the operation in the virtual hot zone.

[0011] In this embodiment of the application, when the bad area range exceeds a certain range of the reference hot area, the algorithm compensation is activated, which can effectively avoid misjudgment when the user swipes near the edge.

[0012] In one possible implementation, the step of compensating the starting coordinates of the operation in the virtual hotspot in response to detecting the user's operation in the virtual hotspot includes: in response to detecting the user's operation in the virtual hotspot and determining that the operation is an underscore operation, compensating the starting coordinates of the operation in the virtual hotspot.

[0013] This application embodiment can effectively avoid the impact of user click operations on user gesture recognition by determining the user's swipe operation.

[0014] In one possible implementation, determining that the operation is a swipe-down operation includes: after a preset timeout, if no user lift-up operation is detected within the preset timeout and the user's swipe-down distance is greater than or equal to a preset swipe-down threshold, determining that the operation is a swipe-down operation; or, within the preset timeout, in response to detecting a user lift-up operation and the user's swipe-down distance being greater than or equal to the preset swipe-down threshold, determining that the operation is a swipe-down operation.

[0015] This application embodiment can effectively avoid misjudgments caused by user click operations by judging based on a preset time period.

[0016] In one possible implementation, reporting the compensated starting point coordinates to the upper layer includes: using the compensated starting point coordinates as the starting point, compensating one or more connection points so that the one or more connection points form a continuous downward trajectory with the starting point, and the one or more connection points have the same ordinate as the starting point; and reporting the compensated starting point coordinates and the coordinates of the one or more connection points to the upper layer.

[0017] In this embodiment, by compensating for multiple connection points, a smoother swipe trajectory can be formed, thereby improving the accuracy of recognizing user gestures.

[0018] Secondly, embodiments of this application provide a gesture recognition device, including one or more functional modules, which are used to implement the gesture recognition method as described in the first aspect.

[0019] Thirdly, embodiments of this application provide an electronic device, including: a processor and a memory, wherein the memory is used to store a program; and the processor is used to run the program to implement the gesture recognition method as described in the first aspect.

[0020] Fourthly, embodiments of this application provide a readable storage medium storing a program that, when run on an electronic device, causes the electronic device to implement the gesture recognition method as described in the first aspect.

[0021] Fifthly, embodiments of this application provide a program that, when run on a processor of an electronic device, causes the electronic device to perform the gesture recognition method as described in the first aspect.

[0022] In one possible design, the program in the fifth aspect can be stored wholly or partially on a storage medium packaged with the processor, or it can be stored wholly or partially on a memory not packaged with the processor. Attached Figure Description

[0023] Figure 1 This is a schematic diagram of gesture recognition technology.

[0024] Figure 2 A schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application;

[0025] Figure 3 A flowchart illustrating an embodiment of the gesture recognition method provided in this application;

[0026] Figure 4 A flowchart illustrating another embodiment of the gesture recognition method provided in this application;

[0027] Figure 5 A flowchart illustrating another embodiment of the gesture recognition method provided in this application;

[0028] Figure 6 A flowchart illustrating another embodiment of the gesture recognition method provided in this application;

[0029] Figure 7 A flowchart illustrating another embodiment of the gesture recognition method provided in this application;

[0030] Figure 8 A flowchart illustrating another embodiment of the gesture recognition method provided in this application;

[0031] Figure 9 A schematic diagram of gesture recognition provided in an embodiment of this application;

[0032] Figure 10 This is a schematic diagram of the structure of the gesture recognition device provided in the embodiments of this application. Detailed Implementation

[0033] In this embodiment of the application, unless otherwise stated, the character " / " indicates that the preceding and following objects are in an OR relationship. For example, A / B can represent A or B. "AND / OR" describes the relationship between the associated objects, indicating that three relationships can exist. For example, A AND / OR B can represent: A existing alone, A and B existing simultaneously, and B existing alone.

[0034] It should be noted that the terms "first" and "second" used in the embodiments of this application are used only for distinguishing descriptive purposes and should not be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated, nor should they be construed as indicating or implying order.

[0035] In the embodiments of this application, "at least one" refers to one or more items, and "more than one" refers to two or more items. Furthermore, "at least one of the following" or similar expressions refer to any combination of these items, which may include any combination of a single item or a plurality of items. For example, at least one of A, B, or C can represent: A, B, C, A and B, A and C, B and C, or A, B, and C. Each of A, B, and C can be an element itself or a set containing one or more elements.

[0036] In this application, terms such as "exemplary," "in some embodiments," and "in another embodiment" are used to indicate that something is an example, illustration, or description. Any embodiment or design described as "exemplary" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the term "exemplary" is intended to present the concept in a concrete manner.

[0037] In the embodiments of this application, the terms "of," "corresponding (relevant)," and "corresponding" may sometimes be used interchangeably. It should be noted that, without emphasizing the distinction, their meanings are consistent. Similarly, in the embodiments of this application, "communication" and "transmission" may sometimes be used interchangeably. It should be noted that, without emphasizing the distinction, their meanings are consistent. For example, transmission can include sending and / or receiving, and can be a noun or a verb.

[0038] In the embodiments of this application, the term "equal to" can be used in conjunction with "greater than" to apply to technical solutions employing the condition of "greater than", and can also be used in conjunction with "less than" to apply to technical solutions employing the condition of "less than". It should be noted that when "equal to" is used with "greater than", it cannot be used with "less than"; and when "equal to" is used with "less than", it cannot be used with "greater than".

[0039] Gesture operation is a common operation for users on electronic devices. Users can use their fingers to perform gesture operations such as swiping down, swiping sideways, and swiping up on electronic devices.

[0040] Since the touch control of electronic device displays relies on the horizontal and vertical electrical signal channels on the display, when the edge of the electronic device's display is damaged, the channel is prone to breakage. This can lead to abnormal signals on the channel, making it impossible to effectively detect the user's finger touch, thus causing the user's gesture operation to fail.

[0041] In related technologies, there is a lack of technical means to effectively recognize user gestures when the screen edge of an electronic device is damaged.

[0042] Figure 1 An exemplary schematic diagram of gesture recognition in related technologies is shown.

[0043] refer to Figure 1 , Figure 1 The left image shows a user waking up the notification center by swiping down when the edge of the electronic device's screen is undamaged. Figure 1 The right image shows that when the top edge of an electronic device's screen is damaged, the user cannot wake up the notification center by swiping down.

[0044] To address the aforementioned issues, this application proposes a gesture recognition method applicable to electronic devices including touchscreens. The electronic device can be a fixed device, such as a large screen, laptop, or desktop computer. It can also be a mobile device, which can be referred to as User Equipment (UE), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile terminal, user terminal, terminal, wireless communication equipment, user agent, or user device. Mobile devices can be stations (STAION, ST) in a WLAN, cellular phones, cordless phones, Session Initiation Protocol (SIP) phones, Wireless Local Loop (WLL) stations, Personal Digital Assistant (PDA) devices, handheld devices with wireless communication capabilities, computing devices or other processing devices connected to a wireless modem, in-vehicle devices, vehicle-to-everything (V2X) terminals, computers, laptops, handheld communication devices, handheld computing devices, satellite wireless devices, wireless modem cards, set-top boxes (STBs), customer premises equipment (CPEs), and / or other devices used for communication over wireless systems, as well as next-generation communication systems, such as mobile devices in 5G networks or mobile devices in future evolved Public Land Mobile Networks (PLMNs). These mobile devices can also be wearable devices. Wearable devices, also known as wearable smart devices, are a general term for devices that utilize wearable technology to intelligently design and develop everyday wearable items, such as glasses, gloves, watches, clothing, and shoes. Wearable devices are portable devices that are worn directly on the body or integrated into a user's clothing or accessories. Wearable devices are not just hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction.

[0045] Figure 2 First, the hardware structure of the electronic device 100 is shown as an example.

[0046] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0047] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0048] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0049] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0050] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0051] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0052] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0053] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0054] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0055] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0056] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0057] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0058] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0059] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0060] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0061] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0062] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0063] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0064] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0065] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0066] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0067] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0068] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0069] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0070] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0071] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.

[0072] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0073] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0074] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0075] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0076] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0077] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0078] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0079] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0080] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0081] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0082] Next, combined Figure 3 The gesture recognition method provided in the embodiments of this application will be described.

[0083] like Figure 3 The diagram shown is a flowchart of an embodiment of the gesture recognition method provided in this application, which specifically includes the following steps:

[0084] Step 301: Determine the damaged area and virtual hot zone of the touchscreen.

[0085] Specifically, when an electronic device's screen is turned on, it can detect whether there are any damaged areas on the touchscreen.

[0086] Understandably, if the electronic device detects a damaged area on the touchscreen, it can calculate the extent of the damaged area and then proceed to step 302. Alternatively,

[0087] If the electronic device does not detect any damaged areas on the touchscreen, it can recognize user gestures according to the procedures in the relevant technologies. For details, please refer to the descriptions in the relevant technologies, which will not be repeated here.

[0088] The specific method for calculating the extent of the damaged area on the touchscreen can be found in the descriptions in the relevant technologies, and will not be repeated here.

[0089] Understandably, virtual hot zones can be set in addition to the baseline hot zone. The baseline hot zone can be a hot zone initially set by the system, where the coordinates of user actions detected in the baseline hot zone can be used for gesture recognition. The virtual hot zone can be used to detect the coordinates of user actions, but these coordinates cannot be used for gesture recognition.

[0090] In some alternative embodiments, the range of the virtual hot zone can be the range adjacent to the reference hot zone.

[0091] For example, assuming the range of the baseline hot zone is (0-100), the range of the virtual hot zone can be (100-150).

[0092] In some optional embodiments, it can also be determined whether the damaged area is greater than or equal to the reference hot zone range. When the damaged area is greater than or equal to the reference hot zone range, step 302 can be executed.

[0093] In some optional embodiments, it can also be determined whether the damaged area is greater than or equal to the reference hot zone range and whether the range exceeded is less than a preset range threshold. When the damaged area is greater than the reference hot zone range and the range exceeded is less than the preset range threshold, step 302 can be executed, thereby avoiding misjudgment of normal user touch operation.

[0094] Step 302: When the user performs a swipe-down operation starting from the damaged area, in response to detecting the user's operation in the virtual hot zone, the starting coordinates of the user's operation in the virtual hot zone are compensated so that the compensated starting coordinates are located within the base hot zone. The compensated starting coordinates are then reported to the upper layer, and these compensated starting coordinates can be used for gesture recognition.

[0095] Understandably, the starting coordinates of a user's operation within the bad zone cannot be detected, but the user's swipe operation can be detected when it passes through a virtual hot zone other than the bad zone.

[0096] For example, suppose the range of the baseline hot zone is (0-100), the range of the virtual hot zone is (100-150), and the range of the damaged area is (0-120). When the user's swipe operation moves from the damaged area to the virtual hot zone, the starting coordinates of the user's operation can be detected in the range of 100-150.

[0097] In some optional embodiments, in order to prevent normal user click operations from being misidentified as wake-up gestures such as swiping down, embodiments of this application may preset a duration, and determine whether the user operation is a click or a swiping down based on the preset duration.

[0098] If the user action is determined to be a click based on a preset duration, no coordinate compensation is needed. Or,

[0099] If the user's action is determined to be an underscore based on a preset duration, the starting coordinates of the user's underscore action in the virtual hot zone can be compensated so that the compensated starting coordinates are located within the baseline hot zone.

[0100] It is understandable that the starting coordinates detected by the user in the virtual hot zone are the starting coordinates generated after the user's operation is detected on the touch screen. The compensated starting coordinates can be regarded as a kind of virtual coordinates. The compensated starting coordinates and the ending coordinates can be reported to the upper layer, so that the upper layer can identify the user's gesture based on the reported starting coordinates and ending coordinates. The ending coordinates can be the coordinates of the ending position of the user's gesture on the touch screen.

[0101] The method of determining whether a user's gesture is a click or a swipe based on a preset duration can include the following two types:

[0102] Method 1

[0103] If, after a preset time period, no user hand-raising operation is detected within the preset time period, and the swipe distance in the user operation is greater than or equal to the preset swipe threshold, the user operation can be considered a swipe operation, i.e., a non-click operation; or, if a user hand-raising operation is detected within the preset time period or the swipe distance in the user operation is less than the preset swipe threshold, the user operation can be considered a click operation, i.e., a non-swipe operation.

[0104] Method 2,

[0105] Within a preset time period, in response to detecting a user's hand lift, the system can detect the swipe distance during the user's action. If the swipe distance is greater than or equal to a preset swipe threshold, the user's action is considered a swipe, i.e., not a click; conversely, if the swipe distance is less than the preset threshold, the user's action is considered a click, i.e., not a swipe. Compared to method 1, method 2 eliminates the need to wait for the preset time period to expire. It determines whether the user's action is a click or a swipe immediately after detecting the hand lift, thus saving time and improving efficiency.

[0106] In some optional embodiments, in addition to compensating for the starting coordinates of the user operation in the virtual hot zone, one or more connection points can be compensated within the bad zone, using the compensated starting coordinates as the starting point. This allows the one or more connection points to form a continuous downward trajectory with the starting point, and the one or more connection points have the same vertical coordinate as the starting point. This makes it easier for the upper layer to recognize the user's gestures based on the coordinates of the one or more compensated connection points and the compensated starting point.

[0107] The multiple connection points can be equally spaced or unequally spaced; this application does not impose any special limitations on this.

[0108] It is understood that the interval between the above multiple connection points refers to the ordinate, and the x-coordinates of the above multiple connection points can be the same, and the x-coordinates can be the same as the x-coordinates of the compensated starting point.

[0109] It should be noted that these one or more connection points are not points generated on the touchscreen by the user's operation; rather, they can be considered as virtual coordinate points generated by the system.

[0110] In related technologies, when the screen edge of an electronic device is damaged and the user's gestures cannot be recognized, the user needs to perform relatively complicated operations to bypass the damaged area of ​​the screen in order to recognize the user's gestures. The technical solution of this application can effectively recognize the user's gestures even when the screen edge of the electronic device is damaged without changing the user's usage habits, and is imperceptible to the user.

[0111] Figure 4 This is a flowchart illustrating another embodiment of the gesture recognition method provided in this application. Step 301 may include the following steps:

[0112] Step 401: Obtain screen data after the electronic device's screen is turned on.

[0113] Specifically, the screen data after the electronic device turns on can be the first frame data after the screen turns on, or the screen data after the electronic device turns on can be any frame data after the screen turns on. This application embodiment does not make any special limitation on this.

[0114] Step 402: Determine if the screen data is normal.

[0115] Specifically, the method for determining whether the screen data is normal may include: comparing the capacitance value of the screen data with the reference capacitance value, wherein the reference capacitance value can be considered as the preset capacitance value of the screen data, and the capacitance value of the screen data obtained in step 401 can be considered as the capacitance value obtained in real time.

[0116] If the screen data capacitance value is the same as or close to the reference capacitance value, the screen data can be considered normal, thus confirming that the touchscreen is not damaged, and step 401 can be executed. Alternatively,

[0117] If the capacitance value of the screen data is different from the reference capacitance value and the capacitance value of the screen data is an extreme value, the screen data can be considered abnormal, and it can be determined that the touch screen has been damaged. Step 403 can then be executed.

[0118] Step 403: Determine whether the preset conditions are met.

[0119] If one or more preset conditions are met, step 302 can be executed. Or,

[0120] If none of the conditions in one or more preset conditions are met, step 401 can be executed.

[0121] One or more preset conditions may include the following conditions:

[0122] Condition 1: Determine whether the current navigation method is gesture navigation.

[0123] If it's gesture navigation, then the conditions can be considered met; or,

[0124] If it is not gesture navigation, it can be considered that the conditions are not met.

[0125] In some optional embodiments, when it is not gesture navigation, such as three-button navigation, the user's top swipe gesture can trigger the technical solution of this application.

[0126] Condition 2: Determine whether the extent of the damaged area is greater than the baseline hot zone.

[0127] If the extent of the damaged area is greater than or equal to the baseline thermal zone, the condition can be considered met. Alternatively,

[0128] If the damaged area is smaller than the baseline hot zone and the damaged area does not affect the user's gesture function, the condition can be considered not met.

[0129] Condition 3: When the range of the damaged area is greater than the range of the reference hot zone, determine whether the range exceeds the preset range threshold.

[0130] The preset range threshold can be determined based on the actual interface layout of the product, and this application does not impose any special restrictions on it.

[0131] Understandably, if the deviation is too large, it will affect the user's touch experience on the desktop. Therefore, it can be considered that the condition is not met; that is, when the deviation exceeds a preset threshold, the condition can be considered not met. Or,

[0132] When the value outside the range is less than or equal to the preset range threshold, the condition can be considered met.

[0133] Figure 5 This is a flowchart illustrating another embodiment of the gesture recognition method provided in this application. Step 301 may include the following steps:

[0134] Step 501: Obtain screen data after the electronic device's screen is turned on.

[0135] For details on how step 501 is implemented, please refer to the relevant description in step 401, which will not be repeated here.

[0136] Step 502: Determine if the screen data is normal.

[0137] Specifically, the method for determining whether the screen data is normal can be found in the relevant description in step 402, and will not be repeated here.

[0138] If the screen data is determined to be normal, the cumulative number of errors can be reset to zero, and step 501 can be executed. Alternatively,

[0139] If the screen data is determined to be abnormal, the cumulative number of abnormalities can be incremented by 1, and step 503 can be executed.

[0140] The initial value for the cumulative number of abnormal occurrences can be set to 0.

[0141] Step 503: Determine whether the cumulative number of abnormalities is greater than or equal to the preset number threshold.

[0142] Specifically, you can check the screen data multiple times to see if it is normal.

[0143] If multiple screen data anomalies are detected, meaning the cumulative number of anomalies is greater than or equal to a preset threshold, step 504 can be executed. Alternatively,

[0144] If the cumulative number of abnormalities is less than the preset threshold, proceed to step 501.

[0145] Step 504: Determine whether the preset conditions are met.

[0146] If one or more preset conditions are met, step 302 can be executed. Or,

[0147] If none of the conditions in one or more preset conditions are met, step 501 can be executed.

[0148] The description of one or more preset conditions can be found in the relevant description in step 403, and will not be repeated here.

[0149] Figure 6This is a flowchart illustrating another embodiment of the gesture recognition method provided in this application. Step 302 may include the following steps:

[0150] Step 601: In response to the detected user operation, determine whether there are bad sectors.

[0151] If no bad sectors are found, proceed to step 605. Alternatively,

[0152] If bad sectors exist, proceed to step 602.

[0153] Step 602: Determine whether the starting coordinates corresponding to the user operation are within the virtual hot zone.

[0154] If the starting coordinates of the user's operation are determined to be outside the virtual hotspot, proceed to step 605. Alternatively,

[0155] If it is determined that the starting coordinates of the user's operation are within the virtual hot zone, proceed to step 603.

[0156] Step 603: Determine whether the user's operation is an down swipe operation.

[0157] If the user's action is determined not to be an underscore, proceed to step 605. Alternatively,

[0158] If the user's action is determined to be an underscore, proceed to step 604.

[0159] Step 604: Compensate the starting coordinates of the user operation in the virtual hot zone so that the compensated starting coordinates are located within the reference hot zone, and report the compensated starting coordinates to the upper layer.

[0160] Step 605: Report the coordinates corresponding to the user operation to the upper layer.

[0161] The coordinates corresponding to the user operation can include the compensated start and end coordinates.

[0162] Figure 7 The flowchart of another embodiment of the gesture recognition method provided in this application is shown. It can be understood that the entity performing step 604 can be the Touch Screen Algorithm (TSA) unit in an electronic device. After step 604, the following steps may also be included:

[0163] In step 701, the TSA sends the compensated starting coordinates to the daemon. Correspondingly, the daemon receives the compensated starting coordinates sent by the TSA.

[0164] Specifically, after obtaining the compensated starting coordinates, the TSA can send the compensated starting coordinates to the daemon process.

[0165] For example, the daemon could be aptouch_daemon.

[0166] It is understood that the daemon process may also have other names, and this application embodiment does not impose any special limitations on this. The daemon process can serve as an intermediary between the touch screen driver and the touch screen algorithm unit.

[0167] In step 702, in response to the received compensated starting coordinates, the daemon sends the compensated starting coordinates to the touchscreen driver. Correspondingly, the touchscreen driver receives the compensated starting coordinates.

[0168] Step 703: In response to the received compensated starting coordinates, the touchscreen driver writes the coordinates to the device node.

[0169] Figure 8 A flowchart illustrating another embodiment of the gesture recognition method provided in this application may include the following steps before step 301:

[0170] Step 801: In response to the user's activation, the electronic device screen lights up.

[0171] Step 802: In the screen-on state, the integrated circuit (IC) detects a path interruption in the touchscreen and reports the interrupt event to the touchscreen driver. The corresponding touchscreen driver receives the interrupt event.

[0172] Step 803: In response to the received interrupt event, the touch screen driver reads the screen data from the touch IC.

[0173] Understandably, the screen data could be capacitance data.

[0174] In step 804, the touchscreen driver sends screen data to the daemon process. Correspondingly, the daemon process receives the screen data.

[0175] In step 805, in response to the received screen data, the daemon sends the screen data to the TSA. The TSA then receives the screen data.

[0176] It is understandable that after receiving the screen data, the TSA can calculate the coordinates corresponding to the screen data and calculate the bad area range based on the coordinates, that is, the damaged area of ​​the touch screen in step 301.

[0177] Next, through Figure 9 The gesture recognition method of this application is illustrated by way of example.

[0178] refer to Figure 9The touch screen 900 of the electronic device has a damaged area 901. The vertical coordinate range of this area 901 is assumed to be 0-120. The touch screen 900 may also include a reference hot area 902 and a virtual hot area 903. The vertical coordinate range of the reference hot area 902 is assumed to be 0-100, and the vertical coordinate range of the virtual hot area 903 is assumed to be 100-150.

[0179] When a user swipes down from point A to point B, since point A is located within region 901, which is a bad zone, the starting coordinates of the user's swipe operation within region 901 cannot be detected. For example, assuming the vertical coordinate of point A is 80, if the touchscreen 900 has no bad zones, the user's swipe operation within the vertical coordinate range of 80-100 can be detected as a starting coordinate. However, in this embodiment, the vertical coordinate range of 80-100 is a bad zone, and the user's swipe operation within this range cannot be detected as a starting coordinate. When the user continues swiping down from vertical coordinate 120, since the vertical coordinate range from 120 to point B is not a bad zone, but rather a virtual hot zone, the starting coordinates of the user's swipe operation between vertical coordinates 120 and B can be detected. For example, this starting point could be point C.

[0180] Understandably, although point C can be detected based on the virtual hot zone as its starting coordinates, point C is not within the reference hot zone. Therefore, if the coordinates of point C and point B are reported to the upper layer, the upper layer cannot recognize the corresponding swipe gesture based on the swipe trajectory from point C to point B. In this embodiment, the ordinate of point C can be compensated. For example, the ordinate of point C can be modified so that the modified ordinate of point C is within the reference hot zone.

[0181] For example, assuming the ordinate of point C is 125, we can modify the ordinate of point C to obtain point D, whose ordinate can be any ordinate between 0 and 100. The x-coordinates of points A, B, C, and D are the same.

[0182] In this scenario, the coordinates of points D and B can be reported to the upper layer. Since point D is within the reference hot zone, the upper layer can identify the corresponding swipe gesture based on the swipe trajectory from point D to B, thereby triggering the corresponding task. For example, assuming that the swipe gesture can wake up the notification center, the upper layer can wake up the notification center after receiving the coordinates of points D and B.

[0183] Figure 10 This is a schematic diagram of the structure of one embodiment of the gesture recognition device of this application, as shown below. Figure 10As shown, the gesture recognition device 1000 described above is applied to an electronic device, which includes a touchscreen. The gesture recognition device 1000 may include: a determining module 1010, a compensation module 1020, and a recognition module 1030; wherein,

[0184] The determination module 1010 is used to determine the damaged area and virtual hot zone of the touch screen;

[0185] The compensation module 1020 is used to compensate the starting coordinates of the operation in the virtual hot zone when the user performs a swipe operation starting from the damaged area, in response to detecting the user's operation in the virtual hot zone, so that the compensated starting coordinates are located within the reference hot zone.

[0186] The recognition module 1030 is used to report the compensated starting point coordinates to the upper layer, and the compensated starting point coordinates are used for gesture recognition.

[0187] In one possible implementation, the determining module 1010 is specifically used to acquire screen data at least once;

[0188] In response to the at least one screen data anomaly, the damaged area of ​​the touchscreen is determined.

[0189] In one possible implementation, the compensation module 1020 is specifically configured to compensate for the starting coordinates of the operation in the virtual hot zone in response to detecting a user's operation in the virtual hot zone, and the damaged area being greater than or equal to the reference hot zone range; or...

[0190] In response to detecting a user's operation in the virtual hot zone, and the damaged area extending beyond the reference hot zone by less than a preset range threshold, compensation is performed on the starting coordinates of the operation in the virtual hot zone.

[0191] In one possible implementation, the compensation module 1020 is specifically used to compensate the starting coordinates of the operation corresponding to the operation in the virtual hot zone in response to detecting the user's operation in the virtual hot zone and determining that the operation is a swipe operation.

[0192] In one possible implementation, the compensation module 1020 is further configured to determine that the operation is a swipe operation if, after a preset timeout, no user lift-up operation is detected within the preset timeout period, and the user's swipe distance is greater than or equal to a preset swipe threshold; or...

[0193] Within the preset time period, in response to detecting a user's hand-raising operation and the user's swipe distance being greater than or equal to the preset swipe threshold, the operation is determined to be a swipe operation.

[0194] In one possible implementation, the identification module 1030 is further configured to compensate one or more connection points using the compensated starting point coordinates as the starting point, such that the one or more connection points form a continuous downward trajectory with the starting point, and the one or more connection points have the same vertical coordinate as the starting point.

[0195] The compensated starting point coordinates and the coordinates of the one or more connection points are reported to the upper layer.

[0196] Figure 10 The gesture recognition device 1000 provided in the illustrated embodiment can be used to execute the technical solution of the method embodiment shown in this application. Its implementation principle and technical effect can be further referred to the relevant description in the method embodiment.

[0197] The above should be understood Figure 10 The division of the various modules in the gesture recognition device 1000 shown is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, these modules can be implemented entirely in software via processing element calls; they can be fully implemented in hardware; or some modules can be implemented in software via processing element calls, while others are implemented in hardware. For example, the detection module can be a separate processing element or integrated into a chip in the electronic device. The implementation of other modules is similar. Moreover, these modules can be fully or partially integrated together, or they can be implemented independently. During implementation, each step of the above method or each of the above modules can be completed through integrated logic circuits in the hardware of the processor element or through software instructions.

[0198] For example, these modules can be one or more integrated circuits configured to implement the above methods, such as one or more Application Specific Integrated Circuits (ASICs), one or more Digital Signal Processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs). Alternatively, these modules can be integrated together as a System-On-a-Chip (SOC).

[0199] In the above embodiments, the processor may include, for example, a CPU, DSP, microcontroller, or digital signal processor, and may also include a GPU, embedded neural network processing unit (NPU), and image signal processor (ISP). The processor may also include necessary hardware accelerators or logic processing hardware circuits, such as an ASIC, or one or more integrated circuits for controlling the execution of the program in this application. Furthermore, the processor may have the function of operating one or more software programs, which may be stored in a storage medium.

[0200] This application also provides a readable storage medium storing a program that, when run on an electronic device, causes the electronic device to execute the method provided in the embodiments shown in this application.

[0201] This application also provides a program product including a program that, when run on an electronic device, causes the electronic device to perform the method provided in the embodiments shown in this application.

[0202] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, A and B simultaneously, or B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.

[0203] Those skilled in the art will recognize that the units and algorithm steps described in the embodiments disclosed herein can be implemented using electronic hardware, computer software, or a combination of electronic hardware and software. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0204] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0205] In the several embodiments provided in this application, any function, if implemented as a software functional unit and sold or used as an independent product, can be stored in a readable storage medium. Based on this understanding, the technical solution of this application, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0206] The above description is merely a specific embodiment of this application. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application. The protection scope of this application should be determined by the protection scope of the claims.

Claims

1. A gesture recognition method, characterized in that, Applied to an electronic device, the electronic device including a touchscreen, the method includes: Identify the damaged area and virtual hot zone of the touchscreen; When a user performs a swipe-down operation starting from the damaged area, in response to detecting the user's operation in the virtual hot zone, the starting coordinates of the operation in the virtual hot zone are compensated so that the compensated starting coordinates are located within the reference hot zone. The compensated starting coordinates are reported to the upper layer, and the compensated starting coordinates are used for gesture recognition.

2. The method according to claim 1, characterized in that, The determination of the damaged area of ​​the touchscreen includes: Get screen data at least once; In response to the at least one screen data anomaly, the damaged area of ​​the touchscreen is determined.

3. The method according to claim 1, characterized in that, The step of compensating for the starting coordinates of the operation in the virtual hotspot in response to detecting a user's operation in the virtual hotspot includes: In response to detecting a user's operation within the virtual hotspot, and the extent of the damaged area being greater than or equal to the baseline hotspot extent, compensation is performed on the starting coordinates of the operation within the virtual hotspot; or... In response to detecting a user's operation in the virtual hot zone, and the damaged area extending beyond the reference hot zone by less than a preset range threshold, compensation is performed on the starting coordinates of the operation in the virtual hot zone.

4. The method according to any one of claims 1-3, characterized in that, The step of compensating for the starting coordinates of the operation in the virtual hotspot in response to detecting a user's operation in the virtual hotspot includes: In response to detecting a user's operation in the virtual hotspot, and determining that the operation is an underscore operation, the starting coordinates of the operation in the virtual hotspot are compensated.

5. The method according to claim 4, characterized in that, The determination that the operation is an underscore operation includes: If, after a preset timeout, no user lift-off operation is detected within the preset timeout period, and the user's swipe distance is greater than or equal to a preset swipe threshold, the operation is determined to be a swipe operation; or... Within the preset time period, in response to detecting a user's hand-raising operation and the user's swipe distance being greater than or equal to the preset swipe threshold, the operation is determined to be a swipe operation.

6. The method according to any one of claims 1-5, characterized in that, The step of reporting the compensated starting coordinates to the upper layer includes: Using the compensated starting point coordinates as the starting point, compensate one or more connection points so that the one or more connection points form a continuous downward trajectory with the starting point, and the one or more connection points have the same ordinate as the starting point; The compensated starting point coordinates and the coordinates of the one or more connection points are reported to the upper layer.

7. An electronic device, characterized in that, include: A processor and a memory, the memory being used to store a program; the processor being used to run the program to implement the gesture recognition method as described in any one of claims 1-6.

8. A readable storage medium, characterized in that, The readable storage medium stores a program that, when run on an electronic device, implements the gesture recognition method as described in any one of claims 1-6.

Images