Gesture recognition method, device and electronic device

Abstract

The present application discloses a gesture recognition method, device and electronic device, belonging to the field of communication technology. The method comprises: when the gesture recognition function is turned on and there is a radio frequency circuit that meets the preset conditions, adjusting the radio frequency circuit to a target working mode for gesture recognition, wherein the radio frequency circuit in the target working mode includes at least one transmitting path and at least one receiving path; obtaining first information related to the reflected signal; and identifying the gesture action of the user's hand according to the first information. The present application realizes gesture recognition by reusing the existing radio frequency circuit on the electronic device without adding additional modules, thereby reducing manufacturing costs and power consumption of the whole machine.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a gesture recognition method, device and electronic device. Background Art

[0002] With the continuous development of mobile communication technology, smart electronic devices (such as mobile phones) are becoming more and more popular. Electronic devices (such as mobile phones) have evolved from physical buttons to touch screens, and then to voice interaction, realizing a change in the way of interaction, making the applications on electronic devices more rich and interesting, and expanding the functionality and entertainment of electronic devices. Today, the touch interaction method has increasingly shown its shortcomings, and voice interaction is obviously not suitable for occasions that require quietness, and it is difficult to meet the needs of users in certain scenarios. Therefore, an interactive method that uses gesture recognition to achieve air-to-air operation has emerged. Users do not need to touch the electronic device. After making specific movements in the air, the electronic device can complete the specified operation by recognizing the gesture.

[0003] At present, there are three ways to implement gesture recognition interaction in electronic devices. One is to use a specific radar chip to implement gesture recognition interaction; the other is to use a structured light camera to implement three-dimensional stereoscopic imaging and optical plus image processing to implement gesture recognition interaction; the third is to use a stylus that comes with the electronic device, integrate an electronic compass and a multi-axis acceleration sensor in the stylus to implement gesture recognition, and then communicate with the electronic device to achieve interaction. The above gesture recognition interaction implementation methods are implemented by adding additional modules, which has the problem of high cost and increased power consumption of the entire device. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a gesture recognition method, device and electronic device, which can solve the problem that the existing gesture recognition needs to add additional modules to implement, which is costly and increases the power consumption of the whole device.

[0005] In order to solve the above technical problems, this application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a gesture recognition method, the method comprising:

[0007] When the gesture recognition function is turned on and there is a radio frequency circuit that meets the preset conditions, adjusting the radio frequency circuit to a target operating mode for gesture recognition, wherein the radio frequency circuit in the target operating mode includes at least one transmitting path and at least one receiving path;

[0008] Acquire first information related to the reflected signal, wherein the first information includes difference frequency information between the reflected signal and the detection signal, or the first information includes difference frequency information between the reflected signal and the detection signal and phase difference information when the reflected signal reaches antennas of different receiving paths, the detection signal is a signal sent through the transmitting path, and the reflected signal is a signal received by the receiving path after the detection signal is reflected by the user's hand;

[0009] According to the first information, the gesture action of the user's hand is identified.

[0010] In a second aspect, an embodiment of the present application further provides a gesture recognition device, including:

[0011] A first processing module, configured to adjust the radio frequency circuit to a target working mode for gesture recognition when the gesture recognition function is turned on and there is a radio frequency circuit that meets a preset condition, wherein the radio frequency circuit in the target working mode includes at least one transmitting path and at least one receiving path;

[0012] an acquisition module, configured to acquire first information related to a reflection signal, wherein the first information includes frequency difference information between the reflection signal and the detection signal, or the first information includes frequency difference information between the reflection signal and the detection signal and phase difference information when the reflection signal reaches antennas of different receiving paths, the detection signal is a signal sent through the transmitting path, and the reflection signal is a signal received by the receiving path after the detection signal is reflected by a user's hand;

[0013] A gesture recognition module is used to recognize the gesture action of the user's hand according to the first information.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the gesture recognition method described in the first aspect.

[0015] In a fourth aspect, an embodiment of the present application further provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the gesture recognition method described in the first aspect are implemented.

[0016] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the gesture recognition method as described in the first aspect.

[0017] In an embodiment of the present application, when a gesture recognition function is turned on and there is a radio frequency circuit that meets preset conditions, the radio frequency circuit is adjusted to a target working mode for gesture recognition, wherein the radio frequency circuit in the target working mode includes at least one transmitting path and at least one receiving path; first information related to the reflected signal is obtained, wherein the first information includes difference frequency information between the reflected signal and the detection signal, or the first information includes difference frequency information between the reflected signal and the detection signal and phase difference information of the reflected signal reaching antennas of different receiving paths, the detection signal is a signal sent through the transmitting path, and the reflected signal is a signal received by the receiving path after the detection signal is reflected by the user's hand; according to the first information, the gesture action of the user's hand is identified, so that gesture recognition is achieved by reusing the existing radio frequency circuit on the electronic device without adding additional modules, thereby reducing manufacturing costs and overall power consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a schematic diagram of the structure of the radio frequency architecture of the electronic device according to the embodiment of the present application;

[0019] Figure 2 A flowchart of a gesture recognition method provided in an embodiment of the present application;

[0020] Figure 3 A schematic diagram of the structure of a gesture recognition device provided in an embodiment of the present application;

[0021] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0022] Figure 5 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0024] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0025] The gesture recognition method provided in the embodiment of the present application will be described in detail below through specific embodiments and application scenarios in conjunction with the accompanying drawings.

[0026] In order to enable those skilled in the art to better understand the method of the embodiment of the present invention, the following description is first made.

[0027] The method of the embodiment of the present application is applicable to Figure 1 The RF architecture shown is applied to electronic devices that support millimeter wave bands. For example, the FR2 band of the 5G network has a frequency range of 24 GHz to 52 GHz, a wavelength of millimeter level, and a wide frequency band bandwidth that can be used for high-precision gesture recognition.

[0028] The RF architecture includes: a processor, a baseband chip and a RF circuit. The baseband chip is connected to the processor and the RF circuit respectively; the RF circuit includes: a RF front-end circuit and an antenna module, and the RF front-end circuit is connected to the antenna module.

[0029] Here, the radio frequency circuit includes a transmitting path and a receiving path in terms of circuit structure.

[0030] The transmission path includes: a transceiver, a power amplifier PA, a filter Tx filter and a first antenna. The PA is connected to the transceiver and the filter Tx filter respectively, and the filter Tx filter is connected to the first antenna.

[0031] The receiving path includes: a transceiver, a low noise amplifier LNA, a filter Rx filter and a second antenna. Among them, the LNA is connected to the transceiver and the filter Rx filter respectively, and the filter Rx filter is connected to the second antenna. Here, the first antenna and the second antenna are antennas in the antenna module.

[0032] Specifically, the processor is interconnected with each module in the architecture through an interface circuit, responsible for data processing and calculation, and is the core of the electronic device. Among them, an AI chip with AI function can be integrated into the processor.

[0033] The baseband chip has wireless communication functions, including wireless communication protocols, data encoding and decoding, etc.

[0034] The RF front-end circuit includes but is not limited to: a transceiver connected to the baseband chip, a mixer, a power amplifier PA, a filter, a coupler and a low noise amplifier LNA.

[0035] It should be noted that the transceiver is a converter between digital and analog signals, used to receive and transmit signals. Devices such as power amplifiers PA, filters, couplers and low noise amplifiers LNA realize the mutual conversion of intermediate frequency signals to high-frequency millimeter wave signals.

[0036] The antenna module is used to radiate millimeter waves into the air and receive millimeter wave signals in the air. It should be noted that the antenna module may include a millimeter wave antenna array, and multiple antennas on the millimeter wave antenna array work simultaneously to realize functions such as MIMO and space division multiplexing.

[0037] Here, the RF front-end circuit and the antenna module can be packaged in the same module (RF module), eliminating the need for routing on the PCB and reducing power consumption. Only the intermediate frequency signal needs to be transmitted on the PCB, and the intermediate frequency signal completes mixing, amplification, filtering and other functions in the RF module.

[0038] like Figure 2 , which is a flow chart of a gesture recognition method provided in an embodiment of the present application, the method is applied to an electronic device, and the implementation process of the method is specifically described below with reference to the figure.

[0039] Step 201, when the gesture recognition function is turned on and there is a radio frequency circuit that meets a preset condition, adjust the radio frequency circuit to a target working mode for gesture recognition, wherein the radio frequency circuit in the target working mode includes at least one transmitting path and at least one receiving path;

[0040] In this step, there are two ways to trigger the gesture recognition function to be turned on. One is to trigger the gesture recognition function to be turned on through user operation; the other is to trigger the gesture recognition function to be turned on when it is recognized that the electronic device is in the target application scenario.

[0041] Here, the electronic device can autonomously identify the application scenario and determine whether to start the gesture recognition function. For example, the electronic device is in a stationary state and the application scenario in which audio or video is playing is the target application scenario. In this scenario, the user is likely to complete operations such as volume adjustment and playback progress adjustment through gesture recognition, and at this time, the gesture recognition function is triggered to start.

[0042] Optionally, the preset condition includes one of the following:

[0043] There is currently no communication event based on the preset communication network;

[0044] Here, the preset communication network may be a 5G communication network.

[0045] It should be noted that when there is currently no communication event based on a preset communication network (such as a 5G communication network), it means that there is currently a radio frequency circuit in an idle state.

[0046] There is currently a communication event based on a preset communication network, and the throughput of the preset communication network is less than a preset threshold.

[0047] It should be noted that when there is currently a communication event based on a preset communication network and the throughput of the preset communication network is less than a preset threshold, the transmitting path and the receiving path of the RF circuit can be reasonably allocated, and a RF circuit including at least one transmitting path and a receiving path can be selected for gesture recognition.

[0048] Here, if there is currently a communication event based on a preset communication network, and the throughput of the preset communication network is greater than a preset threshold, it means that all current RF circuits need to be used for communication events of the preset network, that is, no idle RF circuits can be used for gesture recognition. At this time, if the gesture recognition function is triggered by user operation, the user is prompted that the gesture recognition function cannot be started in the current scene; if the electronic device autonomously recognizes the application scene, the gesture recognition function is not started in this scene.

[0049] Here, the transmitting path and the receiving path in the radio frequency circuit in the target working mode are both in working state, that is, the transmitting path and the receiving path work at the same time.

[0050] Step 202, obtaining first information related to the reflected signal, wherein the first information includes the difference frequency information between the reflected signal and the detection signal, or the first information includes the difference frequency information between the reflected signal and the detection signal and the phase difference information of the reflected signal reaching antennas of different receiving paths, the detection signal is a signal sent through the transmitting path, and the reflected signal is a signal received by the receiving path after the detection signal is reflected by the user's hand;

[0051] Optionally, the detection signal is a frequency modulated continuous wave signal. The waveform of the frequency modulated continuous wave can be a sawtooth wave or a triangle waveform or a variant of the above two waveforms. Here, the frequency modulated continuous wave signal can measure both distance and speed. When the transmitting path transmits a continuous wave signal with a changing frequency (i.e., a frequency modulated continuous signal) during a frequency sweep period, a certain frequency difference between the reflected signal reflected by the user's hand and the transmitted signal, i.e., the difference frequency information, can be used to obtain the distance information between the user's hand and the electronic device, thereby realizing gesture recognition.

[0052] Step 203: Identify the hand gestures of the user according to the first information.

[0053] In the gesture recognition method of the embodiment of the present application, when a gesture recognition function is turned on and there is a radio frequency circuit that meets a preset condition, the radio frequency circuit is adjusted to a target working mode for gesture recognition, wherein the radio frequency circuit in the target working mode includes at least one transmitting path and at least one receiving path; first information related to the reflection signal is obtained, wherein the first information includes difference frequency information between the reflection signal and the detection signal, or the first information includes difference frequency information between the reflection signal and the detection signal and phase difference information of the reflection signal reaching antennas of different receiving paths, the detection signal is a signal sent through the transmission path, and the reflection signal is a signal received by the receiving path after the detection signal is reflected by the user's hand; according to the first information, the gesture action of the user's hand is identified, so that gesture recognition is achieved by reusing the existing radio frequency circuit on the electronic device without adding additional modules, thereby reducing manufacturing costs and overall power consumption.

[0054] As an optional implementation, in step 201 of the method of the embodiment of the present application, adjusting the radio frequency circuit to a target operating mode for gesture recognition may include:

[0055] Controlling the radio frequency front-end circuit that meets the preset conditions to be connected to the antenna, so that the radio frequency circuit formed after the connection includes at least one transmitting path and at least one receiving path;

[0056] This step can realize the configuration of the RF circuit. For example, since the working mode of 5G communication is time division duplexing TDD mode, the same antenna transmits and receives signals at different times. Therefore, when multiplexing the 5G RF circuit, the RF circuit configuration needs to be completed through a switch.

[0057] Specifically, the RF front-end circuit under the preset condition is controlled to be connected to the target antenna through the first switch.

[0058] by Figure 1For example, the antenna module includes a first antenna 1, a second antenna 2, a third antenna 3, a fourth antenna and a first switch 5, wherein the first switch 5 is respectively connected to the first antenna 1, the second antenna 2, the third antenna 3, the fourth antenna 4 and the RF front-end circuit.

[0059] For example, it can be configured as a 1T3R path. Specifically, port p1 of the first antenna 5 is controlled to be connected to port p5 to form a transmitting path; port p2, port p3, and port p4 of the first antenna 5 are controlled to be connected to port p8, port p9, and port p10 respectively, one by one, to form three receiving paths.

[0060] Controlling the conduction between the signal output end of the transmitting path and the mixer of the receiving path;

[0061] Here, generally, when a communication event of a preset communication network is executed through a radio frequency circuit, the radio frequency circuit is in a working mode for transmitting and receiving signals, and both the transmitting path and the receiving path in the radio frequency circuit are mixed with the local oscillator source, that is, the mixer of the transmitting path is mixed with the local oscillator source, and the mixer of the receiving path is mixed with the local oscillator source. Therefore, specifically, the signal output end of the transmitting path is connected to the mixer of the receiving path through the second switch.

[0062] Optionally, Figure 1 For example, the moving end of the second switch 6 is connected to the mixer of the receiving path, the first fixed end of the second switch 6 is connected to the local oscillator LO, and the second fixed end of the second switch 6 is connected to the signal output end of the transmitting path. That is, part of the energy of the transmitting signal output from the signal output end of the transmitting path coupled by the coupler is fed back to the mixer circuit of the receiving path.

[0063] When the RF circuit is in the working mode for transmitting and receiving signals, the moving end of the second switch 6 is electrically connected to the first fixed end of the second switch 6, that is, the mixer of the transmitting path mixes with the local oscillator source, and the mixer of the receiving path mixes with the local oscillator source.

[0064] When the RF circuit that meets the preset conditions is in the target working mode, the moving end of the second switch 6 is controlled to be electrically connected to the second fixed end of the second switch 6, so that the signal output end of the transmitting path is connected to the mixer of the receiving path.

[0065] It should be noted that in this step, by controlling the signal output end of the transmitting path of the RF circuit in the target working mode and the mixer of the receiving path to be turned on, the subsequent transmitting signal (i.e., the detection signal) passing through the transmitting path can be mixed with the receiving signal (i.e., the reflected signal) received by the receiving path to obtain the difference frequency information between the reflected signal and the detection signal, which is then used in gesture recognition.

[0066] Here, the number of transmission paths and the number of reception paths of the radio frequency circuit in the target working mode can be set as required.

[0067] exist Figure 1 In the example shown, the RF circuit in the target working mode includes one transmitting path and three receiving paths, namely 1T3R, that is, the number of receiving paths is greater than the number of transmitting paths. Such a setting can improve the accuracy of the electronic device in judging the position of the user's hand (especially fingers) because the positions of the antennas on the three receiving paths are different, and their relative positions to the same hand or finger of the user are also different, thereby achieving positioning accuracy.

[0068] In practice, it can also be set to 2T2R, that is, each transmission path corresponds to 2 receiving paths, and when combined, there are 4 receiving paths. Similarly, the accuracy of the electronic device's judgment of the user's hand (especially fingers) position can be improved for the same reason. The above is only an example, and more antennas can be configured according to actual needs, and no specific limitation is made here.

[0069] The transmitting path is controlled to send a detection signal with a first reflected power, wherein the first reflected power is determined by a distance detection range preset for gesture recognition.

[0070] Here, in the embodiment of the present application, gesture recognition is a short-range application and there is no need to transmit a high-power signal. Transmitting a lower-power signal can reduce power consumption and energy consumption.

[0071] As an optional implementation, the difference frequency information is difference frequency information within a plurality of consecutive periods; the method step 203 of the embodiment of the present application includes:

[0072] Performing a one-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain distance information from the user's hand;

[0073] Here, the farther the distance between the antenna in the RF circuit and the user's hand is, the longer the time delay of the received reflected signal relative to the detection signal is, so at the same time, the difference frequency between the reflected signal and the detection signal is larger, so the difference frequency information corresponds to the distance. In this step, the time domain information is converted into frequency domain information through a one-dimensional Fourier transform, and the frequency point is identified to obtain the electronic device, specifically, the distance information from the antenna in the RF circuit to the user's hand.

[0074] Performing a two-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain the velocity information of the user's hand;

[0075] In this step, the difference frequency information is the difference frequency information within multiple continuous cycles. Taking the triangle wave as an example, one cycle specifically refers to the transmission signal (detection signal) sweeping from low frequency to high frequency, and then from high frequency to low frequency. The transmission path is always working, and there are multiple continuous cycle signals.

[0076] Specifically, the difference frequency information 1 (representing distance 1) and the difference frequency information 2 (representing distance 2) of the second period are obtained through the signal of the first period. If the frequency difference in the difference frequency information 1 is greater than the frequency difference in the difference frequency information 2, it means that distance 1 is greater than distance 2, which means that the user's hand is farther away from the electronic device in the second period than in the first period. In this way, the speed information of the user's hand can be calculated through the changing distance and time, that is, the two-dimensional Fourier transform.

[0077] In a case where the first information does not include phase difference information of the reflected signal reaching antennas of different receiving paths, identifying a hand gesture of the user according to the distance information and the speed information;

[0078] Here, the first information does not include the phase difference information of the reflected signal reaching the antennas of different receiving paths, which means that the first information only includes the difference frequency information between the reflected signal and the detection signal, and the number of receiving paths of the RF circuit that meets the preset conditions is 1. Therefore, the gesture of the user's hand can be identified based on the distance information and speed information, and at this time, the basic gesture can be identified.

[0079] In order to eliminate the Doppler frequency shift effect, that is, when the object moves, the reflected signal reflected back has a frequency shift, which leads to a deviation in the calculated distance information, further, as an optional implementation method, after performing a two-dimensional Fourier transform on the frequency difference information of the reflected signal and the detection signal to obtain the speed information of the user's hand, the method of the embodiment of the present application may also include:

[0080] The distance information is calibrated based on the speed information to obtain calibrated distance information.

[0081] It should be noted that the calibrated distance information is accurate distance information after the Doppler frequency shift is eliminated.

[0082] Here, for a brief description of distance calibration, take the triangle wave as an example, in the first half cycle, the low frequency is swept to the high frequency, there is a positive offset; in the second half cycle, the high frequency is swept back to the low frequency, there is a negative offset, and the two can be offset. Here, the position in the second half cycle is different from that in the first half cycle, so the speed information is also taken into account when calibrating the distance.

[0083] In a case where the first information includes phase difference information of the reflected signal reaching antennas of different receiving paths, the gesture of the user's hand is identified according to the distance information, the speed information and the phase difference information.

[0084] Here, when the first information includes the phase difference information of the reflected signal reaching the antennas of different receiving paths, it means that the first information includes the difference frequency information between the reflected signal and the detection signal and the phase difference information of the antenna, and the number of receiving paths of the RF circuit that meets the preset conditions is more than 1. Therefore, the gesture of the user's hand can be identified based on the distance information, speed information and phase difference information, and at this time, complex gestures can be identified.

[0085] It should be noted that the distance information, speed information and angle information can be used as sample data for machine learning, wherein the above information is used as input of a neural network, and a neural network for recognizing gesture actions is obtained through training.

[0086] As an optional implementation, after step 203, the method of the embodiment of the present application may further include:

[0087] Responding to a gesture instruction corresponding to the gesture action.

[0088] Here, the gesture actions and the gesture instructions have a corresponding relationship, that is, different gesture actions, combined with the current application scenarios of the electronic device, correspond to different gesture instructions.

[0089] After the gesture action is recognized by the aforementioned method, the corresponding gesture instruction is obtained and the gesture instruction is responded to and the corresponding event is executed.

[0090] The embodiment of the present application reuses the radio frequency circuit on the electronic device and utilizes the powerful data processing capability and AI capability of the electronic device to realize the interactive mode of gesture recognition without increasing additional cost and sacrificing the body space and appearance aesthetics, so that the user can get a more convenient and interesting operation experience and enhance the user's perceived value of the electronic device.

[0091] It should be noted that electronic devices usually use 3 to 4 antenna modules, which are distributed around the body to obtain omnidirectionality. By cascading multiple sets of antenna modules, all-round gesture recognition can be achieved, while using multiple transmission and multiple reception to improve recognition accuracy.

[0092] In the gesture recognition method of the embodiment of the present application, when a gesture recognition function is turned on and there is a radio frequency circuit that meets a preset condition, the radio frequency circuit is adjusted to a target working mode for gesture recognition, wherein the radio frequency circuit in the target working mode includes at least one transmitting path and at least one receiving path; first information related to the reflection signal is obtained, wherein the first information includes difference frequency information between the reflection signal and the detection signal, or the first information includes difference frequency information between the reflection signal and the detection signal and phase difference information of the reflection signal reaching antennas of different receiving paths, the detection signal is a signal sent through the transmission path, and the reflection signal is a signal received by the receiving path after the detection signal is reflected by the user's hand; according to the first information, the gesture action of the user's hand is identified, so that gesture recognition is achieved by reusing the existing radio frequency circuit on the electronic device without adding additional modules, thereby reducing manufacturing costs and overall power consumption.

[0093] It should be noted that the gesture recognition method provided in the embodiment of the present application can be executed by a gesture recognition device or a control module in the gesture recognition device for executing the gesture recognition method. In the embodiment of the present application, the gesture recognition device provided in the embodiment of the present application is described by taking the gesture recognition method executed by the gesture recognition device as an example.

[0094] like Figure 3 FIG. 3 is a schematic diagram of the structure of a gesture recognition device provided in an embodiment of the present application. The gesture recognition device 300 may include:

[0095] A first processing module 301 is configured to adjust the RF circuit to a target operating mode for gesture recognition when the gesture recognition function is enabled and there is a RF circuit that meets a preset condition, wherein the RF circuit in the target operating mode includes at least one transmitting path and at least one receiving path;

[0096] An acquisition module 302 is used to acquire first information related to a reflection signal, wherein the first information includes difference frequency information between the reflection signal and the detection signal, or the first information includes difference frequency information between the reflection signal and the detection signal and phase difference information of the reflection signal reaching antennas of different receiving paths, the detection signal is a signal sent through the transmitting path, and the reflection signal is a signal received by the receiving path after the detection signal is reflected by the user's hand;

[0097] The gesture recognition module 303 is used to recognize the gesture action of the user's hand according to the first information.

[0098] Optionally, the first processing module 301 includes:

[0099] A first control unit, used for controlling the radio frequency front-end circuit that meets the preset condition to be connected to the antenna, so that the radio frequency circuit formed after the connection includes at least one transmitting path and at least one receiving path;

[0100] A second control unit, used for controlling the conduction between the signal output end of the transmitting path and the mixer of the receiving path;

[0101] The third control unit is used to control the transmitting path to send the detection signal with a first reflected power, wherein the first reflected power is determined by a distance detection range preset for gesture recognition.

[0102] Optionally, the preset condition includes one of the following:

[0103] There is currently no communication event based on the preset communication network;

[0104] There is currently a communication event based on a preset communication network, and the throughput of the preset communication network is less than a preset threshold.

[0105] Optionally, the difference frequency information is difference frequency information within a plurality of continuous periods; accordingly, the gesture recognition module 303 includes:

[0106] A first calculation unit, configured to perform a one-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain distance information from the user's hand;

[0107] A second calculation unit is used to perform a two-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain the velocity information of the user's hand;

[0108] a first gesture recognition unit, configured to recognize a gesture of the user's hand according to the distance information and the speed information when the first information does not include phase difference information of the reflected signal reaching antennas of different receiving paths;

[0109] The second gesture recognition unit is configured to recognize the gesture of the user's hand according to the distance information, the speed information and the phase difference information when the first information includes phase difference information of the reflected signal reaching antennas of different receiving paths.

[0110] Optionally, the device 300 further includes:

[0111] The calibration module is used to calibrate the distance information based on the speed information to obtain calibrated distance information.

[0112] Optionally, the detection signal is a frequency modulated continuous wave signal.

[0113] Optionally, the device 300 further includes:

[0114] A response module is used to respond to the gesture instruction corresponding to the gesture action.

[0115] The gesture recognition device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0116] The gesture recognition device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0117] The gesture recognition device provided in the embodiment of the present application can achieve Figure 2 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0118] In the gesture recognition device of the embodiment of the present application, when the gesture recognition function is turned on and there is a radio frequency circuit that meets the preset conditions, the first processing module adjusts the radio frequency circuit to a target working mode for gesture recognition, wherein the radio frequency circuit in the target working mode includes at least one transmitting path and at least one receiving path; the acquisition module acquires first information related to the reflection signal, wherein the first information includes the difference frequency information between the reflection signal and the detection signal, or the first information includes the difference frequency information between the reflection signal and the detection signal and the phase difference information of the reflection signal reaching the antennas of different receiving paths, the detection signal is a signal sent through the transmission path, and the reflection signal is a signal received by the receiving path after the detection signal is reflected by the user's hand; the gesture recognition module recognizes the gesture action of the user's hand according to the first information, so that gesture recognition is realized by reusing the existing radio frequency circuit on the electronic device without adding additional modules, thereby reducing the manufacturing cost and the power consumption of the whole machine.

[0119] Alternatively, if Figure 4 As shown, the embodiment of the present application also provides an electronic device 400, including a processor 401, a memory 402, and a program or instruction stored in the memory 402 and executable on the processor 401. When the program or instruction is executed by the processor 401, each process of the above-mentioned gesture recognition method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0120] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0121] Figure 5 A schematic diagram of the hardware structure of an electronic device for implementing various embodiments of the present application.

[0122] The electronic device 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a power supply 511 and other components.

[0123] Those skilled in the art will appreciate that the electronic device 500 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 510 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 5 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0124] The processor 510 is configured to adjust the RF circuit to a target operating mode for gesture recognition when a gesture recognition function is enabled and there is an RF circuit that meets preset conditions, wherein the RF circuit in the target operating mode includes at least one transmitting path and at least one receiving path; obtain first information related to the reflected signal, wherein the first information includes difference frequency information between the reflected signal and the detection signal, or the first information includes difference frequency information between the reflected signal and the detection signal and phase difference information of the reflected signal reaching antennas of different receiving paths, the detection signal is a signal sent through the transmitting path, and the reflected signal is a signal received by the receiving path after the detection signal is reflected by the user's hand; and identify the gesture action of the user's hand according to the first information.

[0125] In the embodiment of the present application, gesture recognition is achieved by reusing the existing radio frequency circuit on the electronic device without adding additional modules, thereby reducing the manufacturing cost and the power consumption of the whole device.

[0126] Optionally, the processor 510 is further configured to:

[0127] Controlling the radio frequency front-end circuit that meets the preset conditions to be connected to the antenna, so that the radio frequency circuit formed after the connection includes at least one transmitting path and at least one receiving path;

[0128] Controlling the conduction between the signal output end of the transmitting path and the mixer of the receiving path;

[0129] The transmitting path is controlled to send a detection signal with a first reflected power, wherein the first reflected power is determined by a distance detection range preset for gesture recognition.

[0130] Optionally, the preset condition includes one of the following:

[0131] There is currently no communication event based on the preset communication network;

[0132] There is currently a communication event based on a preset communication network, and the throughput of the preset communication network is less than a preset threshold.

[0133] Optionally, the difference frequency information is difference frequency information within a plurality of consecutive periods; the processor 510 is further configured to:

[0134] Performing a one-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain distance information from the user's hand;

[0135] Performing a two-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain the velocity information of the user's hand;

[0136] In a case where the first information does not include phase difference information of the reflected signal reaching antennas of different receiving paths, identifying a hand gesture of the user according to the distance information and the speed information;

[0137] In a case where the first information includes phase difference information of the reflected signal reaching antennas of different receiving paths, the gesture of the user's hand is identified according to the distance information, the speed information and the phase difference information.

[0138] Optionally, the processor 510 is further configured to:

[0139] The distance information is calibrated based on the speed information to obtain calibrated distance information.

[0140] Optionally, the detection signal is a frequency modulated continuous wave signal.

[0141] Optionally, the processor 510 is further configured to:

[0142] Responding to a gesture instruction corresponding to the gesture action.

[0143] In the embodiment of the present application, gesture recognition is achieved by reusing the existing radio frequency circuit on the electronic device without adding additional modules, thereby reducing the manufacturing cost and the power consumption of the whole device.

[0144] It should be understood that in the embodiment of the present application, the input unit 504 may include a graphics processor (Graphics Processing Unit, GPU) 5041 and a microphone 5042, and the graphics processor 5041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 507 includes a touch panel 5051 and other input devices 5072. The touch panel 5051 is also called a touch screen. The touch panel 5051 may include two parts: a touch detection device and a touch controller. Other input devices 5072 may include but are not limited to a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 509 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 510 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, the user interface, and the application program, and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 510.

[0145] The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned gesture recognition method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0146] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0147] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned gesture recognition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0148] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0149] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0150] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0151] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A gesture recognition method, characterized in that: include: When the gesture recognition function is turned on and there is a radio frequency circuit that meets the preset conditions, adjusting the radio frequency circuit to a target operating mode for gesture recognition, wherein the radio frequency circuit in the target operating mode includes at least one transmitting path and at least one receiving path; Acquire first information related to the reflected signal, wherein the first information includes difference frequency information between the reflected signal and the detection signal, or the first information includes difference frequency information between the reflected signal and the detection signal and phase difference information when the reflected signal reaches antennas of different receiving paths, the detection signal is a signal sent through the transmitting path, and the reflected signal is a signal received by the receiving path after the detection signal is reflected by the user's hand; Recognize the hand gesture of the user according to the first information; The preset condition includes one of the following: There is currently no communication event based on the preset communication network; There is currently a communication event based on a preset communication network, and the throughput of the preset communication network is less than a preset threshold.

2. The method according to claim 1, characterized in that: Adjusting the radio frequency circuit to a target operating mode for gesture recognition includes: Controlling the radio frequency front-end circuit that meets the preset conditions to be connected to the antenna, so that the radio frequency circuit formed after the connection includes at least one transmitting path and at least one receiving path; Controlling the conduction between the signal output end of the transmitting path and the mixer of the receiving path; The transmitting path is controlled to send a detection signal with a first reflected power, wherein the first reflected power is determined by a distance detection range preset for gesture recognition.

3. The method according to claim 1, characterized in that The difference frequency information is the difference frequency information within a plurality of continuous periods; The step of identifying the hand gesture of the user according to the first information includes: Performing a one-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain distance information from the user's hand; Performing a two-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain the velocity information of the user's hand; In a case where the first information does not include phase difference information of the reflected signal reaching antennas of different receiving paths, identifying a hand gesture of the user according to the distance information and the speed information; In a case where the first information includes phase difference information of the reflected signal reaching antennas of different receiving paths, the gesture of the user's hand is identified according to the distance information, the speed information and the phase difference information.

4. The method according to claim 3, characterized in that After performing a two-dimensional Fourier transform on the frequency difference information between the reflection signal and the detection signal to obtain the velocity information of the user's hand, the method further includes: The distance information is calibrated based on the speed information to obtain calibrated distance information.

5. The method according to claim 1, characterized in that The detection signal is a frequency modulated continuous wave signal.

6. The method according to claim 1, characterized in that After identifying the hand gesture of the user according to the first information, the method further includes: Responding to a gesture instruction corresponding to the gesture action.

7. A gesture recognition device, characterized in that: include: A first processing module, configured to adjust the radio frequency circuit to a target working mode for gesture recognition when the gesture recognition function is turned on and there is a radio frequency circuit that meets a preset condition, wherein the radio frequency circuit in the target working mode includes at least one transmitting path and at least one receiving path; an acquisition module, configured to acquire first information related to a reflection signal, wherein the first information includes frequency difference information between the reflection signal and the detection signal, or the first information includes frequency difference information between the reflection signal and the detection signal and phase difference information when the reflection signal reaches antennas of different receiving paths, the detection signal is a signal sent through the transmitting path, and the reflection signal is a signal received by the receiving path after the detection signal is reflected by a user's hand; A gesture recognition module, used to recognize the gesture action of the user's hand according to the first information; The preset condition includes one of the following: There is currently no communication event based on the preset communication network; There is currently a communication event based on a preset communication network, and the throughput of the preset communication network is less than a preset threshold.

8. The device according to claim 7, characterized in that The first processing module comprises: A first control unit, used for controlling the radio frequency front-end circuit that meets the preset condition to be connected to the antenna, so that the radio frequency circuit formed after the connection includes at least one transmitting path and at least one receiving path; A second control unit, used for controlling the conduction between the signal output end of the transmitting path and the mixer of the receiving path; The third control unit is used to control the transmitting path to send the detection signal with a first reflected power, wherein the first reflected power is determined by a distance detection range preset for gesture recognition.

9. The device according to claim 7, characterized in that The difference frequency information is the difference frequency information within a plurality of continuous periods; The gesture recognition module comprises: A first calculation unit, configured to perform a one-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain distance information from the user's hand; A second calculation unit is used to perform a two-dimensional Fourier transform on the difference frequency information of the reflection signal and the detection signal to obtain the velocity information of the user's hand; a first gesture recognition unit, configured to recognize a gesture of the user's hand according to the distance information and the speed information when the first information does not include phase difference information of the reflected signal reaching antennas of different receiving paths; The second gesture recognition unit is configured to recognize the gesture of the user's hand according to the distance information, the speed information and the phase difference information when the first information includes phase difference information of the reflected signal reaching antennas of different receiving paths.

10. The device according to claim 9, characterized in that The device also includes: The calibration module is used to calibrate the distance information based on the speed information to obtain calibrated distance information.

11. The device according to claim 7, characterized in that The detection signal is a frequency modulated continuous wave signal.

12. The device according to claim 7, characterized in that The device also includes: A response module is used to respond to the gesture instruction corresponding to the gesture action.

13. An electronic device, characterized in that: The method comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the gesture recognition method according to any one of claims 1 to 6.

14. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by the processor, the steps of the gesture recognition method according to any one of claims 1 to 6 are implemented.

Images