Gesture recognition method and device
Through multi-antenna configuration and Doppler phase shift analysis of echo signals, the problem of high complexity of gesture recognition in the prior art is solved, efficient gesture recognition is achieved, and the calculation amount is reduced and the recognition accuracy is improved.
Patent Information
- Application Number
- CN202010642990.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-06
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2040-07-06
AI Technical Summary
In the prior art, gesture recognition methods require pre-acquisition of a large amount of antenna signal data for model training, with high computational complexity, and feature extraction of antenna signal data during the recognition process, resulting in large calculation amount and high complexity.
Using a multi-antenna configuration, by transmitting radar electromagnetic signals and receiving echo signals, the gesture is determined based on the change of Doppler phase shift of the echo signal over time, reducing the complexity of gesture recognition, and only needs to be based on the wave range of the echo signal. Changes to distinguish gestures.
It effectively reduces the complexity and calculation amount of gesture recognition, improves recognition accuracy, and does not require additional antennas and radio frequency circuits, achieving improved gesture recognition accuracy without increasing hardware cost and volume.
Smart Images

Figure CN113900507B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of terminal technology, and more specifically, to a gesture recognition method and device in the field of terminal technology. Background Art
[0002] As the types and numbers of electronic devices increase and their popularity becomes more widespread, the way users interact with electronic devices has also evolved from simple interactions using peripherals such as remote controls, mice, and keyboards to diversified interactions using voice interaction, somatosensory interaction, eye movement interaction, and gesture interaction. Among them, gesture interaction is in great demand in many application scenarios because it is more natural and convenient.
[0003] In the field of wireless communication technology, gestures can cause reflection, diffraction, and multipath of wireless signals. Therefore, different gesture types can be identified based on the changes in wireless signals received by electronic devices to achieve gesture interaction. At present, gesture recognition based on wireless signals mainly obtains various gesture models through model training by collecting antenna signal data through antennas. Then, when performing gesture recognition, features related to human body movement speed are extracted from the collected antenna signal data, and gestures are recognized through the trained gesture model.
[0004] However, in the above method, a large amount of antenna signal data needs to be collected in advance for model training, and features need to be extracted from the collected antenna signal data during gesture recognition, which requires a large amount of calculation and has high computational complexity. Summary of the invention
[0005] The embodiments of the present application provide a gesture recognition method and device, which are helpful in reducing the complexity of gesture recognition.
[0006] An embodiment of the present application provides a method for gesture recognition, the method comprising: sending a first radar electromagnetic signal to a gesture recognition area through a first antenna; receiving a first echo signal obtained by reflecting the first radar electromagnetic signal by a gesture in the gesture recognition area through a second antenna; receiving a second echo signal obtained by reflecting the first radar electromagnetic signal by the gesture in the gesture recognition area through a third antenna; determining a first target time of the second antenna according to the first echo signal, at which the range corresponding to the first echo signal is less than a preset first range threshold; determining a second target time of the third antenna according to the second echo signal, at which the range corresponding to the second echo signal is less than a preset second range threshold; determining the gesture according to the first target time and the second target time; wherein the first antenna, the second antenna and the third antenna are not colinear, and the gesture recognition area is located above the first antenna, the second antenna and the third antenna.
[0007] Using the gesture recognition method provided in the embodiment of the present application, the terminal is configured with a transmitting antenna (such as a first antenna) and at least two receiving antennas (such as a second antenna and a third antenna) that are not collinearly positioned, and a radar electromagnetic signal is transmitted to a gesture recognition area through the transmitting antenna, and an echo signal generated by the reflection of the radar electromagnetic signal by the gesture in the gesture recognition area is received simultaneously through the two receiving antennas, and path data of the change of the path between the signal transmitting antenna and different receiving antennas over time due to the movement of the gesture is extracted from the echo signals received by the two receiving antennas, and the gesture is determined according to the order of the moments when the path has the minimum value in the path data of each receiving antenna.
[0008] Compared with the prior art, which requires the pre-collection of a large amount of antenna signal data for model training, and the need to extract features from the collected antenna signal data during gesture recognition, which requires a large amount of calculation and has high computational complexity, the gesture recognition method provided in the embodiment of the present application can effectively distinguish gestures based only on the change of the Doppler phase shift of the echo signal over time, thereby reducing the complexity of gesture recognition.
[0009] In a possible implementation, at the first target moment, the wave path corresponding to the first echo signal has a minimum value; at the second target moment, the wave path corresponding to the second echo signal has a minimum value.
[0010] In a possible implementation, the determining the gesture according to the first target time and the second target time includes: determining the gesture according to the first target time, the second target time, the position of the first antenna, the position of the second antenna, and the position of the third antenna.
[0011] In a possible implementation, the first target time is determined based on first range data of the range corresponding to the first echo signal varying with time; the second target time is determined based on second range data of the range corresponding to the second echo signal varying with time.
[0012] In a possible implementation, the first range data is determined based on at least one of a phase difference, a time difference or a distance difference of the first echo signal; the second range data is determined based on at least one of a phase difference, a time difference or a distance difference of the second echo signal.
[0013] That is to say, the gesture recognition device can determine the first wave path data of the first echo signal corresponding to the first echo signal that changes with time based on the signal parameters of the first echo signal, and the signal parameters include the phase difference, time difference or distance difference of the first echo signal; and determine the first target time based on the first wave path data.
[0014] In a possible implementation, the first radar electromagnetic signal is sent through the first antenna at at least one preset first moment, and the method further includes: at at least one preset second moment, transmitting a second radar electromagnetic signal to the gesture recognition area through the second antenna; receiving, through the first antenna, a third echo signal obtained after the second radar electromagnetic signal is reflected by the gesture in the gesture recognition area; receiving, through the third antenna, a fourth echo signal obtained after the second radar electromagnetic signal is reflected by the gesture in the gesture recognition area; determining, according to the third echo signal, a third target moment of the first antenna, at which the third target moment, the range corresponding to the third echo signal is less than a third range threshold; determining, according to the fourth echo signal, a fourth target moment of the third antenna, at which the fourth target moment, the range corresponding to the fourth echo signal is less than a fourth range threshold; determining the gesture according to the first target moment and the second target moment, includes: determining the gesture according to the first target moment, the second target moment, the third target moment, and the fourth target moment.
[0015] In the gesture recognition method provided in the embodiment of the present application, the gesture recognition device can switch the antenna function by switching the radio frequency circuits corresponding to the first antenna and the second antenna. Without increasing the number of antennas and radio frequency circuits, the dimension of judging the motion trajectory is increased, thereby improving the recognition accuracy of gestures.
[0016] In a possible implementation manner, the at least one first moment and the at least one second moment are set at intervals.
[0017] In a possible implementation manner, the first radar electromagnetic signal is a single-frequency continuous wave or a single-frequency discontinuous wave.
[0018] In a second aspect, the present application also provides a gesture recognition device for executing the method described in the first aspect or any possible implementation thereof. Specifically, the gesture recognition device may include a unit for executing the method described in the first aspect or any possible implementation thereof.
[0019] In a third aspect, an embodiment of the present application further provides a gesture recognition device, the device comprising: a memory, at least one processor, a communication interface, and instructions stored in the memory and executable on the processor. Further, the memory, the processor, and the communication interface communicate with each other through an internal connection path. The at least one processor executes the instruction so that the gesture recognition device implements the method described in the first aspect or any possible implementation thereof.
[0020] In a fourth aspect, the present application further provides a computer-readable storage medium for storing a computer program, wherein the computer program includes methods for implementing the method described in the above-mentioned first aspect or any possible implementation thereof.
[0021] In a fifth aspect, an embodiment of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to implement the method described in the first aspect or any possible implementation thereof.
[0022] In a sixth aspect, an embodiment of the present application further provides a chip device, comprising: an input interface, an output interface, and at least one processor. Optionally, the chip device also includes a memory. The at least one processor is used to execute the code in the memory. When the at least one processor executes the code, the chip device implements the method described in the first aspect or any possible implementation thereof.
[0023] Optionally, the gesture recognition device may be a chip device or an integrated circuit in a terminal.
[0024] In the seventh aspect, an embodiment of the present application also provides a terminal, comprising at least two antennas and the gesture recognition device described in the second aspect or the third aspect above, wherein the at least two antennas are coupled to the gesture recognition device; or comprising at least two antennas and the chip device or integrated circuit described in the sixth aspect above, wherein the at least two antennas are coupled to the gesture recognition device.
[0025] The gesture recognition method, gesture recognition device, computer storage medium, computer program product, chip and terminal provided in this embodiment are all used to execute the gesture recognition method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the gesture recognition method provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings in the embodiments of the present application are briefly introduced below.
[0027] Figure 1 It is a schematic diagram of an application scenario provided by an embodiment of the present application;
[0028] Figure 2 is a schematic diagram of another application scenario provided by an embodiment of the present application;
[0029] Figure 3 is a schematic diagram of another application scenario provided by an embodiment of the present application;
[0030] Figure 4 is a schematic diagram of another application scenario provided by an embodiment of the present application;
[0031] Figure 5 is a schematic diagram of another application scenario provided by an embodiment of the present application;
[0032] Figure 6 is a schematic diagram of another application scenario provided by an embodiment of the present application;
[0033] Figure 7 is a schematic diagram of another application scenario provided by an embodiment of the present application;
[0034] Figure 8 is a schematic diagram of an antenna layout provided in an embodiment of the present application;
[0035] Fig. 9 This is a schematic diagram of a one-transmit-two-receive antenna mode provided in an embodiment of the present application;
[0036] Fig.10 is a schematic diagram of another antenna layout provided in an embodiment of the present application;
[0037] Fig.11 is a schematic diagram of a gesture recognition method 200 provided in an embodiment of the present application;
[0038] Fig.12 It is a schematic diagram of the principle of Doppler frequency shift between dual-station radars in the prior art;
[0039] Fig.13 is a schematic diagram of a gesture motion trajectory provided in an embodiment of the present application;
[0040] Fig.14 It is a schematic diagram of the wave path provided in the embodiment of the present application;
[0041] Fig.15 is a curve showing the change of wave path over time provided in the embodiment of the present application;
[0042] Fig.16 is a schematic diagram of another gesture motion trajectory provided by an embodiment of the present application;
[0043] Fig.17 is a schematic diagram of another wave path provided in an embodiment of the present application;
[0044] Fig.18 is another curve of wave path changing with time provided in an embodiment of the present application;
[0045] Fig.19 is a schematic diagram of another gesture motion trajectory provided in an embodiment of the present application;
[0046] Fig. 20 It is a schematic diagram of another wave path provided in an embodiment of the present application;
[0047] Fig.21is another curve of wave path changing with time provided in an embodiment of the present application;
[0048] Fig. 22 is a schematic diagram of another antenna layout provided in an embodiment of the present application;
[0049] Fig.23 is a schematic diagram of another antenna layout provided in an embodiment of the present application;
[0050] Fig.24 is a schematic diagram of the wave path under different switching states provided by an embodiment of the present application;
[0051] Fig.25 is a curve showing the change of the wave path over time under different switching states provided in the embodiment of the present application;
[0052] Fig.26 is a schematic diagram of another wave path under different switching states provided by an embodiment of the present application;
[0053] Fig. 27 is a curve of the change of the wave path over time under another different switching state provided by an embodiment of the present application;
[0054] Fig.28 is a schematic diagram of another wave path under different switching states provided in an embodiment of the present application;
[0055] Fig.29 is another curve of the change of the wave path over time under different switching states provided by an embodiment of the present application;
[0056] Fig.30 is a schematic diagram of another gesture motion trajectory provided in an embodiment of the present application;
[0057] Fig.31 is a schematic diagram of another gesture motion trajectory provided in an embodiment of the present application;
[0058] Fig.32 is a schematic block diagram of a gesture recognition device 300 provided in an embodiment of the present application;
[0059] Fig.33 is a schematic block diagram of a gesture recognition device 400 provided in an embodiment of the present application;
[0060] Fig.34 A schematic block diagram of a chip 500 according to an embodiment of the present application is provided. DETAILED DESCRIPTION
[0061] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0062] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0063] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0064] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0065] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0066] An embodiment of the present application provides a gesture recognition method based on multiple antennas, which can be applied to a terminal configured with at least two antennas.
[0067] Optionally, the terminal may be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), or the like. The embodiments of the present application do not impose any restrictions on the specific type of the terminal.
[0068] For example, the terminal may be a station (STA) in a WLAN, a cellular phone, a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA) device, a handheld device with wireless communication function, a computing device or other processing device connected to a wireless modem, a vehicle-mounted device, a vehicle networking terminal, a computer, a laptop computer, a handheld communication device, a handheld computing device, a satellite wireless device, a wireless modem card, a TV set top box (STB), customer premise equipment (CPE) and / or other devices for communicating on a wireless system and a next-generation communication module, for example, a mobile terminal in a 5G network or a mobile terminal in a future evolved public land mobile network (PLMN) network, etc.
[0069] As an example but not limitation, when the terminal is a wearable device, the wearable device can also be a general term for wearable devices that are intelligently designed and developed using wearable technology for daily wear, such as glasses, gloves, watches, clothing and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not just hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include those that are fully functional, large in size, and can achieve complete or partial functions without relying on smartphones, such as smart watches or smart glasses, as well as those that only focus on a certain type of application function and need to be used in conjunction with other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.
[0070] The method provided in the embodiment of the present application can be applied to various application scenarios of the terminal, and the effect of the gesture recognized by the method provided in the embodiment of the present application can have the same effect as the gesture made by the user directly on the touch screen or the gesture command input through other input devices. The gesture made by the user in the embodiment of the present application can be a floating gesture made near the terminal (such as 3-5cm above the screen of the terminal, etc.); or it can be a gesture made by the user directly on the touch screen with his hand, for example, when the touch screen of the terminal is damaged, the terminal can recognize the gesture made by the user directly on the touch screen through the method provided in the present application; or it can be a gesture made by the user directly on the touch screen while wearing a protective set, for example, when the user wears gloves, the user can make gestures directly on the touch screen without removing them, and the terminal can recognize the gesture made by the user through the gesture recognition method provided in the present application.
[0071] It should be noted that the gesture described in the embodiments of the present application refers to the movement trend of the user's hand, rather than the hand posture.
[0072] Optionally, a trigger condition for triggering a gesture recognition instruction may be set on the terminal. When the user wants to enable the gesture recognition function, the user may operate the terminal to trigger the gesture recognition instruction.
[0073] The triggering condition for triggering the gesture recognition instruction can be set according to the actual situation. In some embodiments, a physical key or a virtual key for triggering gesture recognition can be set on the terminal. When the user presses the aforementioned physical key or clicks the aforementioned virtual key, the gesture recognition instruction can be triggered.
[0074] For example, Figure 1 As shown, the terminal 100 may include a physical button 110 and a physical button 120, the physical button 110 is a volume button, and the physical button 120 is a power button. In order to avoid traffic accidents, it is usually inconvenient for the user to operate the terminal 100 while driving the vehicle. Therefore, assuming that an association relationship between the volume button 110 and the gesture recognition function is set in the terminal 100, the user can press the first side and the second side of the volume button with two fingers at the same time before the vehicle drives, triggering a gesture recognition instruction and enabling the gesture operation function, so that the user can issue corresponding instructions to the terminal 100 through gestures during driving.
[0075] For example, Figure 2 As shown in (a) of FIG. 1 , the terminal 100 has a “floating gesture” option 101 in the setting options. After the user selects the “floating gesture” option 101, the following is displayed: Figure 2In the interface shown in (b), the "on" option 102 is used to turn on the floating gesture, and the "off" option 103 is used to turn off the floating gesture. When the user selects the "on" option 102, the terminal can recognize the floating gesture made by the user and execute the corresponding instruction according to the specific floating gesture.
[0076] In other embodiments, the user may also set associations between certain applications and gesture recognition instructions on the terminal 100 , so that when the user starts these specific applications, the gesture recognition instructions are automatically triggered.
[0077] For example, many users currently like to use the audio software on the terminal 100 to play songs while driving a vehicle. Therefore, the user can set the association relationship between the audio software and the gesture recognition instruction. Figure 3 As shown, before driving, the user can use the audio software to play songs on the terminal 100, and the terminal 100 displays the default song list of the audio software, including song A 104 and song B 105. The user clicks song B 105 to start the audio software to play song B 105. When the audio software is started, song B 105 automatically triggers the gesture recognition instruction, enabling the gesture operation function, so that the user can issue corresponding instructions to the terminal 100 through gestures during driving.
[0078] Optionally, the gesture recognition method provided in the embodiment of the present application may be applicable to a variety of application scenarios, which is not limited in the embodiment of the present application.
[0079] In one possible implementation, Figure 4 As shown, when the terminal 100 is in the locked screen state (such as Figure 4 In (a) of FIG. 1 , the user can make a floating gesture of sliding to the right on the top of the terminal screen (such as Figure 4 , the terminal can recognize the right sliding gesture through the method provided in the embodiment of the present application, and then unlock and display the main interface of the terminal for the user (such as Figure 4 , as shown in (c) in the figure).
[0080] In another possible implementation, Figure 5 As shown, when the terminal is in the incoming call state (such as Figure 5 When the user is in the state of sliding rightward on the top of the screen of the terminal (as shown in (a) in FIG. Figure 5 , the terminal can recognize the right sliding gesture through the method provided in the embodiment of the present application, and then answer the call for the user and display the call interface (such as Figure 5 Of course, the user can also make a floating gesture of sliding leftward on the top of the terminal screen to hang up the call.
[0081] In another possible implementation, Figure 6 As shown, when the user uses the terminal to listen to music (such as Figure 6 When the user is in the state of sliding leftward on the top of the screen of the terminal (as shown in (a) in FIG. Figure 6 ), the terminal can use the method provided in the embodiment of the present application to identify the left sliding gesture that can be used to play the previous song, and then the terminal switches to the previous song for the user to play (such as Figure 6 Of course, the user can also make a floating gesture of sliding right on the top of the screen of the terminal to switch to the next song; or, make a floating gesture of sliding upward on the top of the screen of the terminal to increase the volume; or, make a floating gesture of sliding downward on the top of the screen of the terminal to reduce the volume, etc. The embodiments of the present application are not illustrated one by one here.
[0082] In another possible implementation, Figure 7 As shown, when the user uses the terminal to listen to music (such as Figure 7 When the user is in the state of the terminal, the user can make a floating gesture from high to low (ie, press down) on the top of the screen of the terminal (as shown in (a) in FIG. Figure 7 (b) in the figure), the terminal can use the push gesture recognized by the method provided in the embodiment of the present application to play songs in the background, and then the terminal switches to playing songs in the background for the user (such as Figure 7 Of course, the user can also make a floating gesture from high to low and then to high (i.e., first press down and then lift up) on the screen of the terminal to switch to the background to play songs; or, make a floating gesture from low to high (i.e., lift up) on the screen of the terminal to switch to the background to play songs; or, make a floating gesture of pressing down on the screen of the terminal to reduce the volume; or, make a floating gesture of lifting up on the screen of the terminal to increase the volume, etc. The embodiments of the present application are not illustrated one by one here.
[0083] Similarly, when a user uses the address book of the terminal, the user can make a gesture of sliding up or sliding down, etc., and when the terminal recognizes that the gesture is a sliding up through the method provided in the embodiment of the present application, it can be used to display the previous page of the address book for the user, and if it recognizes that the gesture is a sliding down, it can be used to display the next page of the address book for the user; or, when the user uses the terminal to browse the photo album, the user can make a gesture of sliding left or right, etc., and when the terminal recognizes that the gesture is a sliding right through the method provided in the embodiment of the present application, it can be used to display the next picture for the user, and if it recognizes that the gesture is a sliding left, it can be used to display the previous picture for the user; or, when the user uses the application of the terminal, the user can make a gesture from high to low (i.e., pressing down) or from low to high. When the terminal recognizes the gesture as pressing down, lifting up, or pressing down and then lifting up through the method provided in the embodiment of the present application, it can be used to exit the application or display the desktop for the user; or, when the screen of the terminal is in a lit state and the user is not using the terminal temporarily, the user can make a pressing gesture, and when the terminal recognizes the gesture as pressing down through the method provided in the embodiment of the present application, it can be used to turn off the screen; or, when the screen of the terminal is in the screen-off state and the user wants to wake up the terminal, the user can make a pressing gesture first and then lifting up, etc., and when the terminal recognizes the gesture as pressing down and then lifting up through the method provided in the embodiment of the present application, it can be used to light up the screen and wake up the terminal.
[0084] It should be noted that the above only schematically illustrates or lists some possible application scenarios, but the embodiments of the present application are not limited thereto. The gesture recognition method provided in the embodiments of the present application can also be applied to other application scenarios of gesture recognition, which are not listed one by one in the embodiments of the present application.
[0085] It should also be noted that the user can use one or more fingers, such as the index finger, to implement the above-mentioned gestures in various sliding directions; or, the user can use the palm of the hand to implement the above-mentioned gestures in various sliding directions, which is not limited to this embodiment of the present application.
[0086] It should be noted that the “movement from right to left” described in the embodiments of the present application can be understood as “movement to the left”, the “movement from left to right” can be understood as “movement to the right”, the “movement from bottom to top” can be understood as “movement up”, the “movement from top to bottom” can be understood as “movement down”, the “movement from high to low” can be understood as “movement down (i.e. pressing down)”, and the “movement from low to high” can be understood as “movement up (i.e. lifting up)”.
[0087] The terminal used in the embodiment of the present application may include at least two antennas and a gesture recognition device, and the gesture recognition device is configured with a communication interface. The gesture recognition device can transmit signals / data with the at least two antennas through the communication interface to implement the gesture recognition method provided in the embodiment of the present application.
[0088] It should be noted that the embodiment of the present application is only introduced by taking the at least two antennas and the gesture recognition device integrated in the same terminal as an example, but the embodiment of the present application is not limited to this. Optionally, the at least two antennas can be integrated in a first terminal, the gesture recognition device can be integrated in a second terminal, and signals and / or data can be transmitted between the first terminal and the second terminal. When the at least two antennas and the gesture recognition device are integrated in different terminals, the process of implementing the gesture recognition method provided in the embodiment of the present application can refer to the process of integrating at least two antennas and the gesture recognition device in the same terminal. To avoid repetition, it will not be repeated here.
[0089] Optionally, the embodiment of the present application does not limit the specific number of antennas.
[0090] In a possible implementation, the terminal may include two antennas, and the two antennas are configured as a one-transmit and one-receive antenna mode.
[0091] In another possible implementation, the terminal may include three antennas, the three antennas are configured as a one-transmit-two-receive antenna mode, and the three antennas are not co-linear.
[0092] In yet another possible implementation, the terminal may include at least four antennas, the at least four antennas are configured as a one-transmit-multiple-receive antenna mode, and the at least four antennas are not co-linear.
[0093] It should be noted that the antenna mode of "A transmits and B receives" described in the embodiments of the present application means that A antennas are respectively connected to A RF transmitting circuits to form A transmitting channels; and B antennas are respectively connected to B RF receiving circuits to form B receiving channels.
[0094] It should be noted that, for the sake of clarity, the embodiments of the present application are described only by taking the example that the terminal includes a first antenna, a second antenna and a third antenna, but the embodiments of the present application are not limited to this.
[0095] It should also be noted that the gesture recognition process when the terminal includes two antennas or more than four antennas can refer to the gesture recognition process when the terminal includes a first antenna, a second antenna and a third antenna, and will not be repeated here to avoid repetition.
[0096] Optionally, the first antenna, the second antenna and the third antenna may be independently provided antennas dedicated to gesture recognition; or, the at least three antennas may reuse existing antennas used for wireless communication, such as a WIFI antenna, which is not limited in the embodiments of the present application.
[0097] In a possible implementation, when the first antenna, the second antenna, and the third antenna are independently provided antennas for gesture recognition, the first radar electromagnetic signal may be a single-frequency continuous wave. That is, the terminal may continuously transmit and receive radar electromagnetic signals through the first antenna, the second antenna, and the third antenna.
[0098] In this way, using an extremely narrow-band single-frequency continuous wave radar as the platform has little impact on terminal communications. Although the echo signal has a certain bandwidth, the bandwidth broadening caused by gesture movement is very small (approximately the Hz level), so it can coexist with terminal communications.
[0099] In another possible implementation, when the first antenna, the second antenna, and the third antenna reuse existing antennas for wireless communication, the first radar electromagnetic signal may be a single-frequency discontinuous wave. In other words, the terminal may implement intermittent transmission and reception of communication signals and radar electromagnetic signals by reusing the at least three antennas.
[0100] In this way, no additional layout and wiring burden will be imposed on the RF front end of the terminal, no hardware cost will be increased, and the power consumption and volume of the terminal will not be affected. This solves the problem that when radar is currently used for gesture recognition, the layout of radar sensors in the terminal will bring a large layout and wiring burden to the RF front end of the terminal, increasing the hardware cost, power consumption and volume of the terminal.
[0101] It should also be noted that the positions of the first antenna, the second antenna and the third antenna described in the embodiment of the present application are not collinear, which can be understood as when the first antenna, the second antenna and the third antenna are projected onto the plane where the screen or touch panel of the terminal is located, the projection positions of the first antenna, the second antenna and the third antenna in the plane are not collinear. If the plane is represented by a two-dimensional space (x-axis and y-axis), the projections of the first antenna, the second antenna and the third antenna in the plane correspond to different values on the x-axis, or different values on the y-axis, or both the values on the x-axis and the values on the y-axis are different.
[0102] Optionally, the first antenna, the second antenna, and the third antenna may be arranged in a variety of ways so that the first antenna, the second antenna, and the third antenna are not colinear, which is not limited in this embodiment of the present application.
[0103] In one possible implementation, Figure 8(a) in FIG. 1 shows a possible position relationship diagram of the first antenna (A1), the second antenna (A2) and the third antenna (A3). Figure 8 As shown in (a), taking the plane where the screen of the terminal is located as the projection plane of the first antenna, the second antenna and the third antenna, the horizontal direction as the x-axis direction, and the vertical direction as the y-axis direction as an example, T represents the top of the terminal, B represents the bottom of the terminal, L represents the left side of the terminal, R represents the right side of the terminal, the first antenna and the third antenna have the same value on the y-axis, and the second antenna and the third antenna have the same value on the x-axis.
[0104] Optionally, the values of the first antenna and the third antenna on the y-axis may be different, and / or the values of the second antenna and the third antenna on the x-axis may be different, which is not limited in the embodiment of the present application.
[0105] For example: Figure 8 (b) in FIG. 5 shows another possible positional relationship, where the first antenna and the third antenna have different values on the y-axis, and the second antenna and the third antenna have different values on the x-axis.
[0106] It should be noted that Figure 8 (a) and (b) in the figure only exemplarily show that the first antenna, the second antenna and the third antenna are projected in the middle area of the screen, and the gesture recognition area is located above the screen.
[0107] Optionally, the first antenna, the second antenna, the third antenna and the gesture recognition area may also be projected onto other areas of the screen, which is not limited in the embodiments of the present application.
[0108] For example, the first antenna, the second antenna, and the third antenna may be projected together at the upper left corner of the screen (eg, Figure 8 (c) in the figure), upper right corner, lower left corner, and lower right corner.
[0109] Another example: Figure 8 As shown in (d) in the figure, the first antenna, the second antenna and the third antenna can be projected at the lower right corner, the upper left corner and the lower left corner of the screen respectively.
[0110] Optionally, the projection of the gesture recognition area on the screen may or may not overlap with the projections of the first antenna, the second antenna, and the third antenna on the screen, which is not limited in this embodiment of the present application.
[0111] In a possible implementation, the first antenna, the second antenna, and the third antenna are arranged as follows: Figure 8 When (a) is set in, the gesture recognition area can be located above the screen, in the middle area above the screen, in the upper left corner area or other areas.
[0112] In another possible implementation, the first antenna, the second antenna, and the third antenna are arranged as follows: Figure 8 When (c) is set in, the gesture recognition area can be located above the screen, in the middle area above the screen, in the upper left corner area or other areas.
[0113] Optionally, the first antenna, the second antenna, and the third antenna may be configured as a one-transmit-two-receive antenna mode in a variety of ways, which is not limited in the embodiments of the present application.
[0114] In one possible implementation, Fig. 9 Shows Figure 8 A possible configuration mode in which the first antenna, the second antenna, and the third antenna are configured as a one-transmit-two-receive antenna mode. Fig. 9 As shown, the first antenna can be connected to the RF transmitting circuit to form a transmitting channel, the second antenna can be connected to the first RF receiving circuit to form a first transmitting channel, and the third antenna can be connected to the second RF receiving circuit to form a second transmitting channel. Fig. 9 After setting, the first antenna is a transmitting antenna, the second antenna is a first receiving antenna, and the third antenna is a second receiving antenna.
[0115] For example: Figure 8 The first antenna, the second antenna and the third antenna shown in (a) are arranged according to Fig. 9 After setting the one-transmit-two-receive mode in Fig.10 The schematic diagram of the antenna mode of one transmit and two receive is shown, wherein the first antenna (A1) is the transmitting antenna (T x ), the second antenna (A2) is the first receiving antenna (R x1 ), the third antenna (A2) is the second receiving antenna (R x2 ).
[0116] Optionally, Figure 8 The first antenna, the second antenna and the third antenna shown in (a) may also be connected to the RF transmitting circuit, the first RF receiving circuit and the second RF receiving circuit in other ways and set to a one-transmit-two-receive antenna mode, which is not limited to this in the embodiments of the present application.
[0117] The first antenna, the second antenna and the third antenna are as follows. Fig.10 The shown one-transmit-two-receive antenna mode setting is used as an example to introduce the gesture recognition method provided in an embodiment of the present application.
[0118] It should be understood that the terminal Figure 8The positional relationship of the first antenna, the second antenna, and the third antenna shown in (b), (c), and (d) is used to set a one-transmit-two-receive antenna mode, and to perform the gesture recognition method, and the gesture recognition method is performed according to Fig.10 The positional relationship among the first antenna, the second antenna, and the third antenna shown in the figure sets a one-transmit-two-receive antenna mode, and the process of executing the gesture recognition method is similar, and will not be described again here to avoid repetition.
[0119] Fig.11 2 shows a schematic flow chart of a gesture recognition method 200 provided in an embodiment of the present application. The method can be applied to the above-mentioned terminal, in which the first antenna, the second antenna and the third antenna are arranged as follows: Fig.10 The method shown in the figure is set to a one-transmit-two-receive antenna mode, and the method can be executed by a gesture recognition device in the terminal.
[0120] S201: A gesture recognition device sends a first radar electromagnetic signal to a gesture recognition area through a first antenna.
[0121] S202: The gesture recognition device receives, through a second antenna, a first echo signal obtained after the first radar electromagnetic signal is reflected by a gesture in the gesture recognition area.
[0122] S203: The gesture recognition device receives, through a third antenna, a second echo signal obtained after the first radar electromagnetic signal is reflected by the gesture in the gesture recognition area.
[0123] It should be noted that the execution order of S202 and S203 is not particular, that is, S202 may be executed first, and then S203; or S203 may be executed first, and then S202; or S202 and S203 may be executed simultaneously.
[0124] S204: The gesture recognition device determines a first target time of the second antenna according to the first echo signal. At the first target time, a range corresponding to the first echo signal is smaller than a preset first range threshold.
[0125] In a possible implementation manner, at the first target moment, the wave path corresponding to the first echo signal has a minimum value.
[0126] Optionally, the gesture recognition device may determine the first target time of the second antenna according to the first echo signal in a variety of ways, which is not limited in this embodiment of the present application.
[0127] In a possible implementation, the gesture recognition device can determine first wave path data of the wave path corresponding to the first echo signal changing with time based on the signal parameters of the first echo signal, and the signal parameters include the phase difference, time difference or distance difference of the first echo signal; and determine the first target time based on the first wave path data.
[0128] That is to say, the first target time is determined according to the first wave path data, and the first wave path data is determined according to at least one of a phase difference, a time difference or a distance difference of the first echo signal.
[0129] Optionally, the first wave path data may represent the change of the echo corresponding to the first echo signal over time in a variety of ways, which is not limited in this embodiment of the present application.
[0130] In a possible implementation, the first wave path data may include a curve showing that the wave path corresponding to the first echo signal changes with time.
[0131] In another possible implementation manner, the first wavelength data may include a corresponding relationship between the wavelength corresponding to the first echo signal and time.
[0132] It should be noted that in the embodiment of the present application, only the curve of the first wave path data including the wave path corresponding to the first echo signal changing with time is introduced as an example, but the embodiment of the present application is not limited to this.
[0133] In a possible implementation, taking a single-frequency continuous wave as an example, a single-frequency continuous wave Doppler radar sensor (DRS) is a radar that emits a point-frequency radio frequency electromagnetic wave and can sense and detect the relative motion of a target by measuring the Doppler frequency shift of an echo signal.
[0134] like Fig.12 As shown in Figure 1, the Doppler frequency shift between the two-station radars originates from the displacement change of the moving target relative to the transmitting antenna and the receiving antenna. The Doppler frequency shift between the two-station radars can be expressed by the following formula 1.
[0135] f d =f c |V|·(cosθ T -cosθ R ) / c (Formula 1)
[0136] Among them, f c represents the RF carrier frequency, c represents the speed of light, θ T represents the angle between the target's velocity vector v and the transmitting antenna's direction vector (i.e., the projection of the velocity V on the line connecting the target and the transmitting antenna), θ RRepresents the angle between the target's velocity vector v and the receiving antenna's direction vector (i.e., the projection of the velocity V on the line connecting the target and the receiving antenna).
[0137] For a single-frequency continuous wave signal, the Doppler frequency shift can be equivalent to the phase shift of the measured echo signal, as shown in the following formula 2.
[0138]
[0139] in, represents the instantaneous phase shift, ∫f d (t) represents the Doppler shift.
[0140] From Formula 2, we can see that when the lower limit of the integral in Formula 1 is known, the instantaneous phase shift is proportional to the wave path distance (WPD) (abbreviated as W(t)), that is, c is the speed of light, that is, the wave path and the Doppler phase shift differ only by a proportional constant.
[0141] It should be noted that the phase shift of the echo signal is also referred to as the phase difference of the echo signal. Similarly, the Doppler frequency shift can be equivalent to measuring the time difference or distance difference of the echo signal.
[0142] Therefore, the Doppler frequency shift of the echo signal can be determined by measuring the phase difference, time difference or distance difference of the echo signal, thereby obtaining the wave path of the echo signal.
[0143] S205: The gesture recognition device determines a second target time of the third antenna according to the second echo signal. At the second target time, a range corresponding to the second echo signal is smaller than a preset second range threshold.
[0144] In a possible implementation manner, at the second target moment, the wave path corresponding to the second echo signal has a minimum value.
[0145] Optionally, the gesture recognition device may determine the second target time of the third antenna according to the second echo signal in a variety of ways, which is not limited in this embodiment of the present application.
[0146] In one possible implementation, the gesture recognition device can determine second wave path data of the wave path corresponding to the second echo signal changing with time based on the signal parameters of the second echo signal, and the signal parameters include the phase difference, time difference or distance difference of the second echo signal; and determine the second target time based on the second wave path data.
[0147] That is to say, the second target time is determined according to the second wave path data, and the second wave path data is determined according to at least one of a phase difference, a time difference or a distance difference of the second echo signal.
[0148] Optionally, the second wave path data may represent the change of the echo corresponding to the second echo signal over time in a variety of ways, which is not limited in this embodiment of the present application.
[0149] In a possible implementation, the second wave path data may include a curve showing that the wave path corresponding to the second echo signal changes with time.
[0150] In another possible implementation manner, the second wavelength data may include a corresponding relationship between the wavelength corresponding to the second echo signal and time.
[0151] It should be noted that in the embodiment of the present application, only the curve of the second wave path data including the wave path corresponding to the second echo signal changing with time is introduced as an example, but the embodiment of the present application is not limited to this.
[0152] It should be noted that the execution order of S204 and S205 is not particular, that is, S204 may be executed first and then S205; or S205 may be executed first and then S204; or S204 and S205 may be executed simultaneously.
[0153] S206: The gesture recognition device determines the gesture according to the first target time and the second target time.
[0154] Optionally, the gesture recognition device may determine the gesture according to the first target time and the second target time in a variety of ways, which is not limited in this embodiment of the present application.
[0155] In a possible implementation, the gesture recognition device may determine the gesture according to the first target time, the second target time, the position of the first antenna, the position of the second antenna, and the position of the third antenna.
[0156] For example, the gesture recognition device may determine the gesture according to the sequence of the first target time and the second target time, as well as the position of the first antenna, the position of the second antenna, and the position of the third antenna.
[0157] In a possible implementation, when the gesture is Fig.13 When the left-right movement (not distinguishing between left to right or right to left) is shown, the first receiving antenna (R x1 ) The wave path diagram corresponding to the first echo signal received is as follows Fig.14 As shown in (a), the second receiving antenna (R x2 ) The wave path diagram corresponding to the second echo signal received is as follows Fig.14 As shown in (b), where Fig.14The black origins in (a) and (b) schematically illustrate the movement trajectory of the gesture at different moments.
[0158] Accordingly, when the gesture moves from left to right, Fig.14 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.15 As shown by the dotted line in (a); Fig.14 The curve of the wave path corresponding to the second echo signal shown in (b) of FIG. 10 changes with time is as follows: Fig.15 As shown by the solid line in (a) in FIG. When the gesture moves from right to left, Fig.14 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.15 As shown by the dotted line in (b); Fig.14 The curve of the wave path corresponding to the second echo signal shown in (b) of FIG. 10 changes with time is as follows: Fig.15 As shown by the solid line in (b).
[0159] Depend on Fig.15 From (a) in FIG. 1 , it can be seen that when the gesture moves from left to right, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value.
[0160] Depend on Fig.15 From (b) in FIG. 1 , it can be seen that when the gesture moves from right to left, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value.
[0161] That is, when the first target time t1 is the same as the second target time t2, or the difference between the first target time t1 and the second target time t2 is less than the time threshold, the gesture recognition device can determine that the motion trajectory of the gesture is a left-right motion.
[0162] In a possible implementation, when the gesture is Fig.16 When the up-and-down movement (not distinguishing between up-to-down and down-to-up) is shown, the first receiving antenna (R x1 ) The wave path diagram corresponding to the first echo signal received is as follows Fig.17 As shown in (a), the second receiving antenna (R x2 ) The wave path diagram corresponding to the second echo signal received is as follows Fig.17As shown in (b), where Fig.17 The black origins in (a) and (b) schematically illustrate the movement trajectory of the gesture at different moments.
[0163] Accordingly, when the gesture moves from bottom to top, Fig.17 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.18 As shown by the dotted line in (a); Fig.17 The curve of the wave path corresponding to the second echo signal shown in (b) changes with time is as follows: Fig.18 As shown by the solid line in (a) in FIG. When the gesture is moving from top to bottom, Fig.17 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.18 As shown by the dotted line in (b); Fig.17 The curve of the wave path corresponding to the second echo signal shown in (b) changes with time is as follows: Fig.18 As shown by the solid line in (b).
[0164] Depend on Fig.18 From (a) in FIG. 1 , it can be seen that when the gesture is moving from bottom to top, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value.
[0165] Depend on Fig.18 From (b) in FIG. 1 , it can be seen that when the gesture is moving from top to bottom, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value.
[0166] That is to say, when the first target moment t1 is later than the second target moment t2, the gesture recognition device can determine that the motion trajectory of the gesture is from bottom to top; when the first target moment t1 is earlier than the second target moment t2, the gesture recognition device can determine that the motion trajectory of the gesture is from top to bottom. In another embodiment of the present application, when the first target moment t1 is later than the second target moment t2, it can be further determined that when the difference between the first target moment t1 and the second target moment t2 is greater than the time threshold, the gesture recognition device can determine that the motion trajectory of the gesture is from bottom to top; and when the first target moment t1 is earlier than the second target moment t2, it can be further determined that when the difference between the first target moment t1 and the second target moment t2 is greater than the time threshold, the gesture recognition device can determine that the motion trajectory of the gesture is from top to bottom.
[0167] In a possible implementation, when the gesture is Fig.19 When the high-low movement (not distinguishing from high to low or from low to high) is shown, the first receiving antenna (R x1 ) The wave path diagram corresponding to the first echo signal received is as follows Fig. 20 As shown in (a), the second receiving antenna (R x2 ) The wave path diagram corresponding to the second echo signal received is as follows Fig. 20 As shown in (b), where Fig. 20 The black origins in (a) and (b) schematically illustrate the movement trajectory of the gesture at different moments.
[0168] Correspondingly, when the gesture moves from high to low, Fig. 20 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.21 As shown by the dotted line in (a); Fig. 20 The curve of the wave path corresponding to the second echo signal shown in (b) changes with time is as follows: Fig.21 As shown by the solid line in (a) in FIG. When the gesture moves from high to low and then to high, Fig. 20 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.21 As shown by the dotted line in (b); Fig. 20 The curve of the wave path corresponding to the second echo signal shown in (b) changes with time is as follows: Fig.21 As shown by the solid line in (b).
[0169] Depend on Fig.21 From (a) in FIG. 1 , it can be seen that when the gesture moves from high to low, at the first target time t1, the first receiving antenna R x1The wave path corresponding to the received first echo signal has a minimum value, and the first receiving antenna R x1 The wave path corresponding to the received first echo signal decreases monotonically with time; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value, and the second receiving antenna R x2 The wave path corresponding to the received second echo signal decreases monotonically over time.
[0170] Depend on Fig.21 From (b) in FIG. 1 , it can be seen that when the gesture moves from high to low and then to high, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value, and the first receiving antenna R x1 The wave path corresponding to the received first echo signal first decreases monotonically and then increases monotonically with time; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value, and the second receiving antenna R x2 The wave path corresponding to the received second echo signal first decreases monotonically and then increases monotonically over time.
[0171] That is to say, when the first target moment t1 is the same as the second target moment t2, or the difference between the first target moment t1 and the second target moment t2 is less than the time threshold, and the range corresponding to the first echo signal and the range corresponding to the second echo signal both decrease monotonically with time, the gesture recognition device can determine that the motion trajectory of the gesture is a high-low motion; when the first target moment t1 is the same as the second target moment t2, or the difference between the first target moment t1 and the second target moment t2 is less than the time threshold, and the range corresponding to the first echo signal and the range corresponding to the second echo signal both first decrease monotonically and then increase monotonically with time, the gesture recognition device can determine that the motion trajectory of the gesture is from high to low and then to high.
[0172] It should be noted that, taking the example of a user performing gestures with his palm, in one possible implementation, when the plane where the palm is located is parallel or approximately parallel to the screen and moves left and right or up and down, the radar electromagnetic signal may be reflected by different areas of the palm in the direction of movement of the palm, such as the horizontal direction, for example, by five fingers respectively, that is, the five fingers may be detected as five different targets, and the above-mentioned time-varying path data or the time-varying path data of each path are obtained according to the path corresponding to the echo signals of these targets, so as to obtain the above-mentioned time-varying curve. In another possible implementation, such as Fig.13 and Fig.16As shown, the plane where the user's palm is located can be perpendicular or approximately perpendicular to the screen and move left and right. In this way, when the palm moves left and right or up and down, the area where the radar electromagnetic signal is reflected in the direction of movement of the palm (such as the side of the palm) is smaller, and the accuracy of gesture recognition is higher.
[0173] It should also be noted that, taking the example of a user using the palm to perform gesture movements, in one possible implementation, when the plane where the palm is located is perpendicular or approximately perpendicular to the screen and moves up and down, the radar electromagnetic signal may be reflected by different areas of the palm in the direction of movement of the palm, such as the vertical direction, for example, by five fingers respectively, that is, the five fingers may be detected as five different targets, and the above-mentioned time-varying path data or the time-varying path data of each path are obtained according to the path corresponding to the echo signals of these targets, so as to obtain the above-mentioned time-varying curve. In another possible implementation, such as Fig.19 As shown, the plane where the user's palm is located can be parallel or approximately parallel to the screen and move up and down. In this way, when the palm moves in the up and down directions, the area where the radar electromagnetic signal is reflected in the direction of the palm's movement (such as the side of the palm) is smaller, and the accuracy of gesture recognition is higher.
[0174] It should be noted that Fig.15 and Fig.18 It can be seen that when the gesture is left-right movement and up-down movement, the following conclusions exist: the first target time t1 is the same as the second target time t2, or the difference between the first target time t1 and the second target time t2 is less than the time threshold. In other words, the antenna of the gesture recognition device adopts Fig.11 The arrangement shown does not allow for more accurate gesture recognition, ie, it is not possible to distinguish whether a gesture is from left to right or from right to left, or whether the gesture is moving from left to right or from high to low and then back to high.
[0175] Therefore, it is possible to consider adding one or more receiving antennas to increase the dimension of judging the motion trajectory, thereby improving the accuracy of gesture recognition. However, in this way, more antennas and corresponding RF receiving circuits are required, which is too costly.
[0176] In the gesture recognition method provided in the embodiment of the present application, the gesture recognition device can switch the antenna function by switching the radio frequency circuits corresponding to the first antenna and the second antenna. Without increasing the number of antennas and radio frequency circuits, the effect of judging the dimension of the motion trajectory is increased, thereby improving the recognition accuracy of the gesture.
[0177] It should be noted that the antenna function described in the embodiments of the present application includes a transmitting function or a receiving function. The function implemented by the antenna is determined by the RF circuit connected to it. When the antenna is connected to the RF transmitting circuit, it can realize the transmitting function, that is, it is a transmitting antenna. When the antenna is connected to the RF receiving circuit, it can realize the receiving function, that is, it is a receiving antenna.
[0178] In a possible implementation, a double pole double throw (DPDT) switch may be provided between the first antenna and the second antenna and between the transmitting channel and the first receiving channel, and the DPDT switch may be controlled to continuously switch at a preset switching frequency, so that the first antenna and the second antenna switch antenna functions at the switching frequency.
[0179] For example: Fig. 22 As shown in (a), when the double-pole double-throw switch is in the first switching state, the first antenna is connected to the radio frequency transmitting circuit, the second antenna is connected to the first radio frequency receiving circuit, and the third antenna is connected to the second radio frequency receiving circuit. That is, the first antenna is a transmitting antenna, the second antenna is a first receiving antenna, and the third antenna is a second receiving antenna.
[0180] It should be noted that, in the first switching state, the first antenna, the second antenna and the third antenna are configured in the same manner as in the one-transmit-two-receive antenna mode. Fig.11 similar.
[0181] Another example: Fig. 22 As shown in (b), when the double-pole double-throw switch is in the second switching state, the first antenna is connected to the first RF receiving circuit, the second antenna is connected to the RF transmitting circuit, and the third antenna is connected to the second RF receiving circuit. That is, the first antenna is the first receiving antenna, the second antenna is the transmitting antenna, and the third antenna is the second receiving antenna.
[0182] It should be noted that, in the second switching state, the transmission-dual-reception antenna mode of the first antenna, the second antenna and the third antenna is set as follows: Fig.23 shown.
[0183] That is to say, the above-mentioned first radar electromagnetic signal is sent through the first antenna at at least one preset first moment, and the method 200 also includes: at at least one preset second moment, transmitting a second radar electromagnetic signal to the gesture recognition area through the second antenna; receiving a third echo signal obtained by the first antenna after the second radar electromagnetic signal is reflected by the gesture in the gesture recognition area; receiving a fourth echo signal obtained by the third antenna after the second radar electromagnetic signal is reflected by the gesture in the gesture recognition area; determining a third target moment of the first antenna according to the third echo signal, at which the third target moment, the range corresponding to the third echo signal is less than a preset third range threshold; determining a fourth target moment of the third antenna according to the fourth echo signal, at which the fourth target moment, the range corresponding to the fourth echo signal is less than a preset fourth range threshold.
[0184] It should be noted that the first range threshold, the second range threshold, the third range threshold and the fourth range threshold may be the same or different, and the embodiments of the present application do not limit this. It should be understood that the specific values of the first range threshold, the second range threshold, the third range threshold and the fourth range threshold may be determined by the antenna setting method, the positional relationship between the gesture recognition area and the antenna, and various predefined gestures.
[0185] Optionally, the at least one first moment and the at least one second moment are arranged at intervals. That is, the at least one first moment is at least one moment when the double-pole double-throw switch is in the first switching state, and the at least one second moment is at least one moment when the double-pole double-throw switch is in the second switching state.
[0186] It should be noted that the gesture recognition device can switch the antenna functions of the first antenna and the second antenna by switching the double-pole double-throw switch at a preset switching frequency within the scanning time period of the radar scanning cycle. That is, the at least one first moment and the at least one second moment belong to the scanning time period of the radar scanning cycle.
[0187] It should be noted that the process of the gesture recognition device determining the third target moment of the first antenna can refer to the above process of determining the first target moment of the first antenna, and the process of the gesture recognition device determining the fourth target moment of the second antenna can refer to the above process of determining the second target moment of the second antenna. To avoid repetition, it will not be repeated here.
[0188] Correspondingly, S206 includes: determining the gesture according to the first target moment, the second target moment, the third target moment and the fourth target moment.
[0189] In one possible implementation, the gesture recognition device can determine the gesture based on the sequence of the first target moment and the second target moment in the first switching state, the sequence of the third target moment and the fourth target moment in the second switching state, and the position of the first antenna, the position of the second antenna, and the position of the third antenna.
[0190] In the following, in the first switching state, the first antenna, the second antenna and the third antenna are as follows: Fig.11 In the antenna mode setting of one transmit and two receive shown in FIG. 1 , in the second switching state, the first antenna, the second antenna and the third antenna are configured as follows: Fig.23 Taking the one-transmit-two-receive antenna mode setting shown as an example, the process of determining the gesture by the gesture recognition device according to the sequence of the first target moment and the second target moment in the first switching state, the sequence of the third target moment and the fourth target moment in the second switching state, and the position of the first antenna, the position of the second antenna, and the position of the third antenna is introduced.
[0191] In a possible implementation, when the gesture is Fig.13 When the left-right movement (not distinguishing between left to right or right to left) is shown, in the first switching state, the first receiving antenna (R x1 ) The wave path diagram corresponding to the first echo signal received is as follows Fig.24 As shown in (a), the second receiving antenna (R x2 ) The wave path diagram corresponding to the second echo signal received is as follows Fig.24 As shown in (b); in the second switching state, the first receiving antenna (R x1 ) The wave path diagram corresponding to the third echo signal received is as follows Fig.24 As shown in (c), the second receiving antenna (R x2 ) The wave path diagram corresponding to the fourth echo signal received is as follows Fig.24 As shown in (d), where Fig.24 The black origins in (a), (b), (c) and (d) schematically illustrate the movement trajectory of the gesture at different moments.
[0192] Accordingly, when the gesture is moving from left to right, in the first switching state, Fig.24 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.25 As shown by the dotted line in (a); Fig.24 The curve of the wave path corresponding to the second echo signal shown in (b) of FIG. 10 changes with time is as follows: Fig.25 As shown by the solid line in (a); in the second switching state, Fig.24The curve of the wave path corresponding to the third echo signal shown in (c) of FIG. 10 changes with time is as follows: Fig.25 As shown by the dotted line in (c); Fig.24 The curve of the wave path corresponding to the fourth echo signal shown in (d) of FIG. 10 changes with time is as follows: Fig.25 As shown by the solid line in (c).
[0193] Accordingly, when the gesture is moving from right to left, in the first switching state, Fig.24 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.25 As shown by the dotted line in (b); Fig.24 The curve of the wave path corresponding to the second echo signal shown in (b) of FIG. 10 changes with time is as follows: Fig.25 As shown by the solid line in (b); in the second switching state, Fig.24 The curve of the wave path corresponding to the third echo signal shown in (c) of FIG. 10 changes with time is as follows: Fig.25 As shown by the dotted line in (d); Fig.24 The curve of the wave path corresponding to the fourth echo signal shown in (d) of FIG. 10 changes with time is as follows: Fig.25 As shown by the solid line in (d).
[0194] Depend on Fig.25 From (a) in FIG. 1 , it can be seen that when the gesture is moving from left to right, in the first switching state, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value.
[0195] Depend on Fig.25 From (c) in FIG. 1 , it can be seen that when the gesture is moving from left to right, in the second switching state, at the third target time t3, the first receiving antenna R x1 The wave path corresponding to the received third echo signal has a minimum value; at the fourth target time t4, the second receiving antenna R x2 The wave path corresponding to the fourth received echo signal has a minimum value.
[0196] Depend on Fig.25 From (b) in FIG. 1 , it can be seen that when the gesture is moving from right to left, in the first switching state, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value.
[0197] Depend on Fig.25 From (d) in FIG. 1 , it can be seen that when the gesture is moving from right to left, in the second switching state, at the third target time t3, the first receiving antenna R x1 The wave path corresponding to the received third echo signal has a minimum value; at the fourth target time t4, the second receiving antenna R x2 The wave path corresponding to the fourth received echo signal has a minimum value.
[0198] Therefore, the gesture recognition device can determine the gesture in the following different situations.
[0199] Case 1-1: When in the first switching state, the first target moment t1 is the same as the second target moment t2, or the difference between the first target moment t1 and the second target moment t2 is less than the time threshold, and in the second switching state, the third target moment t3 is later than the fourth target moment t4, the gesture recognition device can determine that the movement trajectory of the gesture is from left to right.
[0200] Further, in another embodiment of the present application, when in the first switching state, the first target moment t1 is the same as the second target moment t2, or the difference between the first target moment t1 and the second target moment t2 is less than the time threshold, and in the second switching state, the third target moment t3 is later than the fourth target moment t4, and the difference between the third target moment t3 and the fourth target moment t4 is greater than the time threshold, the gesture recognition device can determine that the movement trajectory of the gesture is from left to right.
[0201] Case 1-2: When in the first switching state, the first target moment t1 is the same as the second target moment t2, or the difference between the first target moment t1 and the second target moment t2 is less than the time threshold, and in the second switching state, the third target moment t3 is earlier than the fourth target moment t4, the gesture recognition device can determine that the movement trajectory of the gesture is from right to left.
[0202] Further, in another embodiment of the present application, when in the first switching state, the first target moment t1 is the same as the second target moment t2, or the difference between the first target moment t1 and the second target moment t2 is less than the time threshold, and in the second switching state, the third target moment t3 is earlier than the fourth target moment t4, and the difference between the fourth target moment t4 and the third target moment t3 is greater than the time threshold, the gesture recognition device can determine that the movement trajectory of the gesture is from right to left.
[0203] In a possible implementation, when the gesture is Fig.16When the up-and-down movement (not distinguishing between bottom-up and top-down) is shown, in the first switching state, the first receiving antenna (R x1 ) The wave path diagram corresponding to the first echo signal received is as follows Fig.26 As shown in (a), the second receiving antenna (R x2 ) The wave path diagram corresponding to the second echo signal received is as follows Fig.26 As shown in (b); in the second switching state, the first receiving antenna (R x1 ) The wave path diagram corresponding to the third echo signal received is as follows Fig.26 As shown in (c), the second receiving antenna (R x2 ) The wave path diagram corresponding to the fourth echo signal received is as follows Fig.26 As shown in (d), where Fig.26 The black origins in (a), (b), (c) and (d) schematically illustrate the movement trajectory of the gesture at different moments.
[0204] Accordingly, when the gesture is moving from bottom to top, in the first switching state, Fig.26 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig. 27 As shown by the dotted line in (a); Fig.26 The curve of the wave path corresponding to the second echo signal shown in (b) of FIG. 10 changes with time is as follows: Fig. 27 As shown by the solid line in (a); in the second switching state, Fig.26 The curve of the wave path corresponding to the third echo signal shown in (c) of FIG. 10 changes with time is as follows: Fig. 27 As shown by the dotted line in (c); Fig.26 The curve of the wave path corresponding to the fourth echo signal shown in (d) of FIG. 10 changes with time is as follows: Fig. 27 As shown by the solid line in (c).
[0205] Accordingly, when the gesture is moving from top to bottom, in the first switching state, Fig.26 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig. 27 As shown by the dotted line in (b); Fig.26 The curve of the wave path corresponding to the second echo signal shown in (b) of FIG. 10 changes with time is as follows: Fig. 27 As shown by the solid line in (b); in the second switching state, Fig.26 The curve of the wave path corresponding to the third echo signal shown in (c) of FIG. 10 changes with time is as follows: Fig. 27 As shown by the dotted line in (d); Fig.26 The curve of the wave path corresponding to the fourth echo signal shown in (d) of FIG. 10 changes with time is as follows: Fig. 27As shown by the solid line in (d).
[0206] Depend on Fig. 27 From (a) in FIG. 1 , it can be seen that when the gesture is moving from bottom to top, in the first switching state, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value.
[0207] Depend on Fig. 27 From (c) in FIG. 1 , it can be seen that when the gesture is moving from bottom to top, in the second switching state, at the third target time t3, the first receiving antenna R x1 The wave path corresponding to the received third echo signal has a minimum value; at the fourth target time t4, the second receiving antenna R x2 The wave path corresponding to the fourth received echo signal has a minimum value.
[0208] Depend on Fig. 27 From (b) in FIG. 1 , it can be seen that when the gesture is moving from top to bottom, in the first switching state, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value.
[0209] Depend on Fig. 27 From (d) in FIG. 1 , it can be known that when the gesture is moving from top to bottom, in the second switching state, at the third target time t3, the first receiving antenna R x1 The wave path corresponding to the received third echo signal has a minimum value; at the fourth target time t4, the second receiving antenna R x2 The wave path corresponding to the fourth received echo signal has a minimum value.
[0210] Therefore, the gesture recognition device can determine the gesture in the following different situations.
[0211] Case 2-1: When in the first switching state, the first target moment t1 is later than the second target moment t2, and in the second switching state, the third target moment t3 is the same as the fourth target moment t4, or the difference between the third target moment t3 and the fourth target moment t4 is less than the time threshold, the gesture recognition device can determine that the movement trajectory of the gesture is from bottom to top.
[0212] Further, in another embodiment of the present application, when in the first switching state, the first target moment t1 is later than the second target moment t2, and the difference between the first target moment t1 and the second target moment t2 is greater than the time threshold, and in the second switching state, the third target moment t3 is the same as the fourth target moment t4, or the difference between the third target moment t3 and the fourth target moment t4 is less than the time threshold, the gesture recognition device can determine that the movement trajectory of the gesture is from bottom to top.
[0213] Case 2-2: When in the first switching state, the first target moment t1 is earlier than the second target moment t2, and in the second switching state, the third target moment t3 is the same as the fourth target moment t4, or the difference between the third target moment t3 and the fourth target moment t4 is less than the time threshold, the gesture recognition device can determine that the movement trajectory of the gesture is from top to bottom.
[0214] Further, in another embodiment of the present application, when in the first switching state, the first target moment t1 is earlier than the second target moment t2, and the difference between the second target moment t2 and the first target moment t1 is greater than the time threshold, and in the second switching state, the third target moment t3 is the same as the fourth target moment t4, or the difference between the third target moment t3 and the fourth target moment t4 is less than the time threshold, the gesture recognition device can determine that the movement trajectory of the gesture is from top to bottom.
[0215] In a possible implementation, when the gesture is Fig.19 When the high-low movement (not distinguishing from high to low or from high to low and then to high) is shown, in the first switching state, the first receiving antenna (R x1 ) The wave path diagram corresponding to the first echo signal received is as follows Fig.28 As shown in (a), the second receiving antenna (R x2 ) The wave path diagram corresponding to the second echo signal received is as follows Fig.28 As shown in (b); in the second switching state, the first receiving antenna (R x1 ) The wave path diagram corresponding to the third echo signal received is as follows Fig.28 As shown in (c), the second receiving antenna (R x2 ) The wave path diagram corresponding to the fourth echo signal received is as follows Fig.28 As shown in (d), where Fig.28 The black origins in (a), (b), (c) and (d) schematically illustrate the movement trajectory of the gesture at different moments.
[0216] Accordingly, when the gesture moves from high to low, in the first switching state, Fig.28The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.29 As shown by the dotted line in (a); Fig.28 The curve of the wave path corresponding to the second echo signal shown in (b) of FIG. 10 changes with time is as follows: Fig.29 As shown by the solid line in (a); in the second switching state, Fig.28 The curve of the wave path corresponding to the third echo signal shown in (c) of FIG. 10 changes with time is as follows: Fig.29 As shown by the dotted line in (c); Fig.28 The curve of the wave path corresponding to the fourth echo signal shown in (d) of FIG. 10 changes with time is as follows: Fig.29 As shown by the solid line in (c).
[0217] Correspondingly, when the gesture moves from high to low and then to high, in the first switching state, Fig.28 The curve of the wave path corresponding to the first echo signal shown in (a) of FIG. 10 changes with time is as follows: Fig.29 As shown by the dotted line in (b); Fig.28 The curve of the wave path corresponding to the second echo signal shown in (b) of FIG. 10 changes with time is as follows: Fig.29 As shown by the solid line in (b); in the second switching state, Fig.28 The curve of the wave path corresponding to the third echo signal shown in (c) of FIG. 10 changes with time is as follows: Fig.29 As shown by the dotted line in (d); Fig.28 The curve of the wave path corresponding to the fourth echo signal shown in (d) of FIG. 10 changes with time is as follows: Fig.29 As shown by the solid line in (d).
[0218] Depend on Fig.29 From (a) in FIG. 1 , it can be seen that when the gesture is moving from high to low, in the first switching state, at the first target time t1, the first receiving antenna R x1 The wavelength corresponding to the received first echo signal is smaller than the preset first wavelength threshold, and the first receiving antenna R x1 The wave path corresponding to the received first echo signal decreases monotonically with time; at the second target time t2, the second receiving antenna R x2 The wavelength corresponding to the received second echo signal is smaller than the preset second wavelength threshold, and the second receiving antenna R x2 The wave path corresponding to the received second echo signal decreases monotonically over time.
[0219] Depend on Fig.29 From (c) in FIG. 1 , it can be seen that when the gesture is moving from high to low, in the second switching state, at the third target time t3, the first receiving antenna R x1The wavelength corresponding to the received third echo signal is smaller than the first wavelength threshold, and the first receiving antenna R x1 The wave path corresponding to the received third echo signal decreases monotonically with time; at the fourth target time t4, the second receiving antenna R x2 The wavelength corresponding to the received fourth echo signal is smaller than the second wavelength threshold, and the second receiving antenna R x2 The wave path corresponding to the received fourth echo signal decreases monotonically over time.
[0220] Depend on Fig.29 From (b) in FIG. 1 , it can be seen that when the gesture moves from high to low and then to high, in the first switching state, at the first target time t1, the first receiving antenna R x1 The wave path corresponding to the received first echo signal has a minimum value, and the first receiving antenna R x1 The wave path corresponding to the received first echo signal first decreases monotonically and then increases monotonically with time; at the second target time t2, the second receiving antenna R x2 The wave path corresponding to the received second echo signal has a minimum value, and the second receiving antenna R x2 The wave path corresponding to the received second echo signal first decreases monotonically and then increases monotonically over time.
[0221] Depend on Fig.29 From (d) in FIG. 1 , it can be known that when the gesture moves from high to low and then to high, in the second switching state, at the third target time t3, the first receiving antenna R x1 The wave path corresponding to the received third echo signal has a minimum value, and the first receiving antenna R x1 The wave path corresponding to the received third echo signal first decreases monotonically and then increases monotonically with time; at the fourth target time t4, the second receiving antenna R x2 The wave path corresponding to the received fourth echo signal has a minimum value, and the second receiving antenna R x2 The wave path corresponding to the received fourth echo signal first decreases monotonically and then increases monotonically over time.
[0222] Therefore, the gesture recognition device can determine the gesture in the following different situations.
[0223] Case 3-1: When in the first switching state, the first target moment t1 is the same as the second target moment t2, or the difference between the first target moment t1 and the second target moment t2 is less than the time threshold, and in the second switching state, the third target moment t3 is the same as the fourth target moment t4, or the difference between the third target moment t3 and the fourth target moment t4 is less than the time threshold, and in the first switching state and the second switching state, the range corresponding to the first echo signal and the range corresponding to the second echo signal both decrease monotonically with time, the gesture recognition device can determine that the movement trajectory of the gesture is from high to low.
[0224] Case 3-2: When in the first switching state, the first target moment t1 is the same as the second target moment t2, or the difference between the first target moment t1 and the second target moment t2 is less than the time threshold, and in the second switching state, the third target moment t3 is the same as the fourth target moment t4, or the difference between the third target moment t3 and the fourth target moment t4 is less than the time threshold, and in the first switching state and the second switching state, the range corresponding to the first echo signal and the range corresponding to the second echo signal first decrease monotonically and then increase monotonically with time, the gesture recognition device can determine that the movement trajectory of the gesture is from high to low and then to high.
[0225] In the above example, in the first switching state, the first antenna, the second antenna and the third antenna of the terminal are as follows: Fig.11 In the antenna mode setting of one transmit and two receive shown in FIG. 1 , in the second switching state, the first antenna, the second antenna and the third antenna of the terminal are configured as follows: Fig.23 The antenna mode setting of one transmit and two receive is used as an example to introduce the process of the gesture recognition device determining the gesture, but the embodiments of the present application are not limited thereto. In the embodiments of the present application, the process of the gesture recognition device determining the gesture changes with the change of the antenna mode and / or antenna position setting method, but the basic principle is similar.
[0226] Optionally, the gestures that can be recognized by the gesture recognition method provided in the embodiment of the present application may also include deformations or combinations of the above-mentioned various movements, which is not limited in the embodiment of the present application.
[0227] For example, if the gestures that the gesture recognition device can recognize include rightward movement, then other gestures similar to rightward movement can also be determined as rightward movement, such as Fig.30 As shown in (a), the movement is from the lower left to the upper right, from the upper left to the lower right, from the left to the right in an arc shape, from the left to the right in a wave shape, from the left to the right in a zigzag shape, first upward and then rightward, or first downward and then rightward, etc.
[0228] For another example, if the gestures that the gesture recognition device can recognize include leftward movement, other gestures similar to leftward movement can also be determined as leftward movement, such as Fig.30 As shown in (b) above, the movement may be from the upper right to the lower left, from the lower right to the upper left, from the right to the left in an arc shape, from the right to the left in a wave shape, from the right to the left in a zigzag shape, first upward and then to the left, or first downward and then to the left, etc.
[0229] Similarly, if the gestures that the gesture recognition device can recognize are defined to include downward movement and upward movement, other gestures similar to those from top to bottom can also be determined as downward movement, and other gestures similar to those from bottom to top can also be determined as upward movement. The specific other gestures are similar to the above-mentioned other gestures similar to those from left to right, or similar to those from right to left, and the embodiments of the present application will not go into details about this.
[0230] For example: Recognizable gestures may also include: Fig.31 A combination of various movements such as S-type and O-type shown.
[0231] Using the gesture recognition method provided in the embodiment of the present application, the terminal is configured with a transmitting antenna (such as a first antenna) and at least two receiving antennas (such as a second antenna and a third antenna) that are not collinearly positioned, and a radar electromagnetic signal is transmitted to a gesture recognition area through the transmitting antenna, and an echo signal generated by the reflection of the radar electromagnetic signal by the gesture in the gesture recognition area is received simultaneously through the two receiving antennas, and a curve of the change of the path between the signal transmitting antenna and different receiving antennas over time due to the movement of the gesture is extracted from the echo signals received by the two receiving antennas, and the gesture is determined according to the order of the moments when the path in the curve of each receiving antenna has a minimum value.
[0232] It should also be noted that when the terminal only includes the first antenna and the second antenna, and the first antenna and the second antenna are set to a one-transmit-one-receive antenna mode (such as the first antenna is a transmitting antenna and the second antenna is a receiving antenna), the gesture recognition device can refer to principles similar to the above-mentioned one-transmit-two-receive antenna mode to realize the recognition of whether there is a gesture in the gesture recognition area, that is, when it can detect that the wave path corresponding to the echo signal of the second antenna has changed, it can recognize that there is a gesture in the gesture recognition area.
[0233] Compared with the prior art, which requires the pre-collection of a large amount of antenna signal data for model training, and the need to extract features from the collected antenna signal data during gesture recognition, which requires a large amount of calculation and has high computational complexity, the gesture recognition method provided in the embodiment of the present application can effectively distinguish gestures based only on the change of the Doppler phase shift of the echo signal over time, thereby reducing the complexity of gesture recognition.
[0234] Combined with the above Figures 2 to 31The present invention provides a gesture recognition method 200. Figure 32 to Figure 33 A gesture recognition device for executing the above method 200 is introduced.
[0235] It should be noted that the gesture recognition device may be the gesture recognition device described in the embodiment of the method 200 described above, and may be capable of executing the method implemented by the gesture recognition device in the method 200 described above.
[0236] It is understandable that, in order to realize the above functions, the gesture recognition device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the present application.
[0237] In this embodiment, the functional modules of the gesture recognition device can be divided according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0238] In the case of dividing each functional module into corresponding functional modules, Fig.32 A possible schematic diagram of the composition of the gesture recognition device involved in the above embodiment is shown. Fig.32 As shown, the gesture recognition device 300 may include: a communication unit 310 and a processing unit 320 .
[0239] The processing unit 320 may control at least two antennas through the communication unit 310 to implement the above method 200 embodiment and / or other processes for the technology described herein.
[0240] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.
[0241] In the case of using integrated units, the gesture recognition device 300 may include a processing unit, a storage unit and a communication unit. The processing unit may be used to control and manage the actions of the gesture recognition device 300, for example, it may be used to support the gesture recognition device 300 to execute the steps performed by the above-mentioned various units. The storage unit may be used to support the gesture recognition device 300 to execute stored program codes and data, etc. The communication unit may be used to control the transmitting antenna to transmit the radar electromagnetic signal, and control the receiving antenna to receive the echo signal of the radar electromagnetic signal.
[0242] Among them, the processing unit can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, and so on. The storage unit can be a memory. The communication unit can specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.
[0243] In a possible implementation, the gesture recognition device involved in the embodiment of the present application may be a device having Fig.33 The device 400 of the structure shown includes a processor 410 and a communication interface 420. The processor 410 and the communication interface 420 communicate with each other through an internal connection path. Fig.32 The related functions implemented by the processing unit 320 in the embodiment can be implemented by the processor 410, and the related functions implemented by the communication unit 310 can be implemented by the processor 410 controlling at least two antennas through the communication interface 420.
[0244] Optionally, the device 400 may further include a memory 430, and the processor 410, the communication interface 420 and the memory 430 communicate with each other through an internal connection path. Fig.32 The related functions implemented by the storage unit described in the above can be implemented by the memory 430.
[0245] An embodiment of the present application further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the gesture recognition method in the above-mentioned embodiment.
[0246] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the gesture recognition method in the above-mentioned embodiment.
[0247] The embodiment of the present application also provides a device, which can be a chip, an integrated circuit, a component or a module. Specifically, the device may include a connected processor and a memory for storing instructions, or the device includes at least one processor for obtaining instructions from an external memory. When the device is running, the processor can execute instructions so that the chip executes the gesture recognition method in the above-mentioned method embodiments.
[0248] Fig.34 Schematic diagram of the structure of a chip 500 is shown. The chip 500 includes one or more processors 510 and an interface circuit 520. Optionally, the chip 500 may also include a bus 530.
[0249] The processor 510 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method 200 may be completed by an integrated logic circuit of hardware in the processor 510 or by instructions in the form of software.
[0250] Optionally, the processor 510 may be a general purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The methods and steps disclosed in the embodiments of the present application may be implemented or executed. The general purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
[0251] The interface circuit 520 can be used to send or receive data, instructions or information. The processor 510 can use the data, instructions or other information received by the interface circuit 520 to process, and can send the processing completion information through the interface circuit 520.
[0252] Optionally, the chip also includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory (NVRAM).
[0253] Optionally, the memory stores executable software modules or data structures, and the processor can perform corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in the operating system).
[0254] Optionally, the chip can be used in a gesture recognition device or terminal involved in an embodiment of the present application. Optionally, the interface circuit 520 can be used to output the execution result of the processor 510. The gesture recognition method provided by one or more embodiments of the present application can refer to the aforementioned embodiments, which will not be repeated here.
[0255] It should be noted that the functions corresponding to the processor 510 and the interface circuit 520 can be implemented through hardware design, software design, or a combination of hardware and software, which is not limited here.
[0256] The embodiment of the present application also provides a terminal, which may include at least two antennas and the above Fig.32 The device 300 described in Fig.33 The device 400 or Fig.34 The device 500 described in.
[0257] Among them, the gesture recognition device, terminal, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0258] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0259] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0260] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0261] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0262] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0263] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0264] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0265] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A gesture recognition method, characterized in that: include: Sending a first radar electromagnetic signal to the gesture recognition area through the first antenna, wherein the first radar electromagnetic signal is a single-frequency continuous wave or a single-frequency discontinuous wave; receiving, through a second antenna, a first echo signal obtained after the first radar electromagnetic signal is reflected by a gesture in the gesture recognition area; receiving, by a third antenna, a second echo signal obtained after the first radar electromagnetic signal is reflected by the gesture in the gesture recognition area; Determine a first target time of the second antenna according to the first echo signal, where at the first target time, a range corresponding to the first echo signal is less than a preset first range threshold; Determine a second target time of the third antenna according to the second echo signal, wherein at the second target time, a range corresponding to the second echo signal is less than a preset second range threshold; determining the gesture according to the first target time and the second target time; The first antenna, the second antenna and the third antenna are not collinear, and the gesture recognition area is located above the first antenna, the second antenna and the third antenna.
2. The method according to claim 1, characterized in that At the first target moment, the wave path corresponding to the first echo signal has a minimum value; at the second target moment, the wave path corresponding to the second echo signal has a minimum value.
3. The method according to claim 1, characterized in that The determining the gesture according to the first target time and the second target time includes: The gesture is determined according to the first target time, the second target time, the position of the first antenna, the position of the second antenna, and the position of the third antenna.
4. The method according to any one of claims 1 to 3, characterized in that The first target time is determined based on first range data of the range corresponding to the first echo signal varying with time; the second target time is determined based on second range data of the range corresponding to the second echo signal varying with time.
5. The method according to claim 4, characterized in that The first wave path data is determined based on at least one of a phase difference, a time difference or a distance difference of the first echo signal; the second wave path data is determined based on at least one of a phase difference, a time difference or a distance difference of the second echo signal.
6. The method according to any one of claims 1 to 3 and 5, characterized in that: The first radar electromagnetic signal is sent through the first antenna at at least one preset first moment, and the method further includes: At at least one preset second moment, transmitting a second radar electromagnetic signal to the gesture recognition area through the second antenna; receiving, by the first antenna, a third echo signal obtained by reflecting the second radar electromagnetic signal through the gesture in the gesture recognition area; receiving, by the third antenna, a fourth echo signal obtained after the second radar electromagnetic signal is reflected by the gesture in the gesture recognition area; Determine a third target time of the first antenna according to the third echo signal, where at the third target time, a range corresponding to the third echo signal is less than a preset third range threshold; Determine a fourth target time of the third antenna according to the fourth echo signal, wherein at the fourth target time, a range corresponding to the fourth echo signal is less than a preset fourth range threshold; The determining the gesture according to the first target time and the second target time includes: The gesture is determined according to the first target time, the second target time, the third target time, and the fourth target time.
7. The method according to claim 6, characterized in that The at least one first time point and the at least one second time point are arranged at intervals.
8. A gesture recognition device, characterized in that: It includes a first communication interface, a second communication interface, a third communication interface and a processor, wherein the first communication interface, the second communication interface and the processor are coupled; The first communication interface is used to send a first radar electromagnetic signal to the gesture recognition area through the first antenna, and the first radar electromagnetic signal is a single-frequency continuous wave or a single-frequency discontinuous wave; The second communication interface is used to receive, through the second antenna, a first echo signal obtained after the first radar electromagnetic signal is reflected by the gesture in the gesture recognition area; The third communication interface is used to receive, through a third antenna, a second echo signal obtained after the first radar electromagnetic signal is reflected by the gesture; The processor is used to determine a first target time of the second antenna according to the first echo signal, and at the first target time, a range corresponding to the first echo signal is less than a preset first range threshold; Determine a second target time of the third antenna according to the second echo signal, wherein at the second target time, a range corresponding to the second echo signal is less than a preset second range threshold; determine the gesture according to the first target time and the second target time; The first antenna, the second antenna and the third antenna are not collinear, and the gesture recognition area is located above the first antenna, the second antenna and the third antenna.
9. The device according to claim 8, characterized in that At the first target moment, the wave path corresponding to the first echo signal has a minimum value; at the second target moment, the wave path corresponding to the second echo signal has a minimum value.
10. The device according to claim 8, characterized in that The processor is specifically used for: The gesture is determined according to the first target time, the second target time, the position of the first antenna, the position of the second antenna, and the position of the third antenna.
11. The device according to any one of claims 8 to 10, characterized in that The first target time is determined based on first range data of the range corresponding to the first echo signal varying with time; the second target time is determined based on second range data of the range corresponding to the second echo signal varying with time.
12. The device according to claim 11, characterized in that The first wave path data is determined based on at least one of a phase difference, a time difference or a distance difference of the first echo signal; the second wave path data is determined based on at least one of a phase difference, a time difference or a distance difference of the second echo signal.
13. The device according to any one of claims 8 to 10 and 12, characterized in that The first radar electromagnetic signal is sent through the first antenna at at least one preset first moment; The second communication interface is further used to transmit a second radar electromagnetic signal to the gesture recognition area through the second antenna at at least one preset second moment; The first communication interface is further used to receive, through the first antenna, a third echo signal obtained after the second radar electromagnetic signal is reflected by the gesture in the gesture recognition area; The third communication interface is further used to receive, through the third antenna, a fourth echo signal obtained after the second radar electromagnetic signal is reflected by the gesture in the gesture recognition area; The processor is also used to determine a third target moment of the first antenna based on the third echo signal, at which the range corresponding to the third echo signal is less than a preset third range threshold; determine a fourth target moment of the third antenna based on the fourth echo signal, at which the range corresponding to the fourth echo signal is less than a preset fourth range threshold; and determine the gesture based on the first target moment, the second target moment, the third target moment and the fourth target moment.
14. The device according to claim 13, characterized in that The at least one first time point and the at least one second time point are arranged at intervals.
15. A terminal, characterized in that: The invention comprises a first antenna, a second antenna, a third antenna and a gesture recognition device according to any one of claims 8 to 14, wherein the first antenna, the second antenna and the third antenna are respectively connected to the gesture recognition device, and the first antenna, the second antenna and the third antenna are not colinear.
16. A chip device, comprising at least one processor and an interface circuit, wherein the interface circuit is used to provide the at least one processor with data, instructions or information transmission or reception, characterized in that: When the at least one processor executes the program code or instruction, the method according to any one of claims 1 to 7 is implemented.
17. A computer-readable storage medium for storing a computer program, characterized in that: The computer program comprises instructions for implementing the method of any one of claims 1 to 7.
18. A computer program product, comprising instructions, characterized in that: When the instructions are executed on a computer or a processor, the computer or the processor is enabled to implement the method according to any one of claims 1 to 7.
