Method for recognizing gestures for operating terminal equipment and terminal equipment

By setting up multiple sets of sensing modules on terminal devices and using millimeter wave perception technology to identify two-hand gestures, the problem of double-hand gesture recognition in terminal devices such as mobile phones is solved, and the two-hand recognition and joint operation in game scenes is realized, improving user experience and recognition Accuracy.

CN113574496BActive Publication Date: 2024-11-05GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980094034.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-07-12
Publication Date
2024-11-05
Estimated Expiration
2039-07-12

AI Technical Summary

Technical Problem

The prior art is difficult to realize the tracking and recognition of two-hand gestures in terminal devices such as mobile phones, especially in game scenarios, but it is not possible to effectively solve this problem.

Method used

By setting at least two sets of sensing modules on the terminal device, it is used to sense electromagnetic wave signals affected by left-hand and right-hand gestures, and using millimeter wave perception technology to recognize gestures, realizing the recognition of two-hand gestures.

Benefits of technology

It realizes accurate recognition of two-hand gestures on terminal devices, supports two-hand recognition and joint operation in game scenes, improves user experience, and recognizes actions without a screen, with a wide recognition range and is almost immune to light and heat radiation sources.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113574496B_ABST
    Figure CN113574496B_ABST
Patent Text Reader

Abstract

The embodiments of the present application relate to a method and a terminal device for identifying gestures for operating a terminal device. The terminal device comprises: a first group of sensing modules, for acquiring a first electromagnetic wave signal after being affected by a left-hand gesture by sensing the waveform of an electromagnetic wave; a second group of sensing modules, for acquiring a second electromagnetic wave signal after being affected by a right-hand gesture by sensing the waveform of an electromagnetic wave, the second group of sensing modules and the first group of sensing modules being located at opposite ends of the terminal device respectively; at least one recognition processing module, for identifying the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal; an application layer, for receiving the left-hand gesture and the right-hand gesture, and performing operations corresponding to the left-hand gesture and the right-hand gesture. The method and the terminal device for identifying gestures for operating a terminal device according to the embodiments of the present application can realize two-hand gesture recognition.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of gesture recognition, and in particular to a method and a terminal device for recognizing gestures for operating a terminal device. Background Art

[0002] Existing industry research shows that the way humans interact with machines is undergoing unprecedented change. From the earliest human-machine interaction methods, which included handles and buttons, and mice and keyboards, to the now ubiquitous touch screens, the way humans interact with machines is undergoing unprecedented changes.

[0003] The industry is currently researching airborne sensing, which includes various technologies such as millimeter wave sensing, ultra-wideband (UWB) sensing, and camera sensing. Electromagnetic wave sensing, such as millimeter wave sensing, is a key research direction. It offers advantages such as no need for line-of-sight and strong penetration capabilities.

[0004] In addition, electromagnetic waves can also significantly increase the speed of wireless networks, especially millimeter waves, which may be used in the next generation of wireless communication technology. For example, the Institute of Electrical and Electronics Engineers (IEEE) 802.11ad operating in the 60GHz frequency band supports data transmission rates of up to 6.7Gbps, and its evolution standard IEEE 802.11ay will provide a data transmission rate of 20Gbps. Therefore, millimeter wave radio is expected to bring wireless network access into the era of multi-switch bandwidth (multi-Gbps). Therefore, in the foreseeable future, millimeter wave radio modules will be widely installed in mobile phones, wearables, smart hardware or a wider range of IoT devices, becoming a mainstream communication technology.

[0005] For example, micro-radars can be used to monitor mid-air gestures. These specially designed radar sensors utilize millimeter-wave technology, enabling the tracking of high-speed movements with submillimeter accuracy. However, current technology lacks specifics on how to integrate these sensors with mobile devices, particularly mobile gaming, which often requires dual-gesture tracking and recognition. Implementing this approach is a pressing challenge. Summary of the Invention

[0006] The embodiments of the present application provide a method and a terminal device for recognizing gestures for operating a terminal device, which can realize two-handed gesture recognition.

[0007] In a first aspect, a terminal device is provided, comprising: a first group of sensing modules, for acquiring a first electromagnetic wave signal after being affected by a left-hand gesture by sensing the waveform of the electromagnetic wave, the first group of sensing modules including at least one sensing module; a second group of sensing modules, for acquiring a second electromagnetic wave signal after being affected by a right-hand gesture by sensing the waveform of the electromagnetic wave, the second group of sensing modules including at least one sensing module; the second group of sensing modules and the first group of sensing modules are respectively located at opposite ends of the terminal device; at least one recognition and processing module, for identifying the left-hand gesture and the right-hand gesture based on the first electromagnetic wave signal and the second electromagnetic wave signal; and an application layer, for receiving the left-hand gesture and the right-hand gesture identified by the at least one recognition and processing module, and performing operations corresponding to the left-hand gesture and the right-hand gesture.

[0008] In a second aspect, a method for identifying gestures for operating a terminal device is provided, wherein the terminal device includes a first group of sensing modules and a second group of sensing modules, the first group of sensing modules and the second group of sensing modules respectively including at least one sensing module, the second group of sensing modules and the first group of sensing modules respectively being located at opposite ends of the terminal device, the method including: sensing the waveform of the electromagnetic wave by the first group of sensing modules to obtain a first electromagnetic wave signal after being affected by a left-hand gesture; sensing the waveform of the electromagnetic wave by the second group of sensing modules to obtain a second electromagnetic wave signal after being affected by a right-hand gesture; identifying the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal, and performing operations corresponding to the left-hand gesture and the right-hand gesture.

[0009] In a third aspect, a terminal device is provided for executing the method in the second aspect or its respective implementations. Specifically, the terminal device includes a functional module for executing the method in the second aspect or its respective implementations.

[0010] In a fourth aspect, a terminal device is provided, comprising a processor and a memory, wherein the memory is configured to store a computer program, and the processor is configured to call and execute the computer program stored in the memory to perform the method of the second aspect or its respective implementations.

[0011] In a fifth aspect, a chip is provided for implementing the method of the second aspect or its various implementations. Specifically, the chip includes a processor for calling and executing a computer program from a memory, so that a device equipped with the chip executes the method of the second aspect or its various implementations.

[0012] In a sixth aspect, a computer-readable storage medium is provided for storing a computer program, which enables a computer to execute the method in the above-mentioned second aspect or its various implementations.

[0013] In a seventh aspect, a computer program product is provided, comprising computer program instructions, which enable a computer to execute the method in the above-mentioned second aspect or its various implementations.

[0014] In an eighth aspect, a computer program is provided, which, when executed on a computer, enables the computer to execute the method in the second aspect or its various implementations.

[0015] Through the above technical solution, at least two groups of sensing modules are provided on the terminal device, which are respectively used to sense the electromagnetic wave signals that change due to the influence of left-hand gestures and the electromagnetic wave signals that change due to the influence of right-hand gestures. For example, four sensing modules can be set on the four sides or four corners of the terminal device. In this way, no matter whether the terminal device is in a horizontal screen or a vertical screen, there will be corresponding sensing modules for obtaining the electromagnetic wave signals after being affected by left-hand gestures and right-hand gestures, and performing gesture recognition through the recognition processing module, thereby realizing the recognition of two-hand gestures, that is, realizing two-hand recognition and joint operation in game scenes. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a schematic block diagram of a terminal device provided in an embodiment of the present application.

[0017] Figure 2 This is a schematic diagram of a user using a horizontal screen terminal device provided in an embodiment of the present application.

[0018] Figure 3 This is a schematic block diagram of a terminal device provided with two identification processing modules according to an embodiment of the present application.

[0019] Figure 4 This is a schematic block diagram of a terminal device provided with an identification processing module according to an embodiment of the present application.

[0020] Figure 5 This is a schematic diagram of setting sensing modules on the four sides of a horizontal screen terminal device provided in an embodiment of the present application.

[0021] Figure 6 This is a schematic diagram of setting sensing modules on the four sides of a vertical screen terminal device provided in an embodiment of the present application.

[0022] Figure 7 This is a schematic diagram of setting sensing modules on the four corners of a horizontal screen terminal device provided in an embodiment of the present application.

[0023] Figure 8 This is a schematic diagram of setting sensing modules on the four corners of a vertical screen terminal device provided in an embodiment of the present application.

[0024] Figure 9This is another schematic block diagram of a terminal device provided in an embodiment of the present application with two identification processing modules.

[0025] Figure 10 This is another schematic block diagram of a terminal device provided with two identification processing modules according to an embodiment of the present application.

[0026] Figure 11 This is another schematic block diagram of a terminal device provided with an identification processing module according to an embodiment of the present application.

[0027] Figure 12 This is a schematic flowchart of a method for identifying gestures for operating a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will describe the technical solutions in the embodiments of this application in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0029] The embodiments of this application primarily involve millimeter wave sensing technology, which offers unique advantages and can provide a smarter, more convenient, and more engaging product experience. It can recognize actions without a screen, has a wider recognition range, is virtually unaffected by light and thermal radiation, and can measure true distance. It performs well in distance perception, gesture detection, proximity detection, occupancy detection, distance measurement, and presence detection.

[0030] Due to the accurate distance perception of millimeter waves, we can accurately obtain the angle of arrival (AoA) and distance (range) of the target object to the chip. After processing background noise and sudden abnormal noise points, we can calculate the position of the target object on the two-dimensional plane, thereby achieving positioning and tracking.

[0031] In terms of gesture recognition, we found that whenever people make the same gesture, the movement trends of their hands have their own commonalities, so this makes it possible for millimeter wave recognition technology to recognize the same action of different users.

[0032] For example, the detection of target objects equipped with Radio Frequency Identification (RFID) tags can now achieve centimeter-level positioning, using interferometry. This technology measures the relative phases of multiple RFID receivers to generate a phase hologram. The potential position of the object can be mapped to the phase, and positioning and tracking can be achieved through phase changes. However, since this solution requires the RFID tag to be attached to the object being detected, its application scenarios are relatively cumbersome and cannot meet the requirements of daily use.

[0033] Another example is the use of micro-radars to monitor mid-air gestures. These specially designed radar sensors utilize millimeter-wave technology, enabling the tracking of high-speed movements with submillimeter accuracy. However, current technology lacks specific information on how to integrate these sensors with mobile devices. This is particularly true for mobile gaming, which often requires dual-gesture tracking and recognition. Implementing this is a pressing challenge.

[0034] Therefore, an embodiment of the present application proposes a terminal device that can realize dual-gesture recognition by reasonably setting an electromagnetic wave sensing module.

[0035] Figure 1 This is a schematic flow chart of a terminal device 100 provided in an embodiment of the present application. Figure 1 As shown, the terminal device 100 includes: a first group of sensing modules 110 , a second group of sensing modules 120 , at least one identification processing module 130 , and an application layer 140 .

[0036] The first group of sensing modules 110 is configured to obtain a first electromagnetic wave signal affected by a left-hand gesture by sensing the waveform of the electromagnetic wave; and the second group of sensing modules 120 is configured to obtain a second electromagnetic wave signal affected by a right-hand gesture by sensing the waveform of the electromagnetic wave. Specifically, the first group of sensing modules 110 may include at least one sensing module, and the number of the first group of sensing modules 110 in the terminal device 100 may be one or more groups; the second group of sensing modules 120 may also include at least one sensing module, and the number of the second group of sensing modules 110 in the terminal device 100 may also be one or more groups.

[0037] It should be understood that the sensing module in the embodiment of the present application can be an electromagnetic wave sensor, or a radio frequency chip, for sensing electromagnetic wave signals, that is, each sensing module in the first group of sensing modules 110 and the second group of sensing modules 120 can implement an electromagnetic wave sensing function. For example, the sensing module can be a millimeter wave sensing module for sensing millimeter waves. Specifically, the sensing module included in the terminal device 100 can also be used to send electromagnetic wave signals, that is, any sensing module in the first group of sensing modules 110 and the second group of sensing modules 120 can be used to send electromagnetic wave signals and sense changes in electromagnetic wave signals. The sensing module sends electromagnetic wave signals. When there is no gesture, the sensing module may not sense the electromagnetic wave signal it sends, or the electromagnetic wave signal sensed by the sensing module may be similar to the electromagnetic wave signal it sends. When a gesture is present, the electromagnetic wave signal emitted will change due to the influence of the gesture. The sensing module obtains the electromagnetic wave signal affected by the gesture by sensing the change in the waveform of the electromagnetic wave. For example, in the embodiment of the present application, the sensing module obtains the electromagnetic wave signal after being affected by the gesture, which means that for the initial electromagnetic wave signal emitted, the sensing module can sense the change of the initial electromagnetic wave signal caused by the gesture and obtain the electromagnetic wave signal with the change.

[0038] For example, when a gesture is made with the left hand, the electromagnetic wave signals emitted by the sensing modules in the first group of sensing modules 110 change in waveform due to the influence of the gesture. The first group of sensing modules 110 senses this change and obtains the electromagnetic wave signal that changes due to the influence of the left hand gesture as the first electromagnetic wave signal. For another example, when a gesture is made with the right hand, the electromagnetic wave signals emitted by the sensing modules in the second group of sensing modules 120 change in waveform due to the influence of the gesture. The second group of sensing modules 120 senses this change and obtains the electromagnetic wave signal that changes due to the influence of the right hand gesture as the second electromagnetic wave signal.

[0039] It should be understood that the sensing module of the embodiment of the present application can be used to send electromagnetic wave signals. The sensing module may be independent of the transmission module for data transmission in the terminal device 100, or the two may be the same module. Specifically, if any sensing module in the embodiment of the present application reuses the transmission module for business data transmission in the terminal device 100, that is, the sensing module and the transmission module belong to the same module, then the transmission module or the sensing module does not send and obtain electromagnetic wave signals for gesture recognition when there is business data transmission, but only sends electromagnetic wave signals when there is no necessary business data transmission, and obtains electromagnetic wave signals that change due to the influence of gestures for gesture recognition. Alternatively, if the change in the electromagnetic wave signal caused by the sensing module sensing the gesture conflicts with the transmission of business data by the transmission module, the corresponding business data transmission moment can be left blank for gesture recognition.

[0040] For example, any one of the sensing modules in the terminal device 100 can be used to obtain changes in electromagnetic wave signals caused by left-hand gestures and / or right-hand gestures at a first time. Specifically, the first group of sensing modules 110 can be used to send a third electromagnetic wave signal at a first time, the third electromagnetic wave signal being used to obtain the first electromagnetic wave signal, i.e., the third electromagnetic wave signal being used as a detection signal. When a gesture is affected, the third electromagnetic wave signal changes, and the electromagnetic wave signal obtained by the first group of sensing modules 110 after the change is the first electromagnetic wave signal. Similarly, the second group of sensing modules 120 can be used to send a fourth electromagnetic wave signal at the first time, the fourth electromagnetic wave signal being used to obtain the second electromagnetic wave signal, i.e., the fourth electromagnetic wave signal can also be used as a detection signal. When a gesture is affected, the fourth electromagnetic wave signal changes, and the electromagnetic wave signal obtained by the second group of sensing modules 120 after the change is the second electromagnetic wave signal. Optionally, any one of the sensing modules in the terminal device 100 can also be used to transmit service data at a second time, wherein the first time and the second time do not overlap. This allows the sensing module to both transmit business data and sense changes in electromagnetic wave signals for gesture recognition, without conflict or interference between the two.

[0041] On the contrary, if the transmission module used for business data transmission and the sensing module used for gesture recognition do not belong to the same module, a corresponding interface is required to transmit the electromagnetic wave signal required for gesture recognition to the transmission module; or the time when the transmission module transmits data is transmitted to the sensing module used for the gesture recognition process through the corresponding interface, so as to ensure that the sensing module only sends electromagnetic wave signals for gesture recognition when there is no need for data transmission, thereby avoiding interference between the two; if the two conflict, the corresponding data transmission time can be left blank.

[0042] For example, any one of the sensing modules in the terminal device 100 can be used to obtain changes in electromagnetic wave signals caused by left-hand gestures and / or right-hand gestures at a first time. Specifically, the first group of sensing modules 110 can be used to send a third electromagnetic wave signal at a first time, and the third electromagnetic wave signal is used to obtain the first electromagnetic wave signal; similarly, the second group of sensing modules 120 can be used to send a fourth electromagnetic wave signal at the first time, and the fourth electromagnetic wave signal is used to obtain the second electromagnetic wave signal. The transmission module in the terminal device 100 is used to transmit business data at a second time, and the first time and the second time do not overlap. The transmission module can send the second time to the sensing module so that the sensing module can determine the first time based on the second time.

[0043] Optionally, when the first group of sensing modules 110 or the second group of sensing modules 120 includes multiple sensing modules, each sensing module may work individually or in combination, but the embodiment of the present application is not limited thereto.

[0044] It should be understood that the second group of sensing modules 110 and the first group of sensing modules 120 in the terminal device 100 are respectively located at opposite ends of the terminal device 100. Alternatively, if the terminal device 100 is a square with equal sides, the first group of sensing modules 110 and the second group of sensing modules 120 can be set at any two opposite ends of the terminal device 100.

[0045] However, if Figure 2 As shown, assuming that the terminal device 100 is a mobile phone, the terminal device 100 is generally rectangular, that is, a non-square rectangle; in addition, considering several common application scenarios of mobile phones, such as game scenarios, Figure 2 As shown in the figure, the mobile phone is usually placed horizontally, and the hands usually hold the left and right ends of the phone respectively. Figure 1 As shown, assuming that the terminal device 100 is placed in a horizontal position, the first group of sensing modules 110 and the second group of sensing modules 120 can be respectively located at the left and right ends of the terminal device 100, so as to facilitate the recognition of left and right hand operations. Similarly, assuming that the terminal device 100 is placed in a vertical position, the first group of sensing modules 110 and the second group of sensing modules 120 can also be set at the left and right ends of the terminal device 100 placed in a vertical position, corresponding to the upper and lower ends when the terminal device is placed in a horizontal position. The embodiments of the present application are not limited to this.

[0046] in addition, Figure 1In the example, the first and second groups of sensing modules 110, 120 are rectangular and are positioned in the middle of each end of the terminal device 100. However, the first and second groups of sensing modules 110, 120 may also have other shapes and may be positioned at any location on each end. For example, the first and second groups of sensing modules 110, 120 may include multiple sensing modules, and the multiple sensing modules may be evenly distributed at each end. For example, the multiple sensing modules included in the first group of sensing modules 110 may be evenly or unevenly distributed at several locations from top to bottom across the entire left end of the terminal device 100, and the multiple sensing modules included in the second group of sensing modules 120 may be evenly or unevenly distributed at several locations from top to bottom across the entire right end of the terminal device 100. For another example, considering factors such as sensing effect, the positions of the sensing modules included in the first and second groups of sensing modules 110 may be symmetrical relative to the centerline of the terminal device 100, but embodiments of the present application are not limited to this.

[0047] In the terminal device 100, after the first electromagnetic wave signal is acquired by the first group of sensing modules 110 and the second electromagnetic wave signal is acquired by the second group of sensing modules 120, the at least one recognition processing module 130 can be used to: recognize the left hand gesture and the right hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal. Specifically, the at least one recognition processing module 130 can be located at any position in the terminal device 100. Figure 1 The position shown is only one possibility.

[0048] Optionally, any one of the at least one recognition processing module 130 in the embodiment of the present application may be an independent module, that is, the recognition processing module 130 is configured to be used only for the two-hand gesture recognition process. Alternatively, any one of the recognition processing modules may reuse a processor for other purposes in the terminal device 100, or be located in a processor. For example, the recognition processing module may be located in a modem in the terminal device 100, and the modem may include multiple recognition processing modules.

[0049] It should be understood that the left-hand gestures or right-hand gestures that can be recognized in the embodiments of the present application may include multiple types, for example, at least one of the following: swipe up, swipe down, swipe left, swipe right, single-click, double-click, circle, and multi-point simultaneous single-click. In addition, the left-hand gestures and right-hand gestures in the embodiments of the present application may be the same or different, and may be arbitrarily combined, and the embodiments of the present application are not limited thereto.

[0050] In the terminal device 100, the application layer 140 is used to: receive the left hand gesture and the right hand gesture recognized by the at least one recognition processing module 130, and perform operations corresponding to the left hand gesture and the right hand gesture. Specifically, the application layer 140 can be located at any position in the terminal device 100, Figure 1 The position shown is only one possibility.

[0051] Optionally, the electromagnetic waves in the embodiments of the present application may be millimeter waves, or other electromagnetic waves; correspondingly, the electromagnetic wave signals in the embodiments of the present application may be millimeter wave radio signals, or other electromagnetic wave signals, but the embodiments of the present application are not limited thereto.

[0052] It should be understood that, considering the different signal processing methods and the interaction between the recognition processing module and the application layer, the at least one recognition processing module 130 of the embodiment of the present application can be set to one or more. Figure 3 and Figure 4 , described with one and two recognition processing modules as examples respectively.

[0053] Figure 3 FIG. 1 shows a schematic diagram of setting two recognition processing modules in an embodiment of the present application. Figure 3 As shown, compared Figure 1 The at least one identification processing module 130 of the terminal device 100 includes a first identification processing module 131 and a second identification processing module 132 .

[0054] Specifically, the first recognition processing module 131 is configured to recognize the left-hand gesture based on the first electromagnetic wave signal acquired by the first group of sensing modules 110, and transmit the recognition signal to the application layer 140. The second recognition processing module 132 is configured to recognize the right-hand gesture based on the second electromagnetic wave signal acquired by the second group of sensing modules 120, and transmit the recognition signal to the application layer 140. The application layer 140 is configured to receive and merge the left-hand gesture recognized by the first recognition processing module 131 and the right-hand gesture recognized by the second recognition processing module 132, and perform operations corresponding to the merged left-hand gesture and the right-hand gesture.

[0055] For example, the first recognition processing module 131 recognizes the left hand gesture as an upward slide based on the first electromagnetic wave signal received from the first group of sensing modules 110; the second recognition processing module 132 recognizes the right hand gesture as a slide to the right or forward, that is, a slide from left to right, based on the second electromagnetic wave signal received from the second group of sensing modules 120; and the application layer 140 receives the two gestures of the left hand sliding upward and the right hand sliding right, merges the two gestures, and generates an operation corresponding to the merged gesture. Assuming that the current scene is a game, the two gestures of sliding the left hand upward and sliding the right hand right at the same time represent the operation of the game character jumping from left to right. Then, after receiving the two actions recognized by the first recognition processing module 131 and the second recognition processing module 132, the application layer 140 merges them and determines that the two-hand gesture is to execute a jump from left to right. Then, the application layer 140 can control the terminal device 100 to execute the corresponding operation, that is, to control the corresponding game character to execute a jump from left to right.

[0056] Figure 4 FIG. 1 shows a schematic diagram of an identification processing module in an embodiment of the present application. Figure 4 As shown, compared Figure 1 , the at least one identification processing module 130 of the terminal device 100 may include a third identification processing module 133.

[0057] Specifically, the third recognition processing module 133 is configured to recognize the left-hand gesture based on the first electromagnetic wave signal acquired by the first group of sensing modules 110, and recognize the right-hand gesture based on the second electromagnetic wave signal acquired by the second group of sensing modules 120, then merge the left-hand gesture and the right-hand gesture, and send the merged left-hand gesture and right-hand gesture to the application layer 140. The application layer 140 is configured to receive the merged left-hand gesture and the right-hand gesture by the third recognition processing module 133, and perform an operation corresponding to the merged left-hand gesture and the right-hand gesture.

[0058] For example, the third recognition processing module 133 recognizes the left hand gesture as an upward swipe based on the first electromagnetic wave signal received by the first group of sensing modules 110; and recognizes the right hand gesture as a rightward or forward swipe, that is, a swipe from left to right, based on the second electromagnetic wave signal received by the second group of sensing modules 120. The third recognition processing module 133 merges the two recognized left hand upward swipe and right hand right swipe gestures. Assuming that the current scene is a game, performing the two gestures of the left hand upward swipe and the right hand right swipe simultaneously indicates that the user is operating the game character to jump from left to right. In this case, the third recognition processing module 133 merges the two recognized left hand upward swipe and right hand right swipe gestures to obtain a merged gesture of jumping from left to right. Correspondingly, the application layer 140 receives the merged gesture to perform the corresponding operation. That is, if the application layer 140 receives the merged gesture as jumping from left to right, the application layer 140 can control the terminal device 100 to perform the corresponding operation, that is, to control the corresponding game character to jump from left to right.

[0059] The above describes scenarios in which different numbers of recognition processing modules are configured. Considering that mobile phones and other terminal devices are typically used in both landscape and portrait orientations, it is generally more appropriate to configure the sensing modules at the four sides or corners. This allows the sensing modules to more accurately detect signals from both hands and thus recognize gestures. The following describes the terminal device 100 according to an embodiment of the present application, using examples of different configurations of the sensing modules.

[0060] Optionally, as a first embodiment, considering different hand motion recognition, different sensing modules can be used to complete the recognition respectively. Figure 5 and Figure 6 FIG. 2 shows a schematic diagram of a terminal device 200 according to an embodiment of the present application. Figure 5 and Figure 6 As shown, the terminal device 200 may include four sensing modules, which are respectively located at four sides of the rectangular terminal device 200 . The four sensing modules include: a first sensing module 201 , a second sensing module 202 , a third sensing module 203 and a fourth sensing module 204 .

[0061] It should be understood that the terminal device 200 corresponds to the terminal device 100, and the four sensing modules in the terminal device 200 are one possible configuration of the two groups of sensing modules included in the terminal device 100. Compared with the terminal device 100, the terminal device 200 can be regarded as including two first groups of sensing modules 110 and two second groups of sensing modules 120.

[0062] like Figure 5 As shown, the terminal device 200 is placed horizontally. For the sake of distinction, it is referred to as Figure 5The horizontal screen orientation of the terminal device 200 shown is the first orientation of the terminal device 200. Specifically, when placed in the first orientation, the first group of sensing modules of the terminal device 200 includes the first sensing module 201, that is, the first sensing module 201 corresponds to a first group of sensing modules 110 included in the terminal device 100; the second group of sensing modules of the terminal device 200 includes the second sensing module 202, that is, the second sensing module 202 corresponds to a second group of sensing modules 120 included in the terminal device 100.

[0063] Specifically, the terminal device 200 is placed in a first direction, and the first sensing module 201 is used to obtain a first electromagnetic wave signal after being affected by a left-hand gesture; conversely, the second sensing module 202 is used to obtain a second electromagnetic wave signal after being affected by a right-hand gesture.

[0064] It should be understood that in the embodiment of the present application, when the terminal device 200 is placed in the first direction, it means that the terminal device 200 is in a horizontal screen state. This horizontal screen state includes rotating the vertical terminal device 200 counterclockwise to the horizontal screen, and may also include rotating the vertical terminal device 200 clockwise to the horizontal screen. In other words, Figure 5 As shown, when the terminal device 200 is placed in a first orientation, the first sensing module 201 may correspond to the upper end of the terminal device 200 when placed upright, and the second sensing module 202 may correspond to the lower end of the terminal device 200 when placed upright; alternatively, the second sensing module 202 may correspond to the upper end of the terminal device 200 when placed upright, and the first sensing module 201 corresponds to the lower end of the terminal device 200 when placed upright. Regardless of the horizontal screen orientation, the first sensing module 201 in this embodiment of the application represents the sensing module located on the left, and the second sensing module 202 represents the sensing module located on the right. Accordingly, the first sensing module 201 is used to detect electromagnetic wave signals from the left hand, and the second sensing module 202 is used to detect electromagnetic wave signals from the right hand.

[0065] like Figure 6 As shown, the terminal device 200 is placed vertically. For the sake of distinction, it is referred to as Figure 6 The vertical screen orientation of the terminal device 200 shown is the second orientation of the terminal device 200, so the first orientation of the terminal device 200 is perpendicular to the second orientation, or approximately perpendicular. Specifically, when placed in the second orientation, the first group of sensing modules of the terminal device 200 includes the third sensing module 203, that is, the third sensing module 203 corresponds to the other first group of sensing modules 110 included in the terminal device 100; the second group of sensing modules of the terminal device 200 includes the fourth sensing module 204, that is, the fourth sensing module 204 corresponds to the other second group of sensing modules 120 included in the terminal device 100.

[0066] Specifically, the terminal device 200 is placed in the second direction, and the third sensing module 203 is used to obtain the first electromagnetic wave signal after being affected by the left hand gesture; conversely, the fourth sensing module 204 is used to obtain the second electromagnetic wave signal after being affected by the right hand gesture.

[0067] Similar to the first direction described above, when the terminal device 200 is placed in the second direction, it indicates that the terminal device 200 is in a portrait state. This portrait state may include placing the terminal device 200 upright or upside down. Regardless of the portrait orientation, the third sensing module 203 of the embodiment of the present application represents the sensing module located on the left, and the fourth sensing module 204 represents the sensing module located on the right. Accordingly, the third sensing module 203 is used to detect electromagnetic wave signals of the left hand, and the fourth sensing module 204 is used to detect electromagnetic wave signals of the right hand. In other words, Figure 5 and Figure 6 The numbering order of the four sensing modules is only one possibility, and other orders are also possible. The embodiments of the present application are not limited to this.

[0068] Optionally, the terminal device 200 may further include an orientation sensor, which may be used to identify whether the terminal device 200 is placed in the first orientation or the second orientation. The orientation sensor may be a sensor built into the terminal device, used to identify whether the terminal device is currently in a landscape or portrait state. For example, the orientation sensor may be a gyroscope, but the embodiments of the present application are not limited thereto.

[0069] Optionally, four sensing modules are provided on the four sides of the terminal device 200, and the position of each sensing module can be adjusted according to actual application. Figure 5 and Figure 6 This is just one possibility. For example, Figure 5 and Figure 6 The four sensing modules of the terminal device 200 can be located at the center of the four sides of the rectangular terminal device 200, but the four sensing modules can also be located at non-center positions of the four sides. Figure 5 and Figure 6 Each sensing module in the terminal device 200 is located on one side of the terminal device 200, but each sensing module can also be set at other positions close to each side. Figure 5 However, the first sensing module 201 can also be set to a position close to the left edge, that is, the left side of the first sensing module 201 can be at a certain distance from the leftmost side of the terminal device. The embodiment of the present application is not limited to this.

[0070] In the embodiment of the present application, when the four sensing modules are set on the four sides of the terminal device 200, the identification processing module and the application layer can also be set differently when the terminal device 200 is in different directions.

[0071] Optionally, corresponding to Figure 3 In the case shown in FIG. 1 , the at least one identification processing module in the terminal device 200 may include a first identification processing module and a second identification processing module. Specifically, when the terminal device 200 is placed in the first direction, for example, Figure 5 As shown, Figure 3 The first group of sensing modules 110 in the embodiment includes a first sensing module 201, which is used to obtain a first electromagnetic wave signal after being affected by a left-hand gesture and transmit it to a first recognition processing module 131; the first recognition processing module 131 is used to recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the first sensing module 201 and send the left-hand gesture to the application layer 140. Similarly, Figure 3 The second group of sensing modules 120 includes a second sensing module 202, which is used to obtain a second electromagnetic wave signal after being affected by a right-hand gesture and transmit it to a second recognition processing module 132. The second recognition processing module 132 is used to recognize the right-hand gesture based on the second electromagnetic wave signal obtained by the second sensing module 202 and send the right-hand gesture to the application layer 140. The application layer 140 is used to receive and merge the left-hand gesture and the right-hand gesture, and perform operations corresponding to the merged left-hand gesture and the right-hand gesture.

[0072] Alternatively, when the terminal device is placed in the second direction, for example Figure 6 As shown, Figure 3 The first group of sensing modules 110 in the embodiment includes a third sensing module 203, which is used to obtain a first electromagnetic wave signal after being affected by a left-hand gesture and transmit it to the first recognition processing module 131; the first recognition processing module 131 is used to recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the third sensing module 203 and send the left-hand gesture to the application layer 140. Similarly, Figure 3 The second group of sensing modules 120 includes a fourth sensing module 204, which is used to obtain a second electromagnetic wave signal after being affected by the right-hand gesture and transmit it to the second recognition processing module 132. The second recognition processing module 131 is used to recognize the right-hand gesture based on the second electromagnetic wave signal obtained by the fourth sensing module 204 and send the right-hand gesture to the application layer 140. The application layer 140 is used to receive and combine the left-hand gesture and the right-hand gesture, and perform operations corresponding to the left-hand gesture and the right-hand gesture.

[0073] Optionally, corresponding to Figure 4 In the case shown in FIG. 1 , the at least one identification processing module in the terminal device 200 may further include a third identification processing module. Specifically, when the terminal device 200 is placed in the first direction, for example, Figure 5 As shown, Figure 4 The first group of sensing modules 110 in the embodiment includes a first sensing module 201, which is used to obtain a first electromagnetic wave signal after being affected by a left-hand gesture and transmit it to the third recognition processing module 133, so that the third recognition processing module 133 can recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the first sensing module 201. Similarly, Figure 4 The second group of sensing modules 120 includes a second sensing module 202, which is used to obtain a second electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the third recognition processing module 133, so that the third recognition processing module 133 can recognize the right-hand gesture based on the second electromagnetic wave signal obtained by the second sensing module. After recognizing the left-hand gesture and the right-hand gesture, the third recognition processing module 133 merges the left-hand gesture and the right-hand gesture, and sends the merged left-hand gesture and the right-hand gesture to the application layer 140. The application layer 140 is used to receive the merged left-hand gesture and the right-hand gesture and perform operations corresponding to the merged left-hand gesture and the right-hand gesture.

[0074] Alternatively, when the terminal device is placed in the second direction, Figure 6 As shown, Figure 4 The first group of sensing modules 110 in the embodiment includes a third sensing module 203, which is used to obtain the first electromagnetic wave signal after being affected by the left hand gesture and transmit it to the third recognition processing module 133, so that the third recognition processing module 133 can recognize the left hand gesture according to the first electromagnetic wave signal obtained by the first sensing module 201. Figure 4 The second group of sensing modules 120 includes a fourth sensing module 204, which is used to obtain a second electromagnetic wave signal after being affected by the right-hand gesture and transmit it to the third recognition processing module 133. The third recognition processing module 133 recognizes the left-hand gesture and the right-hand gesture, merges the left-hand gesture and the right-hand gesture, and sends the merged left-hand gesture and the right-hand gesture to the application layer 140. The application layer 140 is used to receive the merged left-hand gesture and the right-hand gesture and perform an operation corresponding to the merged left-hand gesture and the right-hand gesture.

[0075] It should be understood that when the terminal device 200 is placed in the first direction or the second direction, the four sensing modules correspond to Figure 3 and Figure 4The first group of sensing modules 110 and the second group of sensing modules 120 in the terminal device 200 are suitable for the terminal device 100. Figure 3 and Figure 4 For the sake of brevity, some of the related descriptions are not repeated here.

[0076] Optionally, as a second embodiment, considering the motion recognition of each hand, multiple sensing modules can be used to complete the recognition. Figure 7 and Figure 8 FIG. 3 is a schematic diagram showing a terminal device 300 according to an embodiment of the present application. Figure 7 and Figure 8 As shown, the terminal device 300 may include four sensing modules, which are respectively located at the four corners of the rectangular terminal device. The four sensing modules include: a first sensing module 301 , a second sensing module 302 , a third sensing module 303 and a fourth sensing module 304 .

[0077] It should be understood that the terminal device 300 corresponds to the terminal device 100, and the four sensing modules in the terminal device 300 are one possible arrangement of the two groups of sensing modules included in the terminal device 100. Compared with the terminal device 100, the terminal device 300 can be regarded as including a first group of sensing modules 110 and a second group of sensing modules 120. However, when the terminal device 300 is located in different directions, the sensing modules included in the first group of sensing modules 110 or the second group of sensing modules 120 are different.

[0078] Specifically, if Figure 7 As shown, Figure 5 The placement direction of the terminal device 200 is the same as that of the terminal device 200. When the terminal device 300 is placed in the first direction, it indicates that the terminal device 300 is in a landscape mode. When the terminal device 300 is placed in the first direction, its first group of sensing modules includes the adjacent first sensing module 301 and the second sensing module 302, that is, the first sensing module 301 and the second sensing module 302 correspond to the first group of sensing modules 110 included in the terminal device 100; the second group of sensing modules includes the adjacent third sensing module 303 and the fourth sensing module 304, that is, the third sensing module 303 and the fourth sensing module 304 correspond to the second group of sensing modules 120 included in the terminal device 100.

[0079] Specifically, the terminal device 300 is placed in a first direction, and the first sensing module 301 and the second sensing module 302 are used to obtain a first electromagnetic wave signal after being affected by a left-hand gesture. For example, the first sensing module 301 obtains an electromagnetic wave signal after being affected by a left-hand gesture, and the second sensing module 302 also obtains an electromagnetic wave signal after being affected by a left-hand gesture. Then the first electromagnetic wave signal includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the second sensing module 302; in contrast, the third sensing module 303 and the fourth sensing module 304 are used to obtain a second electromagnetic wave signal after being affected by a right-hand gesture. For example, the third sensing module 303 obtains an electromagnetic wave signal after being affected by a right-hand gesture, and the fourth sensing module 304 is used to obtain an electromagnetic wave signal after being affected by a right-hand gesture. Then the second electromagnetic wave signal includes the electromagnetic wave signal obtained by the third sensing module 303 and the electromagnetic wave signal obtained by the fourth sensing module 304.

[0080] It should be understood that in the embodiments of the present application, when the terminal device 300 is placed in the first orientation, it indicates that the terminal device 300 is in a landscape mode. This landscape mode includes rotating the vertical terminal device 300 counterclockwise to a landscape mode, and may also include rotating the vertical terminal device 300 clockwise to a landscape mode. Regardless of the landscape mode, the first sensing module 301 and the second sensing module 302 in the embodiments of the present application represent the two sensing modules located in the left corner, and the third sensing module 303 and the fourth sensing module 304 represent the two sensing modules located on the right. Accordingly, the first sensing module 301 and the second sensing module 302 are used to detect electromagnetic wave signals from the left hand, and the third sensing module 303 and the fourth sensing module 304 are used to detect electromagnetic wave signals from the right hand.

[0081] like Figure 8 As shown, Figure 6 The placement direction of the terminal device 200 is the same as that of the terminal device 200. When the terminal device 300 is placed in the second direction, it indicates that the terminal device 300 is in a portrait state, wherein the first direction is perpendicular to, or approximately perpendicular to, the second direction. When the terminal device 300 is placed in the second direction, the first group of sensing modules of the terminal device 300 includes the second sensing module 302 and the fourth sensing module 304, that is, the second sensing module 302 and the fourth sensing module 304 correspond to the first group of sensing modules 110 included in the terminal device 100; the second group of sensing modules of the terminal device 300 includes the first sensing module 301 and the third sensing module 304, that is, the first sensing module 301 and the third sensing module 304 correspond to the second group of sensing modules 120 included in the terminal device 100.

[0082] Specifically, the terminal device 300 is placed in the second direction, and the second sensing module 302 and the fourth sensing module 304 are used to obtain the first electromagnetic wave signal after being affected by the left-hand gesture. For example, the second sensing module 302 obtains the electromagnetic wave signal after being affected by the left-hand gesture, and the fourth sensing module 304 obtains the electromagnetic wave signal after being affected by the left-hand gesture. Then the first electromagnetic wave signal includes the electromagnetic wave signal obtained by the second sensing module 302 and the electromagnetic wave signal obtained by the fourth sensing module 304; conversely, the first sensing module 301 and the third sensing module 303 are used to obtain the second electromagnetic wave signal after being affected by the right-hand gesture. For example, the first sensing module 301 obtains the electromagnetic wave signal after being affected by the right-hand gesture, and the third sensing module 303 is used to obtain the electromagnetic wave signal after being affected by the right-hand gesture. Then the second electromagnetic wave signal includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the third sensing module 303.

[0083] Similar to the first direction mentioned above, when the terminal device 300 is placed in the second direction, it indicates that the terminal device 300 is in a portrait state. This portrait state may include placing the terminal device 300 upright or upside down. Regardless of the direction of the portrait screen, the second sensing module 302 and the fourth sensing module 304 of the embodiment of the present application represent the two sensing modules located in the left corner, and the first sensing module 301 and the third sensing module 303 represent the two sensing modules located in the right corner. Accordingly, the second sensing module 302 and the fourth sensing module 304 are used to detect the electromagnetic wave signal of the left hand, and the first sensing module 301 and the third sensing module 303 are used to detect the electromagnetic wave signal of the right hand. In other words, Figure 7 and Figure 8 The numbering order of the four sensing modules is only one possibility, and other orders are also possible. The embodiments of the present application are not limited to this.

[0084] Optionally, the terminal device 300 may further include an orientation sensor, which may be used to identify whether the terminal device 300 is placed in the first orientation or the second orientation. The orientation sensor may be a sensor built into the terminal device, used to identify whether the terminal device is currently in a landscape or portrait state. For example, the orientation sensor may be a gyroscope, but the embodiments of the present application are not limited thereto.

[0085] Optionally, four sensing modules are provided at the four corners of the terminal device 300, and the position of each sensing module can be adjusted according to actual application. Figure 7 and Figure 8 This is just one possibility. For example, Figure 7 and Figure 8Each sensing module in the embodiment is rectangular and is located at a corner of the terminal device 300, and each sensing module has a corner that coincides with a corner of the corresponding terminal device 300. However, each sensing module may also have other shapes and be located at other positions near each corner. For example, the first sensing module 301 is located at Figure 7 and Figure 8 The first sensing module 301 is located at a corner of the terminal device, and two sides of the first sensing module 301 coincide with two sides of the terminal device 300. However, the first sensing module 301 can also be set to a position close to a corner of the terminal device 300, that is, the side of the first sensing module 301 can be at a certain distance from the side of the terminal device 300, and the corners do not coincide. The embodiments of the present application are not limited to this.

[0086] In the embodiment of the present application, when the four sensing modules are set at the four corners of the terminal device 300, the identification processing module and the application layer can also be set differently when the terminal device 300 is in different directions.

[0087] Optionally, corresponding to Figure 3 In the case shown, the at least one identification processing module in the terminal device 300 includes a first identification processing module and a second identification processing module. Specifically, when the terminal device 300 is placed in the first direction, for example Figure 7 As shown, Figure 3 The first group of sensing modules 110 in the embodiment includes a first sensing module 301 and a second sensing module 302. Figure 9 FIG. 3 shows a schematic block diagram of each module when the terminal device 300 is placed in a first direction, as shown in FIG. Figure 9 As shown, the first sensing module 301 and the second sensing module 302 are used to obtain a first electromagnetic wave signal after being affected by a left-hand gesture and transmit it to the first recognition processing module 131. For example, the first sensing module 301 is used to sense and obtain an electromagnetic wave signal after being affected by a left-hand gesture and transmit it to the first recognition processing module 131; the second sensing module 302 is used to sense and obtain an electromagnetic wave signal after being affected by a left-hand gesture and transmit it to the first recognition processing module 131. In other words, the first electromagnetic wave signal obtained by the first recognition processing module 131 after being affected by the left-hand gesture includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the second sensing module 301. The first recognition processing module 131 is used to recognize the left-hand gesture based on the obtained first electromagnetic wave signal and then transmit the recognized left-hand gesture to the application layer 140.

[0088] akin, Figure 3 The second group of sensing modules 120 includes a third sensing module 303 and a fourth sensing module 304, that is, Figure 9As shown, the third sensing module 303 and the fourth sensing module 304 are used to obtain a second electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the second recognition processing module 132. For example, the third sensing module 303 is used to sense and obtain an electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the second recognition processing module 132; the fourth sensing module 304 is used to sense and obtain an electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the second recognition processing module 132. In other words, the second electromagnetic wave signal after being affected by the right-hand gesture obtained by the second recognition processing module 132 includes the electromagnetic wave signal obtained by the third sensing module 303 and the electromagnetic wave signal obtained by the fourth sensing module 304. The second recognition processing module 132 is used to recognize the right-hand gesture based on the obtained second electromagnetic wave signal and then transmit the recognized right-hand gesture to the application layer 140. The application layer 140 merges the received left-hand gesture and the right-hand gesture and performs an operation corresponding to the merged left-hand gesture and the right-hand gesture.

[0089] Alternatively, when the terminal device 300 is placed in the second direction, for example Figure 8 As shown, Figure 3 The first group of sensing modules 110 in the embodiment includes a second sensing module 302 and a fourth sensing module 304, that is, Figure 10 FIG. 3 shows a schematic block diagram of each module when the terminal device 300 is placed in the second direction, as shown in FIG. Figure 10 As shown, the second sensing module 302 and the fourth sensing module 304 are used to obtain the first electromagnetic wave signal after being affected by the left-hand gesture and transmit it to the first recognition processing module 131. For example, the second sensing module 302 is used to sense and obtain the electromagnetic wave signal after being affected by the left-hand gesture and transmit it to the first recognition processing module 131; the fourth sensing module 304 is used to sense and obtain the electromagnetic wave signal after being affected by the left-hand gesture and transmit it to the first recognition processing module 131. In other words, the first electromagnetic wave signal obtained by the first recognition processing module 131 after being affected by the left-hand gesture includes the electromagnetic wave signal obtained by the second sensing module 302 and the electromagnetic wave signal obtained by the fourth sensing module 304. The first recognition processing module 131 is used to recognize the left-hand gesture based on the obtained first electromagnetic wave signal and then transmit the recognized left-hand gesture to the application layer 140.

[0090] akin, Figure 3 The second group of sensing modules 120 includes a first sensing module 301 and a third sensing module 303, that is, Figure 10As shown, the first sensing module 301 and the third sensing module 303 are used to obtain a second electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the second recognition processing module 132. For example, the first sensing module 303 is used to sense and obtain an electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the second recognition processing module 132; the third sensing module 303 is used to sense and obtain an electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the second recognition processing module 132. In other words, the second electromagnetic wave signal obtained by the second recognition processing module 132 after being affected by the right-hand gesture includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the third sensing module 303. The second recognition processing module 132 is used to recognize the right-hand gesture based on the obtained second electromagnetic wave signal and then transmit the recognized right-hand gesture to the application layer 140. The application layer 140 combines the received left-hand gesture and the right-hand gesture and performs operations corresponding to the left-hand gesture and the right-hand gesture.

[0091] Optionally, corresponding to Figure 4 In the case shown, the at least one identification processing module of the terminal device 300 includes a third identification processing module. Specifically, when the terminal device 300 is placed in the first direction, for example Figure 7 As shown, Figure 4 The first group of sensing modules 110 in the embodiment includes a first sensing module 301 and a second sensing module 302. The first sensing module 301 and the second sensing module 302 are used to obtain a first electromagnetic wave signal after being affected by a left-hand gesture and transmit it to the third recognition processing module 133. For example, the first sensing module 301 is used to sense and obtain an electromagnetic wave signal after being affected by a left-hand gesture and transmit it to the third recognition processing module 133; the second sensing module 302 is also used to sense and obtain an electromagnetic wave signal after being affected by a left-hand gesture and transmit it to the third recognition processing module 133. In other words, the first electromagnetic wave signal after being affected by a left-hand gesture obtained by the third recognition processing module 133 includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the second sensing module 302.

[0092] akin, Figure 4The second group of sensing modules 120 in the embodiment includes a third sensing module 303 and a fourth sensing module 304. The third sensing module 303 and the fourth sensing module 304 are used to obtain the second electromagnetic wave signal after being affected by the right-hand gesture and transmit it to the third recognition processing module 133. For example, the third sensing module 303 is used to sense and obtain the electromagnetic wave signal after being affected by the right-hand gesture and transmit it to the third recognition processing module 133; the fourth sensing module 304 is used to sense and obtain the electromagnetic wave signal after being affected by the right-hand gesture and transmit it to the third recognition processing module 133. In other words, the second electromagnetic wave signal after being affected by the right-hand gesture obtained by the third recognition processing module 133 includes the electromagnetic wave signal obtained by the third sensing module 303 and the electromagnetic wave signal obtained by the fourth sensing module 304.

[0093] Corresponding to Figure 4 , Figure 11 FIG. 3 shows a schematic block diagram of each module when the terminal device 300 is placed in a first direction, as shown in FIG. Figure 11 As shown, the electromagnetic wave signals obtained by the four sensing modules are all transmitted to the third recognition processing module 133. The third recognition processing module 133 can determine whether the electromagnetic wave signals obtained by each module correspond to a left-hand gesture or a right-hand gesture based on the current orientation of the terminal device 300. For example, when the terminal device 300 is placed in a first orientation, the third recognition processing module 133 is used to identify the left-hand gesture based on the first electromagnetic wave signals obtained by the first sensing module 301 and the second sensing module 302, and to identify the right-hand gesture based on the second electromagnetic wave signals obtained by the third sensing module 303 and the fourth sensing module 304, and then merge the left-hand gesture and the right-hand gesture and send them to the application layer 140. The application layer 140 receives the merged left-hand gesture and the right-hand gesture, and performs operations corresponding to the merged left-hand gesture and the right-hand gesture.

[0094] Alternatively, when the terminal device 300 is placed in the second direction, for example Figure 8 As shown, Figure 4The first group of sensing modules 110 in the embodiment includes a second sensing module 302 and a fourth sensing module 304. The second sensing module 302 and the fourth sensing module 304 are used to obtain the first electromagnetic wave signal after being affected by the left-hand gesture and transmit it to the third recognition processing module 133. For example, the second sensing module 302 is used to sense and obtain the electromagnetic wave signal after being affected by the left-hand gesture and transmit it to the third recognition processing module 133; the fourth sensing module 304 is used to sense and obtain the electromagnetic wave signal after being affected by the left-hand gesture and transmit it to the third recognition processing module 133. In other words, the first electromagnetic wave signal after being affected by the left-hand gesture obtained by the third recognition processing module 133 includes the electromagnetic wave signal obtained by the second sensing module 302 and the electromagnetic wave signal obtained by the fourth sensing module 304.

[0095] akin, Figure 4 The second group of sensing modules 120 in the embodiment includes a first sensing module 301 and a third sensing module 303. The first sensing module 301 and the third sensing module 303 are used to obtain a second electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the third recognition processing module 133. For example, the first sensing module 303 is used to sense and obtain an electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the third recognition processing module 133; the third sensing module 303 is used to sense and obtain an electromagnetic wave signal after being affected by a right-hand gesture and transmit it to the third recognition processing module 133. In other words, the second electromagnetic wave signal after being affected by a right-hand gesture obtained by the third recognition processing module 133 includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the third sensing module 303.

[0096] Corresponding to Figure 4 ,like Figure 11 As shown, the electromagnetic wave signals obtained by the four sensing modules are all transmitted to the third recognition processing module 133. The third recognition processing module 133 can determine whether the electromagnetic wave signals obtained by each module correspond to a left-hand gesture or a right-hand gesture based on the current orientation of the terminal device 300. For example, when the terminal device 300 is placed in the second orientation, the third recognition processing module 133 recognizes the left-hand gesture based on the first electromagnetic wave signal obtained by the second sensing module 302 and the fourth sensing module 304, and recognizes the right-hand gesture based on the second electromagnetic wave signal obtained by the first sensing module 301 and the third sensing module 303, and then merges the left-hand gesture and the right-hand gesture and sends them to the application layer 140. The application layer 140 receives the merged left-hand gesture and the right-hand gesture, and performs operations corresponding to the merged left-hand gesture and the right-hand gesture.

[0097] It should be understood that when the terminal device 300 is placed in the first direction or the second direction, the four sensing modules correspond to Figure 3 and Figure 4 The first group of sensing modules 110 and the second group of sensing modules 120 in the terminal device 100 are connected. Therefore, the terminal device 300 is applicable to the terminal device 100. Figure 3 and Figure 4 For the sake of brevity, some of the related descriptions are not repeated here.

[0098] It should be understood that in this second embodiment, any one of the first recognition processing module 131, the second recognition processing module 132, and the third recognition processing module 133 needs to process the electromagnetic wave signals of multiple sensing modules. Specifically, when processing the electromagnetic wave signals of multiple sensing modules, any one of the recognition processing modules can adopt any of the following methods: selecting the recognition result with the highest probability as the recognition result of the corresponding recognition processing module; processing the results of multiple sensing modules, such as performing arithmetic averaging or weighted averaging, to obtain a recognition result, but the embodiments of the present application are not limited to this.

[0099] Therefore, the terminal device of the embodiment of the present application is provided with at least two groups of sensing modules, which are respectively used to sense the electromagnetic wave signals after being affected by the left-hand gesture and the electromagnetic wave signals after being affected by the right-hand gesture. For example, four sensing modules can be set in the manner of the first and second embodiments mentioned above. In this way, regardless of whether the terminal device is in a horizontal screen or a vertical screen, there will be corresponding sensing modules for obtaining the electromagnetic wave signals after being affected by the left-hand gesture and the right-hand gesture, respectively, and performing gesture recognition through the recognition processing module, thereby realizing the recognition of two-hand gestures, that is, realizing two-hand recognition and joint operation in game scenes.

[0100] Combined with the above Figures 1 to 11 , describes the embodiment of the present application in detail from the perspective of the terminal device, and will now be combined with Figure 12 , describes a method for identifying gestures for operating a terminal device according to an embodiment of the present application.

[0101] Figure 12 A schematic flow chart of a method 400 for identifying gestures for operating a terminal device according to an embodiment of the present application is shown. The method 400 can be executed by a terminal device comprising a first group of sensing modules and a second group of sensing modules, wherein the first group of sensing modules and the second group of sensing modules each comprise at least one sensing module, and the second group of sensing modules and the first group of sensing modules are located at opposite ends of the terminal device. For example, the terminal device may refer to Figures 1 to 11 Any one of the terminal devices 100, 200 and 300.

[0102] Specifically, if Figure 12As shown, the method 400 includes: S410, sensing the waveform of the electromagnetic wave through the first group of sensing modules to obtain a first electromagnetic wave signal after being affected by the left hand gesture; S420, sensing the waveform of the electromagnetic wave through the second group of sensing modules to obtain a second electromagnetic wave signal after being affected by the right hand gesture; S430, identifying the left hand gesture and the right hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal, and performing operations corresponding to the left hand gesture and the right hand gesture.

[0103] Optionally, as an embodiment, the terminal device includes four sensing modules, which are respectively located at the four sides of the rectangular terminal device, and the four sensing modules include: a first sensing module, a second sensing module, a third sensing module and a fourth sensing module; when the terminal device is placed in a first direction, the first group of sensing modules includes the first sensing module, and the second group of sensing modules includes the second sensing module; when the terminal device is placed in a second direction, the first group of sensing modules includes the third sensing module; the second group of sensing modules includes the fourth sensing module; the first direction is perpendicular to the second direction.

[0104] Optionally, as an embodiment, the four sensing modules are respectively located at the center positions of the four sides of the rectangular terminal device.

[0105] Optionally, as an embodiment, the left-hand gesture and the right-hand gesture are identified based on the first electromagnetic wave signal and the second electromagnetic wave signal, including: if the terminal device is placed in the first direction, identifying the left-hand gesture based on the first electromagnetic wave signal obtained by the first sensing module; identifying the right-hand gesture based on the second electromagnetic wave signal obtained by the second sensing module; if the terminal device is placed in the second direction, identifying the left-hand gesture based on the first electromagnetic wave signal obtained by the third sensing module; and identifying the right-hand gesture based on the second electromagnetic wave signal obtained by the fourth sensing module.

[0106] Optionally, as an embodiment, the terminal device includes four sensing modules, which are respectively located at the four corners of the rectangular terminal device, and the four sensing modules include: a first sensing module, a second sensing module, a third sensing module and a fourth sensing module; when the terminal device is placed in a first direction, the first group of sensing modules includes the adjacent first sensing module and the second sensing module, and the second group of sensing modules includes the adjacent third sensing module and the fourth sensing module; when the terminal device is placed in a second direction, the first group of sensing modules includes the second sensing module and the fourth sensing module; the second group of sensing modules includes the first sensing module and the third sensing module; the first direction is perpendicular to the second direction.

[0107] Optionally, as an embodiment, the identifying the left-hand gesture and the right-hand gesture based on the first electromagnetic wave signal and the second electromagnetic wave signal includes: if the terminal device is placed in the first direction, identifying the left-hand gesture based on the first electromagnetic wave signal obtained by the first sensing module and the second sensing module; identifying the right-hand gesture based on the second electromagnetic wave signal obtained by the third sensing module and the fourth sensing module; if the terminal device is placed in the second direction, identifying the left-hand gesture based on the first electromagnetic wave signal obtained by the second sensing module and the fourth sensing module; and identifying the right-hand gesture based on the second electromagnetic wave signal obtained by the first sensing module and the third sensing module.

[0108] Optionally, as an embodiment, the method further includes: determining, by a direction sensor in the terminal device, whether the terminal device is placed in the first direction or in the second direction.

[0109] Optionally, as an embodiment, the electromagnetic wave signal is a millimeter wave radio signal.

[0110] Optionally, as an embodiment, the method 40 further includes: sending third electromagnetic wave information through the first group of sensing modules at a first time, the third electromagnetic wave signal being used to obtain the first electromagnetic wave signal; and sending fourth electromagnetic wave information through the second group of sensing modules at the first time, the fourth electromagnetic wave signal being used to obtain the second electromagnetic wave signal.

[0111] Optionally, as an embodiment, the method 400 further includes: transmitting business data at a second time, the first time and the second time do not overlap.

[0112] Optionally, as an embodiment, transmitting the business data at the second time includes: transmitting the business data through the first group of sensing modules and / or the second group of sensing modules at the second time.

[0113] Therefore, the method for identifying gestures of operating a terminal device in an embodiment of the present application is achieved by providing at least two groups of sensing modules on the terminal device, which are respectively used to sense the electromagnetic wave signals after being affected by the left-hand gesture and the electromagnetic wave signals after being affected by the right-hand gesture. For example, four sensing modules can be set on the four sides or four corners of the terminal device. In this way, regardless of whether the terminal device is in a horizontal screen or a vertical screen, there will be corresponding sensing modules for obtaining the electromagnetic wave signals after being affected by the left-hand gesture and the right-hand gesture, respectively. According to the electromagnetic wave signal, the corresponding gesture can be identified, and then the operation corresponding to the gesture is executed. In this way, the recognition of two-hand gestures can be realized, that is, the recognition and joint operation of two-handed gestures in game scenes are realized.

[0114] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0115] In this document, the term "and / or" simply describes a relationship between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document generally indicates that the related objects are in an "or" relationship.

[0116] It should be understood that the processor of the embodiments of the present application may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method embodiment can be completed by hardware integrated logic circuits in the processor or software instructions. The above processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly implemented as a hardware decoding processor, or can be implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0117] It is understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0118] It should be understood that the above-mentioned memories are exemplary but not restrictive. For example, the memories in the embodiments of the present application may also be static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM RAM (DR RAM), etc. In other words, the memories in the embodiments of the present application are intended to include, but are not limited to, these and any other suitable types of memories.

[0119] An embodiment of the present application also provides a computer-readable storage medium for storing a computer program.

[0120] Optionally, the computer-readable storage medium can be applied to the mobile terminal / terminal device in the embodiments of the present application, and the computer program enables the computer to execute the corresponding processes implemented by the mobile terminal / terminal device in the various methods of the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0121] An embodiment of the present application also provides a computer program product, including computer program instructions.

[0122] Optionally, the computer program product can be applied to the mobile terminal / terminal device in the embodiments of the present application, and the computer program instructions enable the computer to execute the corresponding processes implemented by the mobile terminal / terminal device in the various methods of the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0123] The embodiment of the present application also provides a computer program.

[0124] Optionally, the computer program can be applied to the mobile terminal / terminal device in the embodiments of the present application. When the computer program runs on the computer, the computer executes the corresponding processes implemented by the mobile terminal / terminal device in the various methods of the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0125] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0126] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0127] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0128] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0129] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0130] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0131] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A terminal device, characterized in that: include: A first group of sensing modules, used to obtain a first electromagnetic wave signal after being affected by a left-hand gesture by sensing the waveform of the electromagnetic wave, wherein the first group of sensing modules includes at least one sensing module; A second group of sensing modules, used for acquiring a second electromagnetic wave signal after being affected by the right-hand gesture by sensing the waveform of the electromagnetic wave, wherein the second group of sensing modules includes at least one sensing module; The second group of sensing modules and the first group of sensing modules are respectively located at two opposite ends of the terminal device; at least one recognition processing module, configured to recognize the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal; The application layer is used to receive the left-hand gesture and the right-hand gesture recognized by the at least one recognition processing module, and perform operations corresponding to the left-hand gesture and the right-hand gesture.

2. The terminal device according to claim 1, characterized in that: The terminal device includes four sensing modules, which are respectively located at four sides of the rectangular terminal device, and the four sensing modules include: a first sensing module, a second sensing module, a third sensing module and a fourth sensing module; When the terminal device is placed in a first direction, the first group of sensing modules includes the first sensing module, and the second group of sensing modules includes the second sensing module; When the terminal device is placed in the second direction, the first group of sensing modules includes the third sensing module; the second group of sensing modules includes the fourth sensing module; The first direction is perpendicular to the second direction.

3. The terminal device according to claim 2, characterized in that: The four sensing modules are respectively located at the center positions of the four sides of the rectangular terminal device.

4. The terminal device according to claim 2 or 3, characterized in that: The at least one recognition processing module includes a first recognition processing module and a second recognition processing module, When the terminal device is placed in the first direction, the first recognition processing module is used to recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the first sensing module; the second recognition processing module is used to recognize the right-hand gesture according to the second electromagnetic wave signal obtained by the second sensing module; the application layer is used to receive and merge the left-hand gesture recognized by the first recognition processing module and the right-hand gesture recognized by the second recognition processing module, and perform operations corresponding to the merged left-hand gesture and the right-hand gesture; When the terminal device is placed in the second direction, the first recognition and processing module is used to recognize the left-hand gesture based on the first electromagnetic wave signal obtained by the third sensing module; the second recognition and processing module is used to recognize the right-hand gesture based on the second electromagnetic wave signal obtained by the fourth sensing module; the application layer is used to receive and merge the left-hand gesture recognized by the first recognition and processing module and the right-hand gesture recognized by the second recognition and processing module, and perform operations corresponding to the left-hand gesture and the right-hand gesture.

5. The terminal device according to claim 2 or 3, characterized in that: The at least one recognition processing module includes a third recognition processing module, When the terminal device is placed in the first direction, the third recognition processing module is used to recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the first sensing module, and recognize the right-hand gesture according to the second electromagnetic wave signal obtained by the second sensing module, and merge the left-hand gesture and the right-hand gesture; the application layer is used to receive the merged left-hand gesture and the right-hand gesture, and perform operations corresponding to the merged left-hand gesture and the right-hand gesture; When the terminal device is placed in the second direction, the third recognition and processing module is used to recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the third sensing module, and to recognize the right-hand gesture according to the second electromagnetic wave signal obtained by the fourth sensing module, and to merge the left-hand gesture and the right-hand gesture; the application layer is used to receive the merged left-hand gesture and the right-hand gesture, and to perform operations corresponding to the merged left-hand gesture and the right-hand gesture.

6. The terminal device according to claim 1, characterized in that: The terminal device includes four sensing modules, which are respectively located at four corners of the rectangular terminal device, and the four sensing modules include: a first sensing module, a second sensing module, a third sensing module and a fourth sensing module; When the terminal device is placed in a first direction, the first group of sensing modules includes the adjacent first sensing module and the second sensing module, and the second group of sensing modules includes the adjacent third sensing module and the fourth sensing module; When the terminal device is placed in the second direction, the first group of sensing modules includes the second sensing module and the fourth sensing module; the second group of sensing modules includes the first sensing module and the third sensing module; The first direction is perpendicular to the second direction.

7. The terminal device according to claim 6, characterized in that: The at least one recognition processing module includes a first recognition processing module and a second recognition processing module, When the terminal device is placed in the first direction, the first recognition processing module is used to recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the first sensing module and the second sensing module; the second recognition processing module is used to recognize the right-hand gesture according to the second electromagnetic wave signal obtained by the third sensing module and the fourth sensing module; the application layer is used to receive and merge the left-hand gesture and the right-hand gesture recognized by the recognition processing module, and perform operations corresponding to the merged left-hand gesture and the right-hand gesture; When the terminal device is placed in the second direction, the first recognition and processing module is used to recognize the left-hand gesture based on the first electromagnetic wave signal obtained by the second sensing module and the fourth sensing module; the second recognition and processing module is used to recognize the right-hand gesture based on the second electromagnetic wave signal obtained by the first sensing module and the third sensing module; the application layer is used to receive and merge the left-hand gesture and the right-hand gesture recognized by the recognition and processing module, and perform operations corresponding to the left-hand gesture and the right-hand gesture.

8. The terminal device according to claim 6, characterized in that: The at least one recognition processing module includes a third recognition processing module, When the terminal device is placed in the first direction, the third recognition processing module is used to recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the first sensing module and the second sensing module, and recognize the right-hand gesture according to the second electromagnetic wave signal obtained by the third sensing module and the fourth sensing module, and merge the left-hand gesture and the right-hand gesture; the application layer is used to receive the merged left-hand gesture and the right-hand gesture, and perform operations corresponding to the merged left-hand gesture and the right-hand gesture; When the terminal device is placed in the second direction, the third recognition and processing module is used to recognize the left-hand gesture according to the first electromagnetic wave signal obtained by the second sensing module and the fourth sensing module, and to recognize the right-hand gesture according to the second electromagnetic wave signal obtained by the first sensing module and the third sensing module, and to merge the left-hand gesture and the right-hand gesture; the application layer is used to receive the merged left-hand gesture and the right-hand gesture, and to perform operations corresponding to the merged left-hand gesture and the right-hand gesture.

9. The terminal device according to any one of claims 2 or 3 or 6 or 7 or 8, characterized in that: The terminal device further includes: A direction sensor is used to identify whether the terminal device is placed in the first direction or in the second direction.

10. The terminal device according to any one of claims 1 or 2 or 3 or 7 or 8, characterized in that: The electromagnetic wave signal is a millimeter wave radio signal.

11. The terminal device according to any one of claims 1, 2 or 6, characterized in that: The first group of sensing modules is also used for: Sending a third electromagnetic wave signal at a first time, wherein the third electromagnetic wave signal is used to obtain the first electromagnetic wave signal; The second group of sensing modules is also used for: A fourth electromagnetic wave signal is sent at the first time, and the fourth electromagnetic wave signal is used to obtain the second electromagnetic wave signal.

12. The terminal device according to claim 11, characterized in that: The first group of sensing modules and / or the second group of sensing modules are further used for: The service data is transmitted at a second time, wherein the first time and the second time do not overlap.

13. The terminal device according to claim 11, characterized in that: The terminal device further includes: The transmission module is used to transmit business data at a second time, and the first time and the second time do not overlap.

14. The terminal device according to claim 13, characterized in that: The transmission module is also used for: Sending the second time to the first group of sensing modules and / or the second group of sensing modules; The first group of sensing modules and / or the second group of sensing modules are used for: The first time is determined according to the second time.

15. A method for identifying gestures for operating a terminal device, characterized in that: The terminal device includes a first group of sensing modules and a second group of sensing modules, the first group of sensing modules and the second group of sensing modules each include at least one sensing module, the second group of sensing modules and the first group of sensing modules are respectively located at two opposite ends of the terminal device, and the method includes: The first group of sensing modules senses the waveform of the electromagnetic wave to obtain a first electromagnetic wave signal affected by the left hand gesture; The second group of sensing modules senses the waveform of the electromagnetic wave to obtain a second electromagnetic wave signal affected by the right hand gesture; The left-hand gesture and the right-hand gesture are recognized according to the first electromagnetic wave signal and the second electromagnetic wave signal, and operations corresponding to the left-hand gesture and the right-hand gesture are performed.

16. The method according to claim 15, characterized in that The terminal device includes four sensing modules, which are respectively located at four sides of the rectangular terminal device, and the four sensing modules include: a first sensing module, a second sensing module, a third sensing module and a fourth sensing module; When the terminal device is placed in a first direction, the first group of sensing modules includes the first sensing module, and the second group of sensing modules includes the second sensing module; When the terminal device is placed in the second direction, the first group of sensing modules includes the third sensing module; the second group of sensing modules includes the fourth sensing module; The first direction is perpendicular to the second direction.

17. The method according to claim 16, characterized in that The four sensing modules are respectively located at the center positions of the four sides of the rectangular terminal device.

18. The method according to claim 16 or 17, characterized in that The identifying the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal includes: If the terminal device is placed in the first direction, the left-hand gesture is identified according to the first electromagnetic wave signal obtained by the first sensing module; and the right-hand gesture is identified according to the second electromagnetic wave signal obtained by the second sensing module; If the terminal device is placed in the second direction, the left-hand gesture is identified based on the first electromagnetic wave signal obtained by the third sensing module; and the right-hand gesture is identified based on the second electromagnetic wave signal obtained by the fourth sensing module.

19. The method according to claim 15, characterized in that The terminal device includes four sensing modules, which are respectively located at four corners of the rectangular terminal device, and the four sensing modules include: a first sensing module, a second sensing module, a third sensing module and a fourth sensing module; When the terminal device is placed in a first direction, the first group of sensing modules includes the adjacent first sensing module and the second sensing module, and the second group of sensing modules includes the adjacent third sensing module and the fourth sensing module; When the terminal device is placed in the second direction, the first group of sensing modules includes the second sensing module and the fourth sensing module; the second group of sensing modules includes the first sensing module and the third sensing module; The first direction is perpendicular to the second direction.

20. The method according to claim 19, characterized in that The identifying the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal includes: If the terminal device is placed in the first direction, the left-hand gesture is identified according to the first electromagnetic wave signal acquired by the first sensing module and the second sensing module; and the right-hand gesture is identified according to the second electromagnetic wave signal acquired by the third sensing module and the fourth sensing module; If the terminal device is placed in the second direction, the left-hand gesture is identified based on the first electromagnetic wave signal obtained by the second sensing module and the fourth sensing module; and the right-hand gesture is identified based on the second electromagnetic wave signal obtained by the first sensing module and the third sensing module.

21. The method according to any one of claims 16, 17, 19 or 20, characterized in that: The method further comprises: By using a direction sensor in the terminal device, it is determined whether the terminal device is placed in the first direction or in the second direction.

22. The method according to claim 15 or 20, characterized in that The electromagnetic wave signal is a millimeter wave radio signal.

23. The method according to any one of claims 15, 16 or 19, characterized in that: The method further comprises: Sending third electromagnetic wave information through the first group of sensing modules at a first time, wherein the third electromagnetic wave signal is used to obtain the first electromagnetic wave signal; At the first time, fourth electromagnetic wave information is sent through the second group of sensing modules, and the fourth electromagnetic wave signal is used to obtain the second electromagnetic wave signal.

24. The method according to claim 23, characterized in that The method further comprises: The service data is transmitted at a second time, and the first time and the second time do not overlap.

25. The method according to claim 24, characterized in that The transmitting the service data at the second time includes: The service data is transmitted through the first group of sensing modules and / or the second group of sensing modules at the second time.