Multiplayer environment gesture control right acquisition method, network device, and storage medium

Abstract

This application provides a method, network device, and storage medium for acquiring control rights through gestures in a multi-person environment. The method includes: acquiring the coordinates (x, y, z) of the spatial location identifier point P of the gesture that has acquired control, cached in the previous frame; acquiring a set of multi-person gesture information in the current frame, handlist = {hand0, hand1, hand2, ..., handn}; where n represents the number of hands in the current frame, and each gesture in the set contains the coordinates of key hand points used for gesture recognition; determining the number of gestures in the multi-person gesture information set handlist, and if it is greater than 1, outputting the hand closest to coordinate P in the current frame as the gesture that has acquired control. This application embodiment can identify the gesture that has acquired control in the current frame in a multi-person gesture environment, avoiding confusion in the interaction system.

Description

Technical Field

[0001] This application relates to the field of communication equipment technology, and in particular to a method for obtaining multi-person environmental gesture control rights, network equipment, and storage medium. Background Technology

[0002] Gesture control enables contactless operation and is becoming increasingly widespread. Human interaction via gesture recognition is gradually becoming a mainstream control method. However, during gesture recognition, the system can only recognize one gesture at a time, while multiple gestures may appear within the camera's field of view, leading to system confusion. Summary of the Invention

[0003] To overcome the problems existing in related technologies, this application provides a method for obtaining gesture control rights in a multi-user environment, a network device, and a storage medium.

[0004] According to the first aspect of the embodiments of this application, a method for obtaining multi-person environmental gesture control rights.

[0005] Get the spatial location identifier information point P of the gesture for gaining control in the previous frame buffer;

[0006] Get the set of hand gesture information for multiple people in the current frame: handlist = {hand0, hand1, hand2, ..., handn}; where n represents the number of hands in the current frame, and each gesture in the set contains the coordinates of the hand key points used to identify the gesture;

[0007] Determine the number of gestures in the multi-person gesture information set handlist. If it is greater than 1, output the hand that is closest to coordinate P in the current frame as the gesture that has gained control.

[0008] Preferably, the number of gestures in the multi-person gesture information set handlist is determined. If the number of gestures in handlist is equal to 1, the current gesture is output as the gesture to gain control, and the P coordinate is updated.

[0009] If the number of handlist gestures is 0, the P coordinate is empty.

[0010] Preferably, it also includes determining whether the P coordinate is empty; if it is not empty, determining the number of gestures in the multi-person gesture information set handlist to obtain the gesture for gaining control; if the P coordinate is empty, iterating through the handlist and taking the key point coordinates of one gesture in order each time to perform gesture conversion.

[0011] Determine whether the transformed gesture is a gesture for gaining control;

[0012] If it is a gesture to gain control, update the P coordinates and end the traversal; if it is not a gesture to gain control, retrieve the key point coordinates of the next gesture in the handlist, perform gesture transformation, and determine whether the gesture is a gesture to gain control.

[0013] Preferably, the P coordinates (x, y, z) are obtained from the gesture key points through an algorithm.

[0014] Preferably, the P coordinates (x, y, z) are obtained from the gesture key points through an algorithm, including processing the gesture key points by averaging or weighting algorithms.

[0015] Preferably, the P coordinates (x, y, z) are selected from the area enclosed by the key points of the gesture.

[0016] Preferably, the P coordinate (x, y, z) is the center of the area enclosed by the gesture key points.

[0017] Preferably, the gestures in the identified set of multi-person gesture information are the gestures for which control can be obtained.

[0018] The second aspect of this application provides a network device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes a method for acquiring gesture control rights in a multi-user environment.

[0019] The third aspect of this application provides a storage medium storing computer program instructions thereon, which, when executed by a processor, are used to implement a method for acquiring gesture control rights in a multi-user environment.

[0020] The technical solutions provided in this application embodiment may include the following beneficial effects:

[0021] In this embodiment, the adjacent frame comparison algorithm can identify the gesture for gaining control in the current frame in a multi-person gesture environment, thus avoiding confusion in the interaction system.

[0022] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0023] The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments consistent with this application and, together with the application, serve to explain the principles of this application.

[0024] Figure 1 This is a flowchart illustrating Embodiment 1 of this application;

[0025] Figure 2 This is a flowchart illustrating Embodiment 2 of this application;

[0026] Figure 3This is a flowchart illustrating Embodiment 3 of this application. Detailed Implementation

[0027] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0028] To address the problems existing in the background technology, Embodiment 1 of this application provides a method for obtaining gesture control rights in a multi-person environment, such as... Figure 1 As shown, it includes:

[0029] Get the spatial location identifier information point P (x, y, z) of the gesture for gaining control in the previous frame buffer.

[0030] Get the set of hand gesture information for multiple people in the current frame: handlist = {hand0, hand1, hand2, ..., handn}; where n represents the number of hands in the current frame, and each gesture in the set contains the coordinates of the hand key points used to identify the gesture;

[0031] Determine the number of gestures in the multi-person gesture information set handlist. If it is greater than 1, output the hand that is closest to coordinate P in the current frame as the gesture that has gained control.

[0032] The video captured by the camera consists of a series of consecutive frames, and the changes between adjacent frames are usually small. Taking standard definition (SD) video as an example, the SD camera has a frame rate of 30fps, with each frame spaced 0.33ms apart. Analyzing adjacent frame data reveals that even within a very short time (0.33ms), the data changes between adjacent frames are minimal, even when the user's hand is actively moving. Therefore, in the above embodiment, an adjacent frame comparison method is used, utilizing the coordinates of the spatial location identifier point P of the control-acquiring gesture in the previous frame to determine the control-acquiring gesture in the current frame. This enables the recognition of the control-acquiring gesture in the current frame in a multi-person gesture environment, avoiding confusion in the interaction system.

[0033] Example 2, as Figure 2 As shown, based on the above embodiment, the number of gestures in the multi-person gesture information set handlist is determined. If the number of gestures in handlist is equal to 1, the current gesture is output as the gesture to gain control, and the P coordinate is updated to the P coordinate of the current frame.

[0034] If the number of handlist gestures is 0, the P coordinate is empty.

[0035] Of course, other methods can also be used to handle the case where the number of gestures in the multi-person gesture information set handlist is less than or equal to 1, which will not be elaborated here.

[0036] This embodiment of the application also includes determining whether the P coordinate is empty. If it is not empty, it means that the current gesture control has been occupied. The handlist of multiple gesture information is processed by the aforementioned adjacent frame comparison algorithm to obtain the gesture for acquiring control. If the P coordinate is empty, it means that the current gesture control has not been occupied. The handlist is traversed, and the key point coordinates of one gesture are taken in sequence for gesture conversion.

[0037] Determine whether the transformed gesture is a gesture for gaining control;

[0038] If the gesture indicates gaining control, update the P coordinates and end the traversal; otherwise, retrieve the keypoint coordinates of the next gesture in the handlist, perform gesture conversion, and determine whether a gesture indicates gaining control. See Example 3. Figure 3 As shown.

[0039] In this embodiment, the P coordinates (x, y, z) are obtained from gesture key points using an algorithm. For example, they can be obtained by calculating the average value of the gesture key points or by using a weighted algorithm of the weights of each key point.

[0040] In this embodiment, the P coordinates (x, y, z) are selected from the area enclosed by the gesture key points. For example, the P coordinates (x, y, z) are the center of the area enclosed by the gesture key points.

[0041] The gestures identified in the set of multi-person gesture information in this application are the gestures that are set to grant control.

[0042] First, it needs to be explained how to acquire gesture control. Users can acquire control by performing specific gestures. If no one currently holds gesture control, the user acquires it directly. If gesture control is already held, the user must wait for it to be released before acquiring it.

[0043] How is gesture control released? This includes both active and passive release. Active release occurs when the user with gesture control performs a "close control" gesture. Passive release occurs when the user's hand leaves the virtual control area within a certain timeframe. Once gesture control is released, the P coordinate is set to empty.

[0044] Is it possible to seize control of gestures?

[0045] To prevent interruptions during operation, once gesture control is acquired, other users cannot seize it. Other users can only regain gesture control if the user actively or passively releases it.

[0046] For example, in this embodiment, acquiring gesture control can be done by extending all five fingers and facing the screen. Disabling gesture control can be done by placing the five fingers or even turning their backs to the screen. Passive release can be achieved by the gesture leaving the screen for a set time. Of course, gesture control can also be other gestures and is not limited to the examples given.

[0047] This application also provides a network device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it performs the above-described method for obtaining multi-person environmental gesture control rights.

[0048] This application embodiment also provides a storage medium storing computer program instructions, which, when executed by a processor, are used to implement the above-described method for obtaining multi-person environmental gesture control rights.

[0049] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

[0050] The above are merely preferred embodiments of this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A method for acquiring gesture control rights in a multi-person environment, characterized in that, Get the spatial location identifier information point P (x, y, z) of the gesture for gaining control in the previous frame buffer; Get the set of hand gesture information for multiple people in the current frame: handlist={hand0, hand1, hand2, ..., handn}; where n represents the number of hands in the current frame, and each gesture in the set contains the coordinates of the hand key points used to identify the gesture; The number of gestures is obtained from the multi-person gesture information set handlist. If the number of gestures is greater than 1, the hand that is closest to the P coordinate in the current frame is output as the gesture to gain control. If the number of gestures in handlist is equal to 1, the current gesture is output as the gesture to gain control, and the P coordinate is updated. If the number of gestures in handlist is equal to 0, the P coordinate is empty. Determine if coordinate P is empty; if not empty, determine the number of gestures in the multi-person gesture information set handlist to obtain the gesture for gaining control; if coordinate P is empty, iterate through handlist and take the key point coordinates of one gesture in order each time to perform gesture transformation. Determine if the transformed gesture is a gesture to gain control; if it is, update the P coordinates and end the traversal; if it is not a gesture to gain control, retrieve the key point coordinates of the next gesture in the handlist and perform gesture transformation and the determination of whether it is a gesture to gain control.

2. The method for acquiring multi-person environmental gesture control rights according to claim 1, characterized in that, The coordinates (x, y, z) of P are obtained from the gesture key points through an algorithm.

3. The method for acquiring multi-person environmental gesture control rights according to claim 2, characterized in that, The P coordinates (x, y, z) are obtained from the gesture key points through an algorithm, including processing the gesture key points by averaging or weighting algorithms.

4. The method for acquiring multi-person environmental gesture control rights according to claim 1, characterized in that, The P coordinates (x, y, z) are selected from the area enclosed by the gesture key points.

5. The method for acquiring multi-person environmental gesture control rights according to claim 4, characterized in that, The P coordinates (x, y, z) represent the center of the area enclosed by the gesture key points.

6. The method for acquiring multi-person environmental gesture control rights according to claim 1, characterized in that, The gestures in the multi-person gesture information set are the gestures that are set to grant control.

7. A network device, characterized in that, The invention includes a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor executes the program by performing the method for acquiring multi-person environmental gesture control rights as described in any one of claims 1-6.

8. A storage medium having computer program instructions stored thereon, characterized in that, When the program instructions are executed by the processor, they are used to implement the method for obtaining multi-person environmental gesture control rights as described in any one of claims 1-6.

Images