Pairing method and device

By obtaining and matching the posture sequence of the operator and the intelligent controller, the problem of difficulty in pairing the intelligent ring in multi-person scenarios is solved, and the accurate pairing of the intelligent ring and the operator and the synchronous control of the electronic device is realized.

CN119088219APending Publication Date: 2024-12-06LENOVO (BEIJING) LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411155607.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-21
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

In multi-person scenarios, smart rings cannot distinguish between wearer information and specific space locations, resulting in the combination of naked-eye 3D devices and smart rings cannot be paired in computer vision systems and cannot achieve effective interactive control.

Method used

By determining the operating body and the intelligent controller present in the target image, the posture sequence of the operating body and the posture sequence of the intelligent controller are obtained, and paired based on the similarity, the matching between the target operating body and the target intelligent controller is achieved.

Benefits of technology

In multi-person scenarios, the accurate pairing of smart rings and operators is achieved, ensuring that electronic devices can synchronize the 3D model in the screen based on gestures, improving the accuracy and efficiency of interactive control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088219A_ABST
    Figure CN119088219A_ABST
Patent Text Reader

Abstract

The invention discloses a pairing method and device, and the method comprises the steps: determining that a plurality of operation bodies and a plurality of intelligent controllers exist in a target image, and at least one target operation body wearing a target intelligent controller exists; obtaining a first pose sequence of the plurality of operation bodies and a second pose sequence of the plurality of intelligent controllers; and based on the similarity between the first pose sequence and the second pose sequence, pairing the corresponding target operation body with the target intelligent controller.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of electronic technology, and relate to but are not limited to a pairing method and device. Background Art

[0002] In current naked-eye 3D (Autostereoscopy) interaction scenarios, smart rings that interact with naked-eye 3D devices are often used as additional controllers. Since the smart ring itself cannot distinguish the wearer's information and specific spatial location, the combination of computer vision (CV) and the ring cannot be paired in multi-person scenarios. Therefore, how to achieve pairing between smart rings and operators in multi-person scenarios has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] In view of this, an embodiment of the present application provides a pairing method and device.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides a pairing method, including:

[0006] Determining that there are multiple operators and multiple intelligent controllers in the target image, and at least one target operator wears the target intelligent controller;

[0007] Acquire a first pose sequence of multiple operating bodies and a second pose sequence of multiple intelligent controllers;

[0008] Based on the similarity between the first pose sequence and the second pose sequence, the corresponding target operator is paired with the target intelligent controller.

[0009] In a second aspect, an embodiment of the present application provides a pairing device, including:

[0010] A first determination module is used to determine that there are multiple operators and multiple intelligent controllers in the target image, and at least one target operator wears a target intelligent controller;

[0011] A first acquisition module is used to acquire a first posture sequence of multiple operating bodies and a second posture sequence of multiple intelligent controllers;

[0012] The pairing module is used to pair the corresponding target operating body with the target intelligent controller based on the similarity between the first posture sequence and the second posture sequence.

[0013] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a camera device, the camera device being used to acquire a target image, the memory storing a computer program that can be run on the processor, and the processor executing the program to determine that there are multiple operating bodies and multiple intelligent controllers in the target image, and that there is at least one target operating body wearing a target intelligent controller; acquiring a first posture sequence of the multiple operating bodies and a second posture sequence of the multiple intelligent controllers; and pairing the corresponding target operating body with the target intelligent controller based on the similarity between the first posture sequence and the second posture sequence.

[0014] In a fourth aspect, an embodiment of the present application provides a storage medium storing executable instructions for implementing the above method when executed by a processor.

[0015] In a fifth aspect, a computer program product includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the steps in the above method are implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic diagram of an implementation flow of a pairing method provided in an embodiment of the present application;

[0017] Figure 2 A schematic diagram of an implementation flow of a method for starting pairing provided in an embodiment of the present application;

[0018] Figure 3 A schematic diagram of an implementation flow of a method for obtaining a posture provided in an embodiment of the present application;

[0019] Figure 4 A schematic diagram of an implementation flow of a pairing method provided in an embodiment of the present application;

[0020] Figure 5 A schematic diagram of the structure of a pairing device provided in an embodiment of the present application;

[0021] Figure 6 A hardware entity schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the specific technical solution of the embodiments of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application, but are not used to limit the scope of the present application.

[0023] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0024] In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0025] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0026] The present application embodiment provides a pairing method, such as Figure 1 As shown, the method includes:

[0027] Step S110: determining that there are multiple operators and multiple intelligent controllers in the target image, and at least one target operator wears a target intelligent controller;

[0028] Here, the operating body can be a part of the user's body where the intelligent controller can be worn. The intelligent controller can be a controller that can interact with electronic devices. For example, the user can interact with the naked-eye 3D device by wearing a smart ring on the finger; can also interact with the electronic device by wearing a smart watch on the wrist; can also interact with the electronic device by wearing smart glasses.

[0029] In the implementation process, a camera device disposed on an electronic device may be used to obtain video information to determine a target image in which multiple operating bodies and multiple intelligent controllers exist in multiple frames of video. For example, computer vision (CV) may be used to determine that multiple users and multiple smart rings exist in the target image, and it may be recognized that at least one user is wearing a smart ring on his finger.

[0030] Step S120, obtaining a first posture sequence of a plurality of the operating bodies and a second posture sequence of a plurality of the intelligent controllers;

[0031] Here, the first pose sequence of the operating body can be determined based on the video information acquired by the camera within a period of time, and the first pose sequence can be obtained through CV. For example, when the first pose sequence corresponding to the hand movement is determined using CV, the first pose sequence can be recorded as t_cv.

[0032] The second posture sequence of the intelligent controller can be acquired by using a motion-related sensor arranged in the intelligent controller.

[0033] In some embodiments, the second posture sequence is determined by an inertial measurement unit disposed in the smart controller. For example, the posture measurement of a smart ring can rely on an inertial measurement unit (IMU) integrated in it, where an accelerometer calculates acceleration information in a carrier coordinate system and a gyroscope calculates angular velocity information in a navigation coordinate system. The smart ring information sequence can be recorded as t_imu.

[0034] Step S130: based on the similarity between the first posture sequence and the second posture sequence, pair the corresponding target operating body with the target intelligent controller.

[0035] Here, when it is determined that the similarity between the first posture sequence and the second posture sequence is greater than the similarity threshold, it can be determined that the corresponding target operating body and the target intelligent controller are matched for use. For example, the similarity between the hand cv trajectory {t_cv1, t_cv2, ...} and the smart ring IMU trajectory {t_imu1, t_imu2, ...} can be matched. When it is determined that the similarity between the hand's motion trajectory and the smart ring's motion trajectory is greater than the similarity threshold, the target user who wears the target smart ring is determined, so that when the target user wears the smart ring and makes different moving gestures, the electronic device can synchronously operate the 3D model on the screen based on the moving gesture.

[0036] In the embodiment of the present application, it is first determined that there are multiple operators and multiple intelligent controllers in the target image, and at least one target operator is wearing a target intelligent controller; then the first posture sequence of the multiple operators and the second posture sequence of the multiple intelligent controllers are obtained; finally, based on the similarity between the first posture sequence and the second posture sequence, the corresponding target operator is paired with the target intelligent controller. In this way, in a scene with multiple operators and multiple intelligent controllers, pairing between the target operator and the target intelligent controller can be achieved based on the similarity between the first posture of the operator and the second posture of the intelligent control, so as to further realize the control of the electronic device based on the pairing result.

[0037] In some embodiments, Figure 2 As shown, the present application provides a method for starting pairing, comprising the following steps:

[0038] Step S210, determining that there are a plurality of the operating bodies through a computer recognition system;

[0039] Here, the computer recognition system refers to a system that uses computer technology, specific algorithms and models to recognize, analyze and process external information. The computer recognition system can obtain video information using a camera device installed in an electronic device.

[0040] In the implementation process, the computer recognition system can recognize the image of each frame in the video information to determine the presence of multiple operating bodies in the target image based on image recognition. For example, the computer recognition system can use image recognition to determine the presence of multiple hand images corresponding to users in the target image.

[0041] Step S220, locating the existence of a plurality of the intelligent controllers through appearance detection;

[0042] Here, appearance detection is a detection method for quickly identifying whether a target object (intelligent controller) is included in an image.

[0043] For example, multiple smart rings can be located in the target image through appearance detection. In some scenes, the smart rings are all worn on the user's fingers; in some scenes, some smart rings may not be worn on the user's fingers, but placed on the table.

[0044] Step S230: When it is determined that a pairing instruction sent by the target intelligent controller is received, the target image is acquired to start pairing.

[0045] In some embodiments, when it is determined that a start button on the smart controller is triggered, pairing of the smart controller can be triggered, that is, the electronic device can receive a pairing instruction sent by the smart controller.

[0046] In some embodiments, pairing may be automatically initiated when the smart controller is turned on, that is, pairing is triggered when the smart controller starts working.

[0047] When the electronic device determines that a pairing instruction has been received, it determines that there is an intelligent controller that needs to be paired, starts a camera device to acquire a target image, and starts pairing.

[0048] In the embodiment of the present application, the computer recognition system is first used to determine that there are multiple operating bodies; then, the appearance detection is used to locate the presence of multiple intelligent controllers; and finally, when it is determined that a pairing instruction is received from a target intelligent controller, a target image is acquired to start pairing. In this way, it is possible to automatically start configuration when it is determined that there is a pairing requirement for the target intelligent controller.

[0049] In some embodiments, the above method for initiating pairing further includes the following steps:

[0050] Step S240: determining that there is at least a target intelligent controller among the plurality of intelligent controllers that can interact with the electronic device;

[0051] Here, the target smart controller capable of exchanging information with the electronic device may be a smart controller in a working state. For example, it may be determined that there is a target smart ring capable of sending a control instruction to the naked-eye 3D device among a plurality of smart rings.

[0052] Step S250: Obtain a pairing instruction of the target intelligent controller.

[0053] During implementation, the electronic device may initiate pairing upon obtaining a pairing instruction from the target intelligent controller.

[0054] In some embodiments, the user may trigger a pairing start switch on the target smart controller, causing the electronic device to obtain a pairing instruction for the target smart controller.

[0055] In some embodiments, the target intelligent controller may automatically send a pairing instruction when powered on, so that the electronic device obtains the pairing instruction of the target intelligent controller.

[0056] In the embodiment of the present application, it is first determined that there is at least a target intelligent controller that can interact with the electronic device among the multiple intelligent controllers; then the pairing instruction of the target intelligent controller is obtained. In this way, it can be determined that there is a scenario where the target intelligent controller that can interact with the electronic device exists, that is, there is a pairing requirement, and the pairing instruction can be obtained to start the pairing of the operating body and the intelligent controller.

[0057] In some embodiments, the above method for initiating pairing further includes the following steps:

[0058] Step S260: Clear the pairing information of the target intelligent controller that can interact with the electronic device to store updated pairing information after the pairing is completed.

[0059] Here, the electronic device may have stored pairing information from a previous interaction with the intelligent controller. The stored pairing information may be different from the current pairing information, so before a new pairing is performed, the stored pairing information in the electronic device may be cleared, and further, new pairing information may be stored after the pairing is successful.

[0060] In the embodiment of the present application, the pairing information of the target intelligent controller that can interact with the electronic device is cleared to store the updated pairing information after the pairing is completed. In this way, the pairing information that is no longer used can be cleared to improve the efficiency of pairing, help reset the connection status of the device, eliminate potential connection errors, and avoid potential connection conflicts.

[0061] In some embodiments, the above step S120 "obtaining a first posture sequence of the plurality of operating bodies and a second posture sequence of the plurality of intelligent controllers" can be implemented by the following process:

[0062] Acquire the first posture sequence of the plurality of operating bodies and the second posture sequence of the plurality of intelligent controllers within the same time period.

[0063] In the implementation process, the same time interval d can be a 2 second interval, a 5 second interval, a 10 second interval, etc. Obtaining the movement trajectory in the same time period can avoid excessive cumulative errors between the first pose sequence and the second pose sequence.

[0064] In the embodiment of the present application, the first posture sequence of the plurality of operating bodies and the second posture sequence of the plurality of intelligent controllers are obtained in the same time period, so as to avoid excessive cumulative errors between the first posture sequence and the second posture sequence.

[0065] In some embodiments, the above step S120 "obtaining the first posture sequence of the plurality of operating bodies and the second posture sequence of the plurality of intelligent controllers in the same time period" can be implemented by the following steps:

[0066] Step 121: within a preset time period, simultaneously acquiring a first posture sequence of a plurality of operating bodies and a second posture sequence of a plurality of intelligent controllers based on a starting time;

[0067] During implementation, the first posture sequence of multiple operating bodies and the second posture sequence of multiple intelligent controllers can be obtained within a preset time period based on the starting time of the preset time period. For example, the first posture sequence of multiple hands and the second posture sequence of multiple intelligent rings can be obtained within a 5-second interval, starting from the position at the starting time of the 5-second interval.

[0068] or,

[0069] Step 122: intercepting a first posture sequence of a plurality of the operating bodies and a second posture sequence of a plurality of the intelligent controllers within the same time period.

[0070] During the implementation process, the first long pose sequence of the operating body within a period of time and the second long pose sequence of the intelligent controller within a period of time can be obtained first; then the first long pose sequence and the second long pose sequence within the same time period can be screenshoted to obtain the time-aligned first pose sequence and second pose sequence.

[0071] In the embodiment of the present application, within a preset time period, the first posture sequence of multiple operating bodies and the second posture sequence of multiple intelligent controllers are simultaneously obtained based on the starting time; or, the first posture sequence of multiple operating bodies and the second posture sequence of multiple intelligent controllers within the same time period are intercepted. In this way, in actual application, one of the above methods can be selected to obtain multiple first posture sequences and multiple second posture sequences aligned in the time domain.

[0072] In some embodiments, the above step S120 "obtaining a first posture sequence of the plurality of operating bodies and a second posture sequence of the plurality of intelligent controllers" is as follows: Figure 3 As shown, this can be achieved by following the steps below:

[0073] Step S310, obtaining video information including the multiple operating bodies;

[0074] In the implementation process, a camera device provided in an electronic device may be used to obtain video information including multiple operating bodies within a period of time, that is, continuous video frames. For example, a camera provided in a naked-eye 3D device may be used to obtain video information including multiple user hand gestures, that is, continuous video frames.

[0075] Step S320: determining a plurality of first posture sequences within the same time period based on the video information of the plurality of operating bodies;

[0076] During the implementation process, the acquired video frames can be preprocessed first, such as denoising, grayscale, binarization, etc., to improve the efficiency and accuracy of subsequent processing. Then, key points (such as corners, edges, contours, etc.) are detected in the video frame, and the detected key points are characterized to generate feature vectors or descriptors. The camera device is calibrated to obtain the intrinsic and extrinsic parameters of the camera. Based on the intrinsic and extrinsic parameters of the camera, a pose estimation algorithm based on feature matching is used, such as the N-point perspective pose solution algorithm (Perspective-n-Point, PnP), to estimate the pose of the operating body in each frame. Since there may be errors in the pose estimation of a single frame, the pose can be optimized through multi-frame information, such as using algorithms such as Kalman filtering and particle filtering. The pose estimation results of each frame are arranged in chronological order to form a first pose sequence.

[0077] Step S330: Acquire the second posture sequence sent by the multiple intelligent controllers within the same time period.

[0078] Here, the smart controller can obtain the second posture sequence using a sensor and a processor integrated in the smart controller that can obtain motion information. For example, a smart ring can obtain the second posture sequence using an integrated IMU and send the second posture sequence to a naked-eye 3D device that interacts with the smart ring.

[0079] In the embodiment of the present application, firstly, video information including multiple operating bodies is obtained; then, multiple first posture sequences in the same time period are determined based on the video information of the multiple operating bodies; and second posture sequences sent by multiple intelligent controllers in the same time period are obtained at the same time. In this way, the video information can be parsed to obtain multiple first posture sequences in a preset time period, and the second posture sequences sent by multiple intelligent controllers in the preset time period can also be obtained.

[0080] In some embodiments, the above step S130 "pairing the corresponding target operating body with the target intelligent controller based on the similarity between the first posture sequence and the second posture sequence" can be implemented by the following steps:

[0081] Step 131, obtaining similarities between a plurality of the first posture sequences and a plurality of the second posture sequences;

[0082] During implementation, a trajectory similarity calculation method may be used to evaluate the similarities between the plurality of first pose sequences and the plurality of second pose sequences.

[0083] Step 132, determining at least one group of posture sequences whose similarity is greater than a similarity threshold, wherein each group of posture sequences includes a target first posture sequence and a target second posture sequence;

[0084] Here, the larger the similarity value is, the higher the degree of matching between the two pose sequences in space and time, that is, the motion trajectories of the first pose sequence and the second pose sequence are closer or similar. In the implementation process, the similarity threshold can be set according to actual needs. At least one set of pose sequences with a similarity greater than the similarity threshold is determined.

[0085] For example, when it is determined that the similarity between a hand gesture and a smart ring gesture is greater than a similarity threshold, it can be determined that the user's hand and the smart ring have most likely experienced very similar motion paths or trajectories.

[0086] Step 133: pairing the target operating body corresponding to the target first posture sequence with the target intelligent controller corresponding to the target second posture sequence.

[0087] During implementation, a target operating body with a similar determined motion trajectory may be paired with a target intelligent controller.

[0088] In some embodiments, when it is determined that there is a group of operators and smart controllers that can be paired in the application scenario, a group of target operators and target smart controllers with the highest similarity values ​​can be further determined for pairing. For example, when it is determined that there is a scenario where a smart ring is controlled, a pairing of a smart ring and a hand can be determined.

[0089] In some embodiments, when it is determined that there are multiple sets of operators and intelligent controllers that can be paired in the application scenario, the target operators and target intelligent controllers in all sets of target posture sequences whose similarity is greater than a similarity threshold can be paired. For example, in a scenario where multiple smart rings are controlled, the pairing of multiple smart rings with hands can be determined.

[0090] In the embodiment of the present application, firstly, the similarity between multiple first posture sequences and multiple second posture sequences is obtained; then at least one group of posture sequences whose similarity is greater than a similarity threshold is determined; finally, the target operator corresponding to the target first posture sequence is paired with the target intelligent controller corresponding to the target second posture sequence. In this way, it is possible to use the preset similarity threshold to screen out the target intelligent controller and target operator that can be matched.

[0091] In some embodiments, after step 132 of "determining at least one set of pose sequences whose similarity is greater than a similarity threshold", pairing may also be performed through the following steps:

[0092] Step 134, determining a set of target pose sequences from at least one set of pose sequences whose similarity is greater than a similarity threshold;

[0093] Here, a group of posture sequences with the highest similarity can be determined as the target posture sequence; a group of posture sequences closest to the electronic device can also be determined as the target posture sequence; and a group of posture sequences that are matched first can also be determined as the target posture sequence.

[0094] During the implementation process, the above parameters such as similarity, distance and matching time may be comprehensively considered to determine a set of pose sequences as the target pose sequence.

[0095] Step 135: Pair the target operating body corresponding to the first target posture sequence in the target posture sequence with the target intelligent controller corresponding to the second target posture sequence.

[0096] For example, the hand with the most similar running trajectories can be paired with the smart ring; the hand closest to the naked-eye 3D device can be paired with the smart ring to more efficiently obtain the signal of the smart ring; the hand and smart ring that are matched earliest can also be paired to control the naked-eye 3D device using the smart ring with the highest matching sensitivity.

[0097] In the embodiment of the present application, a set of target posture sequences is first determined in at least one set of posture sequences whose similarity is greater than a similarity threshold; then the target operator corresponding to the target first posture sequence in the target posture sequence is paired with the target intelligent controller corresponding to the target second posture sequence. In this way, it is possible to determine a set of target posture sequences that can at least meet one of the following conditions: the highest matching degree, the closest distance to the electronic device, or the highest matching efficiency in at least one set of posture sequences whose similarity is greater than a similarity threshold, so as to efficiently control the electronic device using the intelligent controller corresponding to the target posture sequence.

[0098] In some embodiments, a CV system integrated in an electronic device can be used to record the hand posture sequence information of multiple operators in the scene, locate multiple ring controllers through appearance detection, and automatically start pairing when it is determined that the user appears within the camera range and the ring is activated, such as Figure 4 As shown, perform the following steps:

[0099] Step S410, obtaining multiple hand movement sequences and smart ring information sequences;

[0100] Here, the hand movement sequence can be recorded as t_cv; since the smart ring can use the set inertial measurement unit, the smart ring information sequence can be recorded as t_imu.

[0101] Step S420: Taking the position at the start time as the initial point in each time interval, obtain the hand movement sequence and smart ring information sequence in the time interval;

[0102] Here, the time interval d can be a 2-second interval, a 5-second interval, a 10-second interval, etc. Obtaining the movement trajectory in the same time period can avoid excessive cumulative errors of CV and IMU.

[0103] Step S430, determine the similarity between the cv trajectory and the smart ring IMU trajectory, and take the ones with similarity higher than the similarity threshold as candidate matches. If the matching pair is unique, the pairing is successful;

[0104] In the implementation process, the similarities between the cv trajectories {t_cv1, t_cv2, ...} and the smart ring IMU trajectories {t_imu1, t_imu2, ...} can be matched pairwise.

[0105] Set the similarity threshold according to actual needs, and select matches with similarities higher than the similarity threshold as candidate matches.

[0106] When it is determined that there is a unique pair of successfully matched cv trajectories and smart ring IMU trajectories, it is determined that the corresponding operating body (hand) and the smart ring are successfully matched.

[0107] Step S440: For the trajectories whose similarities all exceed the threshold similarity threshold, select the one with the highest matching degree as a pair.

[0108] In the implementation process, if there are multiple pairs of trajectories whose similarities all exceed the threshold similarity threshold, the trajectory pair with the highest matching degree can be used as a pair. Here, the matching degree can be determined based on the similarity threshold and the position information.

[0109] In the embodiment of the present application, firstly, a plurality of hand movement sequences and smart ring information sequences are obtained; then, in each time interval, the position at the start time is taken as the initial position, and the hand movement sequence and the smart ring information sequence in the time period are obtained; finally, the similarity between the cv trajectory and the smart ring IMU trajectory is determined, and the one with a similarity higher than the similarity threshold is used as a candidate match. If the matching pair is unique, the pairing is successful; for the trajectories whose similarities all exceed the threshold similarity threshold, the one with the highest match is selected as the pairing. In this way, a CV plus ring pairing mechanism can be provided in a multi-person and multi-ring scenario to realize the pairing between the hand and the smart ring, so as to further realize the control of the electronic device by the smart ring based on the pairing result.

[0110] Based on the foregoing embodiments, an embodiment of the present application provides a pairing device, which includes the modules included, each module includes each sub-module, each sub-module includes a unit, which can be implemented by a processor in an electronic device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0111] Figure 5 A schematic diagram of the structure of the pairing device provided in the embodiment of the present application is shown in FIG. Figure 5 As shown, the device 500 includes:

[0112] A first determination module 510 is used to determine that there are multiple operators and multiple intelligent controllers in the target image, and at least one target operator wears a target intelligent controller;

[0113] A first acquisition module 520 is used to acquire a first posture sequence of a plurality of the operating bodies and a second posture sequence of a plurality of the intelligent controllers;

[0114] The pairing module 530 is used to pair the corresponding target operating body with the target intelligent controller based on the similarity between the first posture sequence and the second posture sequence.

[0115] In some embodiments, the pairing device further includes a second determination module, a positioning module, and a second acquisition module, wherein the second determination module is used to determine the existence of multiple operating bodies through a computer recognition system; the positioning module is used to locate the existence of multiple intelligent controllers through appearance detection; the second acquisition module is used to determine that when a pairing instruction sent by the target intelligent controller is received, the target image is acquired to start pairing.

[0116] In some embodiments, the pairing device also includes a third determination module and a third acquisition module, wherein the third determination module is used to determine that there is at least a target intelligent controller among the multiple intelligent controllers that can interact with the electronic device; and the third acquisition module is used to obtain the pairing instructions of the target intelligent controller.

[0117] In some embodiments, the pairing device further includes a clearing module for clearing the pairing information of the target intelligent controller capable of interacting with the electronic device, so as to store updated pairing information after the pairing is completed.

[0118] In some embodiments, the first acquisition module 520 is further used to acquire a first posture sequence of a plurality of the operating bodies and a second posture sequence of a plurality of the intelligent controllers within the same time period.

[0119] In some embodiments, the first acquisition module 520 includes a first acquisition submodule or an interception submodule, wherein the first acquisition submodule is used to simultaneously acquire the first posture sequence of multiple operating bodies and the second posture sequence of multiple intelligent controllers based on the starting time within a preset time length; the interception submodule is used to intercept the first posture sequence of multiple operating bodies and the second posture sequence of multiple intelligent controllers within the same time period.

[0120] In some embodiments, the first acquisition module 520 includes a second acquisition submodule, a first determination submodule and a third acquisition submodule, wherein the second acquisition submodule is used to acquire video information including the multiple operating bodies; the first determination submodule is used to determine multiple first posture sequences within the same time period based on the video information of the multiple operating bodies; and the third acquisition submodule is used to acquire the second posture sequences sent by the multiple intelligent controllers within the same time period.

[0121] In some embodiments, the pairing module 530 includes a fourth acquisition submodule, a second determination submodule and a first pairing submodule, wherein the fourth acquisition submodule is used to obtain the similarity between multiple first posture sequences and multiple second posture sequences; the second determination submodule is used to determine at least one group of posture sequences whose similarity is greater than a similarity threshold, wherein each group of posture sequences includes a target first posture sequence and a target second posture sequence; the first pairing submodule is used to pair the target operating body corresponding to the target first posture sequence with the target intelligent controller corresponding to the target second posture sequence.

[0122] In some embodiments, the pairing module 530 also includes a third determination submodule and a second pairing submodule, wherein the third determination submodule is used to determine a set of target posture sequences from at least one set of posture sequences whose similarity is greater than a similarity threshold; and the second pairing submodule is used to pair the target operating body corresponding to the target first posture sequence in the target posture sequence with the target intelligent controller corresponding to the target second posture sequence.

[0123] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0124] It should be noted that in the embodiment of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable an electronic device (which can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific combination of hardware and software.

[0125] Correspondingly, an embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in a pairing method provided in the above embodiment are implemented.

[0126] Correspondingly, an embodiment of the present application provides an electronic device, Figure 6 A hardware entity diagram of an electronic device provided in an embodiment of the present application, such as Figure 6 As shown, the hardware entity of the device 600 includes: a memory 601 and a processor 602, wherein the memory 601 stores a computer program that can be run on the processor 602, and when the processor 602 executes the program, the steps in a pairing method provided in the above embodiment are implemented.

[0127] The memory 601 is configured to store instructions and applications executable by the processor 602, and can also cache data to be processed or processed by the processor 602 and various modules in the electronic device 600 (for example, image data, audio data, voice communication data, and video communication data), which can be implemented through flash memory (FLASH) or random access memory (Random Access Memory, RAM).

[0128] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0129] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.

[0130] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0131] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0132] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0133] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0134] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0135] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be essentially or partly reflected in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable an electronic device (which can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0136] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0137] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0138] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0139] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A pairing method, the method comprising: include: Determining that there are multiple operators and multiple intelligent controllers in the target image, and at least one target operator wears the target intelligent controller; Acquire a first posture sequence of a plurality of the operating bodies and a second posture sequence of a plurality of the intelligent controllers; Based on the similarity between the first posture sequence and the second posture sequence, the corresponding target operating body is paired with the target intelligent controller.

2. The method according to claim 1, further comprising: include: Determining the existence of a plurality of said operating bodies through a computer recognition system; Locating the presence of multiple intelligent controllers through appearance detection; When it is determined that a pairing instruction sent by the target intelligent controller is received, the target image is acquired to start pairing.

3. The method according to claim 2, further comprising: include: Determining that there is at least a target intelligent controller among the plurality of intelligent controllers that can interact with the electronic device; Obtain a pairing instruction of the target intelligent controller.

4. The method according to claim 3, further comprising: include: The pairing information of the target intelligent controller capable of interacting with the electronic device is cleared to store updated pairing information after the pairing is completed.

5. The method according to claim 1, wherein the first posture sequence of the plurality of operating bodies and the second posture sequence of the plurality of intelligent controllers are obtained. include: Acquire the first posture sequence of the plurality of operating bodies and the second posture sequence of the plurality of intelligent controllers within the same time period.

6. The method according to claim 5, wherein the first posture sequence of the plurality of operating bodies and the second posture sequence of the plurality of intelligent controllers are obtained within the same time period. include: Within a preset time period, simultaneously acquiring a first posture sequence of a plurality of the operating bodies and a second posture sequence of a plurality of the intelligent controllers based on a starting time; or, The first posture sequence of the plurality of operating bodies and the second posture sequence of the plurality of intelligent controllers within the same time period are intercepted.

7. The method according to claim 5, wherein the first posture sequence of the plurality of operating bodies and the second posture sequence of the plurality of intelligent controllers are obtained within the same time period. include: Acquiring video information including the multiple operating bodies; Determine a plurality of first posture sequences within the same time period based on the video information of the plurality of operating bodies; Acquire the second posture sequences sent by the multiple intelligent controllers within the same time period.

8. The method according to any one of claims 1 to 7, wherein the corresponding target operating body is paired with the target intelligent controller based on the similarity between the first posture sequence and the second posture sequence, include: Obtaining similarities between a plurality of the first posture sequences and a plurality of the second posture sequences; Determine at least one group of pose sequences having a similarity greater than a similarity threshold, wherein each group of pose sequences includes a target first pose sequence and a target second pose sequence; The target operating body corresponding to the target first posture sequence is paired with the target intelligent controller corresponding to the target second posture sequence.

9. The method of claim 8, after determining at least one set of pose sequences having a similarity greater than a similarity threshold, the method further include: Determine a set of target pose sequences from at least one set of pose sequences whose similarity is greater than a similarity threshold; The target operating body corresponding to the first target posture sequence in the target posture sequence is paired with the target intelligent controller corresponding to the second target posture sequence.

10. A pairing device, the device include: A first determination module is used to determine that there are multiple operators and multiple intelligent controllers in the target image, and at least one target operator wears a target intelligent controller; A first acquisition module is used to acquire a first posture sequence of a plurality of the operating bodies and a second posture sequence of a plurality of the intelligent controllers; A pairing module is used to pair the corresponding target operating body with the target intelligent controller based on the similarity between the first posture sequence and the second posture sequence.

Citation Information

Cited By

  • Interaction method, autostereoscopic device, and storage medium

    GB2700923A