Static gesture recognizing method and system for AR auxiliary maintenance
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A gesture recognition and augmented reality technology, applied in the field of gesture recognition, can solve problems that affect the flexibility of manual operation and the efficiency of maintenance support
Inactive Publication Date: 2016-09-21
ORDNANCE TECH RES INST OF THE GENERAL ARMAMENT DEPT PLA
View PDF3 Cites 2 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0003] At present, many augmented reality assisted maintenance systems use auxiliary means such as wearing color markers or data gloves to recognize hand movements in order to
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0062] Embodiment 1, a static gesture recognition method for augmented reality assisted maintenance.
[0063] Such as figure 1 As shown, the static gesture recognition method for augmented reality assisted maintenance provided by the present invention includes the following steps:
[0064] S1. Collect video images and perform frame separation to obtain test samples.
[0065] Utilize video camera to collect video image under the background of camouflage outfit or circuit board and carry out frame separation to it, make all the image frames that contain and not contain gesture information be separated from video image, form image frame sequence, collect 1000 in the present embodiment image as a test sample to be processed.
[0066] S2. Perform gesture and background segmentation on each frame of image in the test sample.
[0067] Segment the gesture and background in the image, specifically: according to the skin color range method, judge each pixel in the image one by one; i...
Embodiment 2
[0110] Embodiment 2, a static gesture recognition system for augmented reality assisted maintenance.
[0111] Such as Figure 5 As shown, the static gesture recognition system for augmented reality assisted maintenance provided by the present invention includes an image acquisition module 1 , a gesture segmentation module 2 , a vector construction module 3 , a vector normalization module 4 and a gesture recognition module 5 .
[0112] The image acquisition module 1 is connected with the gesture segmentation module 2, which is used to collect video images through a camera, and perform frame separation on the collected video images to obtain several frames of images, and these images constitute test samples. When the image acquisition module 1 collects video images through a camera, it generally uses a camouflage outfit or a circuit board as a background.
[0113] The gesture segmentation module 2 is connected with the image acquisition module 1 and the vector construction modu...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The invention provides a static gesture recognizing method and system for AR auxiliary maintenance. The method specifically comprises the following steps of: acquiring a video image and performing frame separation to obtain a test sample; separating a gesture from a background of an image in the test sample by using a skin color range method; creating a static gesture feature input vector corresponding to the image in the test sample and normalizing the vector; inputting the normalized the vector into a support vector machine and enabling a classifier in the support vector machine to recognize the gesture for acquiring an optimal classification solution of the static gesture. The method forms the eight-dimension composite characteristic input vector of the static gesture by the seven-order invariant moment of Hu and image normalization moment of inertia (NMI) so as to achieve better robustness for image translation, rotation, and zooming, fully takes account of the influence of illumination, background, and gesture orientation, increases the accuracy of training samples in the support vector machine, and increases recognition precision.
Description
technical field [0001] The invention relates to the technical field of gesture recognition, in particular to a static gesture recognition method and system for augmented reality assisted maintenance. Background technique [0002] At present, the usability of the augmented reality assisted maintenance system is not only reflected in its robustness, but also in its ability to interact with users. The development direction of the augmented reality assisted maintenance system should try to use gestures or direct interaction with human behavior instead of Use an indirect input device. This can make the maintenance process closer to nature, more realistic and rich, and provide convenient conditions for efficient equipment design, testing, repair, maintenance, etc., so as to realize user-centered human-computer interaction. Therefore, it is of great significance to carry out research on static gesture recognition technology for augmented reality assisted maintenance system. [00...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/113G06F18/2411
Inventor 李欣张勇周斌马东玺王伟明赵守伟
Owner ORDNANCE TECH RES INST OF THE GENERAL ARMAMENT DEPT PLA
Login to view more 
Login to view more