Gesture image key frame extraction method based on image similarity

A technology of image similarity and extraction method, applied in instruments, character and pattern recognition, computer parts and other directions, can solve the problems of missed detection of key frames, redundancy of key frames, etc., to enhance the expression ability, improve the accuracy, reduce the effect of quantity

Active Publication Date: 2019-09-17
康旭科技有限公司
View PDF7 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the problems of key frame redundancy and key frame missed detection, the present invention proposes a method for extracting key frames of gesture images based on image similarity, which is a video key frame extraction method for sign language videos with small movements. method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture image key frame extraction method based on image similarity
  • Gesture image key frame extraction method based on image similarity
  • Gesture image key frame extraction method based on image similarity

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] The present invention will be further described below in conjunction with drawings and embodiments.

[0063] The present invention is mainly aimed at the key frame extraction situation in the gesture video. Since the recognition object of the present invention is a self-defined gesture action, a dynamic gesture video database is self-built in the specific implementation. Part of the data sets used in the specific implementation are as follows: figure 2 As shown, the figure shows a partial gesture video frame image converted from one of the gesture videos, and the image is saved in .jpg format, and the final picture size is 1280×720.

[0064] Such as figure 1 As shown, the method of the present invention first converts the gesture video into a gesture video frame image, detects the gesture target area through the Mobilenet-SSD target detection model, classifies the gesture images according to the marked gestures, and divides the gesture images into static gesture image ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a gesture image key frame extraction method based on image similarity. The method comprises the steps of firstly, converting an input gesture video into a video frame image; classifying the video frame images into the static gesture images and the dynamic gesture images by adopting a Mobilenet-SSD target detection model; for the dynamic gesture image, adopting the cosine similarity to judge an image key frame; for the static gesture image, firstly adopting the cosine similarity for pre-extracting the key frame, then using a VGG16 network model for extracting the abstract features, carrying out the space gradient calculation, and according to the gradient difference of two adjacent frames of images, setting a self-adaptive threshold value to complete the judgment of the final key frame of the static image. According to the method, the problems of missing detection and redundancy of the video key frames are effectively solved, and by adopting the VGG-16 network model, the expression capability of the image is greatly enhanced, and the pre-extracted static gestures can be extracted again, so that the number of the static gesture key frames is reduced.

Description

technical field [0001] The invention belongs to a key frame extraction method, in particular to a gesture image key frame extraction method based on image similarity. Background technique [0002] Gesture video key frame extraction is a key step in the dynamic gesture recognition process and an important issue in video structural analysis. Key frame extraction for gesture video reduces data complexity, improves the real-time performance of sign language recognition algorithms, and ensures key frames The extraction effect is an important condition for accurate recognition of sign language. How to determine the action key frames in sign language videos is always a difficult point, mainly because the range of gesture changes is relatively small, it is not easy to determine key frames, and key frame redundancy is prone to occur when key frames are extracted. At present, the common gesture segmentation techniques include video segmentation method, first and last frame and middle...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/113G06V40/28G06V20/48G06V20/46G06F18/22
Inventor 田秋红杨慧敏包嘉欣李霖烨
Owner 康旭科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap