Human motion local characteristic representation method and application in behavior identification thereof

A technology of local features and human movements, applied in the field of image recognition, can solve the problems of difficult movement change process, low recognition effect, qualitative interpretation of physical attributes of human movements, etc.

Inactive Publication Date: 2016-11-02
UNIV OF SHANGHAI FOR SCI & TECH
View PDF4 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the research found that in most feature representation methods, it is difficult to qualitatively explain the physical properties of human actions, and it is difficult to describe the change process of actions well.
Our further analysis found that different human actions are not only manifested in the difference in position information, but also in the energy characteristics of the joint point sequence. not very effective

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human motion local characteristic representation method and application in behavior identification thereof
  • Human motion local characteristic representation method and application in behavior identification thereof
  • Human motion local characteristic representation method and application in behavior identification thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The specific implementation manners of the present invention will be described below in conjunction with the accompanying drawings.

[0052] figure 1 is a schematic flow chart of the method for representing local features of human body movements in this embodiment.

[0053] The first step is to use Microsoft's Kinect SDK (kinect sdk for windows hardware and software) to obtain human body dynamic images and human skeletons. The skeleton is composed of 20 joint points and 13 line segments connecting joints, such as hands and necks , torso, left shoulder, left elbow, left palm, right shoulder, etc. The database used in this embodiment is Dataset-1200 (CAD-60) of Cornell University. The human skeleton model in the database is composed of 15 human skeleton joint points, and the specific order and numbers are shown in Table 1. Thus, the three-dimensional coordinates (x i,t ,y i,t ,z i,t ) information and calculate as follows:

[0054] Table 1 Joint number

[0055]

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of image processing and image identification, and particularly relates to a human motion local characteristic representation method and an application in behavior identification thereof. The human motion local characteristic representation method comprises the following steps that firstly kinetic energy of human bone joints, the position coordinates of the human bone joints, the direction change vectors of the human bone joints and posture potential energy of the human bone joints are extracted from the perspective of energy according to human behavior biological and kinematic characteristics so that a local characteristic combination matrix is constructed; and then dimension reduction is performed on the local characteristic matrix by utilizing K-means clustering and bag of word (BOW) characteristics are extracted, characteristic vectors used for behavior identification are formed through combination of human joint angle characteristics, and the characteristic vectors are applied to the field of human behavior identification so that the method has great effect through experimental verification.

Description

technical field [0001] The invention relates to a local feature extraction method based on three-dimensional space information of a human body in the field of image processing and image recognition, belonging to the field of image recognition. Background technique [0002] In recent years, with the widespread use of video equipment and 3D cameras, behavior recognition based on 3D information has received widespread attention and attention because of its small environmental impact. After searching the existing literature, it was found that Gu J. et al [Gu J, Ding X, Wang S, et al. Action and gait recognition from recovered3-D human joints [J]. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactionson, 2010, 40(4): 1021-1033.] It is believed that the three-dimensional space position sequence of human joint points can well describe the human body movement process, Junxia G. et al. [Junxia G, Xiaoqing D, Shengjin W, et al. al.Full body tracking-based human action ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/23G06F18/253
Inventor 王永雄曾艳
Owner UNIV OF SHANGHAI FOR SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products