Online continuous human behavior identification method based on Kinect

Abstract

The invention discloses an online continuous human behavior identification method based on Kinect, comprising the following steps: (a) extracting human skeleton information from an RGB-D image collected by Kinect, and calculating the normalized relative orientation feature of each joint; (b) carrying out online dynamic segmentation on a feature sequence through an online segmentation method based on feature sequence potential difference to get a gesture feature fragment and an action feature segment; (c) respectively extracting key gestures and atomic actions from the gesture feature fragment and the action feature segment obtained through segmentation; (d) carrying out online mode matching between the feature segments obtained through segmentation and key gestures or atomic actions obtained through offline training, and calculating the likelihood probability that the feature segments are identified as the key gestures or atomic actions of a kind of behavior; and (e) using a variable-length maximum entropy Markov model to identify human behaviors based on the likelihood probability calculated. Compared with the known algorithms, there is no need to detect the start and end time points of each human behavior in advance, and identification can be executed online and in real time.

Description

technical field [0001] The invention relates to the technical field of intelligent human-computer interaction and intelligent robot, in particular to a Kinect-based online continuous human behavior recognition method. Background technique [0002] Human beings will enter an aging society in the 21st century, and the development of service robots can make up for the serious shortage of young labor and solve social problems such as family services and medical services in an aging society. The International Federation of Robotics gives a preliminary definition of service robots: a service robot is a semi-autonomous or fully autonomous robot that can perform services that are beneficial to humans, but does not include equipment engaged in production; if a service robot can be intelligent with humans Friendly interaction, and being able to engage in some household service work according to people's behaviors in daily life, then the application of service robots in the household s...

AI Technical Summary

Problems solved by technology

Although there are several human behavior recognition algorithms for continuous human behavior sequences, these methods still "first detect the start and end time points of each behavior to achieve human behavior segmentation, and then perform human behavior recognition"

Images