Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect

Abstract

The invention provides a man-computer interaction method for an intelligent human skeleton tracking control robot on the basis of kinect. The man-computer interaction method includes the steps of detecting actions of an operator through a 3D depth sensor, obtaining data frames, converting the data frames into an image, splitting objects and background environments similar to a human body in the image, obtaining depth-of-field data, extracting human skeleton information, identifying different positions of the human body, building a 3D coordinate of joints of the human body, identifying rotation information of skeleton joints of the two hands of the human body, identifying which hand of the human body is triggered according to catching of changes of angles of the different skeleton joints, analyzing different action characteristics of the operator, using corresponding characters as control instructions which are sent to a robot of a lower computer, receiving and processing the characters through an AVR single-chip microcomputer master controller, controlling the robot of the lower computer to carry out corresponding actions, and achieving man-computer interaction of the intelligent human skeleton tracking control robot on the basis of the kinect. According to the method, restraints of traditional external equipment on man-computer interaction are eliminated, and natural man-computer interaction is achieved.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and relates to an intelligent robot human-computer interaction method, in particular to an intelligent robot human-computer interaction method based on kinect human skeleton tracking control. Background technique [0002] Human-computer interaction technology refers to the technology that realizes effective communication between humans and computers in a way that is convenient for people to use through computer input and output devices. Skeleton tracking technology is an important technology in the field of human-computer interaction. It has a wide range of application prospects in 3D animation production, online games, medical science, gesture capture and natural human-computer interaction environments. [0003] Keyboards, mice, and joysticks are traditional human-computer interaction devices, but they have certain limitations in terms of naturalness and friendliness in use. ...

AI Technical Summary

Problems solved by technology

[0003] Keyboards, mice, and joysticks are traditional human-computer interaction devices, but they have certain limitations in terms of naturalness and friendliness in use.

Images