Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect

An intelligent robot, human-computer interaction technology, applied in the field of human-computer interaction

Inactive Publication Date: 2013-11-20
NORTHWEST NORMAL UNIVERSITY
View PDF4 Cites 77 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Keyboards, mice, and joysticks are traditional human-computer interaction devices, but they have certain limitations in terms of naturalness and friendliness in use.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect
  • Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect
  • Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0044] Initialize the kinect device, set the camera elevation angle, open the color stream, depth stream and skeleton stream, the resolution of color information processing is 640×480, the resolution of depth information processing is 320×240, and the sampling rate is 30 frames per second; through Video stream, depth stream and skeleton stream get the image type, start VS2010 on the PC at the same time, compile the program, run the program after compiling, and display the human skeleton tracking MFC programming interface. Then turn on the main control switch of the intelligent robot to power on the robot, and at the same time power on the wireless serial port receiving and sending modules. The operator stands between 1.2 meters and 3.5 meters away from the camera. When the MFC programming interface detects the operator's human skeleton node , the operator stretches out his hands, the PC receives the trigger signal of both hands, and sends the character "C" through the wirel...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a man-computer interaction method for an intelligent human skeleton tracking control robot on the basis of kinect. The man-computer interaction method includes the steps of detecting actions of an operator through a 3D depth sensor, obtaining data frames, converting the data frames into an image, splitting objects and background environments similar to a human body in the image, obtaining depth-of-field data, extracting human skeleton information, identifying different positions of the human body, building a 3D coordinate of joints of the human body, identifying rotation information of skeleton joints of the two hands of the human body, identifying which hand of the human body is triggered according to catching of changes of angles of the different skeleton joints, analyzing different action characteristics of the operator, using corresponding characters as control instructions which are sent to a robot of a lower computer, receiving and processing the characters through an AVR single-chip microcomputer master controller, controlling the robot of the lower computer to carry out corresponding actions, and achieving man-computer interaction of the intelligent human skeleton tracking control robot on the basis of the kinect. According to the method, restraints of traditional external equipment on man-computer interaction are eliminated, and natural man-computer interaction is achieved.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and relates to an intelligent robot human-computer interaction method, in particular to an intelligent robot human-computer interaction method based on kinect human skeleton tracking control. Background technique [0002] Human-computer interaction technology refers to the technology that realizes effective communication between humans and computers in a way that is convenient for people to use through computer input and output devices. Skeleton tracking technology is an important technology in the field of human-computer interaction. It has a wide range of application prospects in 3D animation production, online games, medical science, gesture capture and natural human-computer interaction environments. [0003] Keyboards, mice, and joysticks are traditional human-computer interaction devices, but they have certain limitations in terms of naturalness and friendliness in use. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T17/00
Inventor 宋海声成科谭等泰王全州裴东赵学深孔永胜杨蕾安占福
Owner NORTHWEST NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap