Human-computer interaction method and device for multi-person gesture based on kinect

A human-computer interaction and gesture technology, applied in the field of human-computer interaction, can solve the problems of clumsy operation and inability to see clearly, and achieve the effect of natural and fast operation.

Active Publication Date: 2019-01-04
TSINGHUA UNIV
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For a large touch screen with a size of up to 60 inches or even 100 inches, when the operator is operating, because

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-computer interaction method and device for multi-person gesture based on kinect
  • Human-computer interaction method and device for multi-person gesture based on kinect
  • Human-computer interaction method and device for multi-person gesture based on kinect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0034] The following describes the Kinect-based multi-person gesture human-computer interaction method and device according to the embodiments of the present invention with reference to the accompanying drawings. First, the Kinect-based multi-person gesture human-computer interaction method according to the embodiments of the present invention will be described with reference to the accompanying drawings.

[0035] figure 1 It is a flowchart of a Kinect-based multi-person gesture human-computer interaction method according to an e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-person gesture human-computer interaction method and device based on Kinect, wherein, the method comprises the following steps: acquiring color image and depth image ofa scene through a Kinect camera, and acquiring human joint position and facial characteristic parameters of an operator in the scene; according to the human joint position and facial characteristic parameters, the cursor positions of operator's hands being obtained by light propagation along the straight line; the palm region image of the operator being segmented from the color image according tothe joint position of the human body, and the operation instructions being recognized and classified by a pre-trained gesture classification model. The method can be operated naturally and quickly without the help of other external equipments and adopts contactless interaction mode. The method and device can be used in hospital, scientific research and other special scenes, and can be used by more than one person at the same time, so as to meet the more complex interaction requirements in the future.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction, in particular to a Kinect-based multi-person gesture human-computer interaction method and device. Background technique [0002] Human-computer interaction is the exchange of information between humans and computers, and information establishes interactions between humans and computers. In the past, human-computer interaction was mainly computer-centric, such as command line, graphical user interface and other interactive methods. People can only interact with computers through keyboards, mice, touch screens and other methods. Now, more novel and interactive forms that conform to the natural interaction of human beings are becoming more and more mature. These new technologies make the competition between humans and computers closer and can improve their interaction efficiency. Human-computer interaction has also experienced the transformation and development from command line,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06F3/01G06N3/08
CPCG06F3/017G06N3/08G06V40/28G06V40/168G06F18/214
Inventor 陶彦博阮松波梁斌
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap