Man-machine interaction method based on hand action catch
A human-computer interaction and hand technology, which is applied in the field of visual measurement technology and computer, can solve the problems of high price, limited communication lines, complicated data gloves and equipment, etc., and achieve the effect of simple structure and low cost.
Inactive Publication Date: 2010-08-11
TIANJIN UNIV
View PDF4 Cites 31 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] The purpose of the present invention is to use two-dimensional information for traditional human-computer interaction (traditional mouse) to carry out human-computer interaction, which is not suitable for new display technologies (such as 3D projection, three-dimensional display), and the data glove equipment is complicated, expensive and expensive. Due to the lack of communication line constraints, a human-computer interaction method based on hand behavior capture is proposed, that is, the visual mouse
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0025] The invention provides a human-computer interaction method using a camera instead of a special optical fiber sensor or piezoelectric sensor, which can realize the acquisition of three-dimensional information of the operator's hand. It only needs to paste specific marks on the back of the hand and fingertips, and adopts a non-contact information measurement method to get rid of the shackles of gloves and communication lines, improving the comfort and freedom of the operator's hands. The present invention has been able to complete the basic functions of the traditional mouse, that is, the mouse control method based on hand behavior capture, which can be used together with the mouse or independently without the mouse, and can fully realize various operations on the computer. Experimental test results are ideal.
[0026] The present invention will be further described below in conjunction with accompanying drawing and example.
[0027] The peripheral equipment of the prese...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention belongs to a technology of vision measurement and the technical field of computers and relates to a man-machine interaction method based on hand action catch. The man-machine interaction method comprises the following steps of: adhering special marks to two different parts of a hand and arranging the hand into a visual field of a camera; carrying out program initialization comprising initializing video configuration and reading a mark sample database and a camera parameter; obtaining a video image, probing the marks and identifying different mark samples; calculating a three-dimensional coordinate of a probed mark center point in a mark coordinate system; and controlling a mouse based on variation of coordinate values of different marks. The invention realizes basic functions of the mouse by adopting three-dimensional information, has the advantages of simple structure, low cost and the like, gets rid of restraint of a communication wire by adopting non-contact measurement, can be used for a stereo vision system, a virtual reality system and an augmented reality system, develops civil products, and also provides a new technology for developing novel man-machine interaction mode and control mode.
Description
technical field [0001] The invention relates to a method for realizing human-computer interaction by capturing hand behavior, and belongs to the fields of visual measurement technology and computer technology. Background technique [0002] Limited by mainstream display devices and application software, the traditional human-computer interaction method is usually an operation limited to a two-dimensional plane. With the introduction of concepts such as stereo vision, virtual reality, and augmented reality, users prefer a more natural way to interact and interact with operating objects in a more imaginative virtual environment, resulting in "immersion" equivalent to The feeling and experience in the real environment, the research of data glove technology has been developed and applied. The data glove can track the user's flexible gestures and spatial orientation, so that the operator can naturally transfer his consciousness to the computer. Some research institutions at home...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F3/01
Inventor 何明霞宁福星李萌
Owner TIANJIN UNIV