Gesture interaction method and device for helmet-mounted display
A helmet display and interactive device technology, which is applied in the input/output process of user/computer interaction, instrument, and data processing input/output process, etc., can solve the problems of small gesture set, low accuracy rate, and difficulty in recognizing gesture information. , to achieve the effect of small algorithm complexity, simple device and low cost
Active Publication Date: 2017-02-22
深圳市龙芯威半导体科技有限公司
View PDF2 Cites 5 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, it is relatively difficult to completely recognize gesture information only by visual analysis, so the set of gestures that can be recognized by this method is small and the accuracy rate is not high
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0047] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.
[0048] When the user is interacting with the human-computer, since the texture of the hand is very little, the accuracy of gesture detection or recognition using the image captured by the ordinary camera is low. The invention provides a gesture interaction method and device for a head-mounted display. Install two identical cameras and a laser transmitter on the helmet display, the laser transmitter is installed in the center of the helmet display, and the cameras are located on both sides of the laser transmitter and are completely symmetrical. The role of the laser emitter is to add laser scattering spots to the hand of the user to be photographed to facilitate subsequent image processing. The two cameras capture the left view and the right view of the user's hand with laser scattering spots respectively, and then perform gesture recognition ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a gesture interaction method and device for a helmet-mounted display. Two cameras with the same type and a laser transmitter are installed on the helmet-mounted display, the laser transmitter is installed in the center of the helmet-mounted display, and the cameras are located at the two sides of the laser transmitter and are bilaterally symmetric; the laser transmitter is used for adding laser scattering spots for a target, and the two cameras are used for shooting a left view and a right view, added with the laser scattering spots, of a hand of a user respectively and then conducting gesture recognition in an image processing mode. Accordingly, by adding the laser scattering spots for the hand of the user, an original hand area with spare lines becomes an area with rich lines; plane information and depth information of the hand are calculated by adopting a simple and efficient algorithm, and then gesture motion interaction recognition is conducted through the information. The adopted device is simple and low in cost and algorithm complexity, can recognize 27 gesture motion categories and has a very good practical value.
Description
technical field [0001] The invention relates to the technical field of augmented reality and computer vision processing, in particular to a gesture interaction method and device for a head-mounted display. Background technique [0002] Augmented reality is a new research direction developed on the basis of virtual reality in recent years, which has the characteristics of combination of virtual reality and real-time interaction. As the most commonly used display device in virtual reality and augmented reality, the head-mounted display can be connected to the host alone to receive the 3DVR graphics signal from the host, and the image source and other signals will be amplified and displayed in front of the wearer. With the increasing application of head-mounted displays in the fields of business, entertainment and visualization, how to effectively realize human-computer interaction when wearing a head-mounted display has become a hot research topic. [0003] Gesture is a very ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00G06K9/46G06K9/62
CPCG06F3/017G06V40/28G06V10/50G06F18/22G06F18/2411
Inventor 罗文峰
Owner 深圳市龙芯威半导体科技有限公司