Gesture recognition method and device based on hyperspectral imaging

A hyperspectral imaging and gesture recognition technology, applied in the field of gesture recognition devices based on hyperspectral imaging, can solve the problems of insufficient accuracy and validity of the recognition system, and achieve the improvement of accuracy and validity, contrast enhancement, elimination of occlusion or dark spot effect

Active Publication Date: 2019-01-11
HEREN KEJI SHENZHEN LLC
View PDF8 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem of insufficient accuracy and effectiveness of the recognition system based on visible light in the prior art, the present invent

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture recognition method and device based on hyperspectral imaging
  • Gesture recognition method and device based on hyperspectral imaging
  • Gesture recognition method and device based on hyperspectral imaging

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] see Figure 1 to Figure 5 As shown, a gesture recognition method based on hyperspectral imaging disclosed in this embodiment mainly includes the following steps S100 to S400:

[0039] S100. Using a hyperspectral imaging system to collect an image of the gesture under the combined illumination of a visible light source and an infrared light source, to obtain a hyperspectral image.

[0040] Step S100 such as figure 2 As shown in the figure, the user's hand is in an environment with background influence, and the visible light source and the infrared light source are used to irradiate together, and then the image is collected by the hyperspectral imaging system to obtain a hyperspectral image (that is, an image with multiple channels).

[0041] S200. Perform target feature fusion processing on the hyperspectral image to form a single-channel image.

[0042] Step S200 is the same as figure 2 As shown, it includes: executing the matching mechanism of the images of differ...

Embodiment 2

[0053] With the development of smart display devices in the direction of interactive technology, there are currently many TVs or computers that can be controlled by gestures, including channel switching, volume adjustment, menu settings, or characters on the screen. or the movement of objects, etc. A gesture recognition method based on hyperspectral imaging disclosed in Embodiment 2 will take the gesture recognition of this type of intelligent display device as an example, collect the image information displayed by the gesture image in the visible light band and the infrared light band, and pass the image target Feature fusion processing improves the accuracy and effectiveness of its recognition.

[0054] see Figure 6 , a hyperspectral imaging-based gesture recognition method disclosed in Embodiment 2 mainly includes the following steps S110 to S710:

[0055] S110. The smart display device is initialized, and the hyperspectral imaging system, visible light source and infrar...

Embodiment 3

[0064] Many electronic games support somatosensory operations. In the game scene, a hyperspectral imaging-based gesture recognition method in Embodiment 3 can be used to capture video streams of user hand movements using a hyperspectral system (hyperspectral camera). ; For each frame of video, first remove the frequency band pictures with low brightness, then use SVD to reduce the data size, and then use the convolutional neural network algorithm to identify and select the best classification; if the ambient light is too dark, then Images in the visible light band may be eliminated; after SVD processing, more image information in the non-visible light band will be retained, the input characteristics of the convolutional neural network algorithm will be more obvious, and the recognition accuracy will be higher.

[0065] Such as Figure 7 As shown, a gesture recognition method based on hyperspectral imaging disclosed in Embodiment 3 mainly includes the following steps S120 to S7...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a gesture recognition method and device based on hyperspectral imaging, wherein the gesture recognition method comprises: acquiring an image of a gesture under common illumination of a visible light source and an infrared light source through a hyperspectral imaging system to obtain a hyperspectral image; The channel hyperspectral image is merged with the target feature toform a single-channel image; the single-channel image is denoised to obtain a denoised image; the denoised image is identified by an image recognition and motion tracking algorithm to obtain a gesturerecognition result. The invention can simultaneously collect the gesture image information of the visible light band and the infrared light band, and effectively combine the target features of the multi-channel hyperspectral image in the gesture recognition, so that the target feature area contrast is enhanced, thereby effectively performing image segmentation and extracting the hand The contourinformation is used for subsequent gesture recognition, which helps to improve the accuracy and effectiveness of gesture recognition.

Description

technical field [0001] The invention belongs to the technical field of gesture recognition, in particular to a gesture recognition method based on hyperspectral imaging, and to a gesture recognition device based on hyperspectral imaging. Background technique [0002] In computer science, gesture recognition is the subject of using mathematical algorithms to recognize human gestures. Users can use simple gestures to control or interact with devices, allowing computers to understand human behavior. Its core technology is gesture segmentation algorithm, gesture analysis algorithm and gesture recognition algorithm. [0003] With the continuous maturity of image recognition and motion tracking technologies, more and more devices can be operated and interacted with by gestures. Compared with traditional mouse and keyboard input, gesture operation is more convenient, the interaction types are more diverse, and the interaction process is more intuitive. A variety of commercial pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/28G06N3/045
Inventor 王星泽李梓彤蒲庆舒远阮思纯徐炜文
Owner HEREN KEJI SHENZHEN LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap