Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for realizing non-contact virtual mouse based on gesture recognition

A gesture recognition and virtual mouse technology, applied in the field of human-computer interaction, can solve problems such as poor real-time performance, and achieve the effects of good real-time performance, high efficiency and strong real-time performance

Inactive Publication Date: 2019-01-11
CHANGCHUN UNIV OF SCI & TECH
View PDF1 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the problem of poor real-time performance of the existing non-contact human-computer interaction mode, the present invention is mainly based on gesture recognition of monocular vision, starting from two aspects of gesture segmentation and gesture expression, and proposes a non-contact virtual mouse based on gesture recognition. The implementation method is to realize effective mouse events by combining mouse operations, so as to realize effective control of the computer, and has the advantages of strong real-time performance and high efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for realizing non-contact virtual mouse based on gesture recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0017] Such as figure 1 Shown, the realization method of the non-contact virtual mouse based on gesture recognition, the steps of this method are as follows:

[0018] Step 1, the input of the video stream is realized by combining the OPENCV video processing library. The specific operation is to configure the OPENCV2.3.1 visual library on MicrosoftVisual Studio 2010, and run the software program to start the camera itself to obtain the video stream.

[0019] In step 2, the software program detects the interactive gesture for each frame of image and extracts the key frames satisfying the conditions to obtain the frame image.

[0020] Step 3: Gesture segmentation is required to obtain a complete gesture image from the frame image. First, use the skin color extraction of the dual color space of HSV and YCgCr to remove the background non-skin color area to obtain...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method for realizing the non-contact virtual mouse based on gesture recognition belongs to the technical field of human-computer interaction. In order to solve the problem of poor real-time performance of the existing non-contact human-computer interaction mode, the method comprises the following steps: obtaining video data stream by using a camera; intercepting the video stream and extracting frame images; separating a gesture from the video signal frame image; extracting model characteristic parameters for gesture analysis and recognition, classifying gestures according to model parametersand generating gesture descriptions according to specific needs; driving related application according to a mouse operation event. The method has the advantages of instantaneity and high efficiency,and can control the computer in non-contact state with gesture motion as input signal.

Description

technical field [0001] The invention relates to a method for realizing a virtual mouse device, in particular to a method for realizing a non-contact virtual mouse based on gesture recognition, and belongs to the technical field of human-computer interaction. Background technique [0002] At present, the mouse is one of the main interfaces for us to "communicate and communicate" with the computer, but this communication method is far from meeting our requirements. We hope to have a more concise, intelligent and humanized human-computer interaction method. The computer collects video signals of human beings in front of the computer in a non-contact manner, and uses the relevant theories of computer vision to analyze the captured video signals, so as to distinguish human actions, understand human intentions and realize human desired operations, that is, we hope that computers Can "understand" us as much as possible. [0003] Gesture is a natural, intuitive and easy-to-learn me...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/0354
CPCG06F3/017G06F3/03543
Inventor 岳丹洪雨城寇艳强魏红梅高晨皓王冠群李彦黎
Owner CHANGCHUN UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products