Dynamic gesture recognition method, gesture interaction method and interaction system

A dynamic gesture and dynamic technology, applied in the field of computer vision, can solve the problems of high computing load, complicated installation, cumbersome process, etc., and achieve the effect of accurate and efficient human-computer interaction, improved speed and precision, and simple and fast processing process

Active Publication Date: 2021-06-11
OMNIVISION SENSOR SOLUTION (SHANGHAI) CO LTD
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method is limited by the influence of the data frame rate, and the response time is long. At the same time, due to the many steps and cumbersome process, this method has a high computational load and high power consumption during algorithm processing.
In addition, the traditional human-computer interaction system needs to be integrated with the hardware platform, and the installation is more complicated

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic gesture recognition method, gesture interaction method and interaction system
  • Dynamic gesture recognition method, gesture interaction method and interaction system
  • Dynamic gesture recognition method, gesture interaction method and interaction system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0036] In recent years, Dynamic Vision Sensor (DVS) has received more and more attention and applications in the field of computer vision. DVS is a biomimetic visual sensor that mimics the human retina based on spike-triggered neurons. The sensor has a pixel unit array composed of multiple pixel units, and each pixel unit will respond and record the area where the light intensity changes rapidly only when it senses a change in ligh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic gesture recognition method, a gesture interaction method and a gesture interaction system. The interactive system comprises a dynamic vision sensor, which is suitable for triggering an event based on relative movement of an object in a field of view and the dynamic vision sensor and outputting event data flow to a hand detection module; a hand detection module which is suitable for processing the event data flow so as to determine the initial position of the hand; a hand tracking module which is suitable for determining a series of state vectors indicating the hand motion state in the event data stream based on the hand initial position; a gesture recognition module which is suitable for constructing an event cloud based on event data pointed by the obtained state vector, and processing the event cloud by using a neural network based on point cloud to recognize a gesture category; and an instruction response module which is suitable for executing a corresponding operation instruction based on the recognized gesture category. The invention also discloses the corresponding computing equipment.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a human-computer interaction method based on dynamic gesture recognition. Background technique [0002] Human-computer interaction system completes information management, service and processing functions for people to the greatest extent by studying the mutual understanding and communication between humans and computers. From the initial interaction based on traditional hardware devices, such as mouse and keyboard, to the current human-computer interaction system based on computer vision, the development of human-computer interaction is very rapid. [0003] Among them, human-computer interaction systems based on computer vision typically include human-computer interaction based on speech recognition, the most representative of which is Siri launched by Apple; human-computer interaction based on motion recognition, the most representative of which is Microsoft's Kinect; ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/02G06F3/01
CPCG06N3/02G06F3/017G06V40/28G06F18/24Y02D10/00
Inventor 施顺顺武斌蒋睿王沁怡张伟宫超
Owner OMNIVISION SENSOR SOLUTION (SHANGHAI) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products