Gesture interaction method and terminal

An interaction method and gesture technology, applied in the field of human-computer interaction, can solve the problems of gesture false detection and missed detection, low robustness of the algorithm, and the accuracy of gesture interaction needs to be improved, so as to improve user experience and reduce false detection and missed detection The probability of detection, the effect of improving accuracy and robustness

Pending Publication Date: 2020-05-15
QINGDAO PICO TECH CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The key to gesture interaction is gesture recognition. At present, gesture recognition is mostly based on traditional image processing methods to distinguish the hand fr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture interaction method and terminal
  • Gesture interaction method and terminal
  • Gesture interaction method and terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that the present application can be more thoroughly understood, and the scope of the present application can be fully conveyed to those skilled in the art.

[0020] figure 1 A schematic flowchart showing a gesture interaction method according to an embodiment of the present application, see figure 1 , the gesture interaction method of this embodiment includes the following steps:

[0021] Step S101, during a gesture interaction process, the user's gesture is photographed by a camera to obtain an original image, and the original image includes an RGB image;

[0022] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a gesture interaction method and a terminal, and the gesture interaction method comprises the steps: photographing a gesture of a user through a camera in a one-time gesture interaction process, and obtaining an original image which comprises an RGB image; performing hand detection and gesture recognition on the RGB image by using a pre-trained deep neural network to obtaina first gesture recognition result; performing gesture analysis and confirmation based on the first gesture recognition result of each frame of RGB image in the multiple frames of RGB images to obtain a second gesture recognition result; triggering to execute an operation corresponding to the second gesture recognition result to complete gesture interaction. According to the embodiment of the invention, the gesture is detected and recognized by adopting the deep neural network, so that the probability of false detection and missing detection is reduced, the accuracy and robustness of gesturerecognition and gesture interaction are improved, and the user experience is improved.

Description

technical field [0001] The present application relates to the technical field of human-computer interaction, and in particular to a gesture interaction method and a terminal. Background technique [0002] With the development of technology, gesture interaction has been widely used in human-computer interaction fields such as mobile terminal operation, access control system, and remote control. The key to gesture interaction is gesture recognition. At present, gesture recognition is mostly based on traditional image processing methods to distinguish the hand from the background. False detection and missed detection are serious, the robustness of the algorithm is low, and the accuracy of gesture interaction needs to be improved. Contents of the invention [0003] In view of the above problems, the present application is proposed to provide a gesture interaction method and a terminal that overcome the above problems or at least partially solve the above problems. [0004] A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00G06N3/04
CPCG06F3/017G06V40/117G06V40/113G06N3/045
Inventor 孙飞
Owner QINGDAO PICO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products