Intelligent interactive gesture control method and device

A technology of gesture control and intelligent interaction, applied in the input/output of user/computer interaction, neural learning method, input/output process of data processing, etc. problem, to achieve the effect of good interaction, strong participation and improved efficiency

Pending Publication Date: 2021-12-03
ZHEJIANG UNIV OF FINANCE & ECONOMICS
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Moreover, the non-contact control technology has been applied but has not been fully promoted, and the development prospect is good.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent interactive gesture control method and device
  • Intelligent interactive gesture control method and device
  • Intelligent interactive gesture control method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] see figure 1 , is an intelligent interactive gesture control method, comprising the following steps:

[0032] S10, gesture capture: the user makes a gesture in front of the camera within 2-4 seconds, and captures the gesture through the camera;

[0033] S20, Gesture training: collect different control gestures, train personalized gestures, increase the type and number of gestures;

[0034] S30, Gesture recognition: Capture the viewing screen in real time through the camera, recognize and capture the gesture, compare the gesture data after training that has been entered into the system, and obtain the gesture result;

[0035] S40, interactive control: the recognized gestures are controlled to obtain their corresponding control effects through interactive control, and human-computer interactive control is realized.

[0036] During the gesture recognition process, it displays the recognition rate, recognition effect and information about whether the recognition is succes...

Embodiment 2

[0042] On the basis of the above-mentioned embodiments, the one-to-one correspondence between gesture actions and interactive control can be set as follows: the left and right sliding of the whole palm corresponds to ppt left and right page turning, and the video moves forward and backward; Pushing forward corresponds to zooming out of webpages and pictures, and shrinking backward corresponds to zooming in on webpages and pictures; flipping the left and right of the whole palm corresponds to rotating the picture left and right; keeping all five fingers together corresponds to exiting and pausing, and pinching five fingers together corresponds to grabbing files. Opening corresponds to letting go; shaking hands of the whole palm corresponds to screenshots and screen recordings; clockwise and counterclockwise rotation of the whole palm to draw circles corresponds to sliding up and down in pdf and word; clicks of the index finger correspond to click events of the mouse; left and rig...

Embodiment 3

[0044] On the basis of the above examples, see figure 2 , gesture training includes the following steps:

[0045] S21, data collection: forming a corresponding gesture picture set from the gesture movement process captured by the camera frame by frame;

[0046] S22, data analysis: Preprocess the gesture pictures to achieve standardization, through four steps: random cropping, denoising, skin color detection, binarization, and morphological processing: random cropping unifies pictures of different sizes into a size of 100×140 , for subsequent processing; denoising is to achieve the elimination of image noise and enhance the effect of the image. The present invention uses a bilateral filter, which considers the spatial relationship and grayscale relationship of the image, and uses the spatial Gaussian weight and grayscale similarity at the same time Gaussian weight ensures that the boundary will not be blurred; skin color detection and binarization use the Cr component of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent interactive gesture control method and device. The method comprises the steps: S10, gesture capturing: a user makes a gesture in front of a camera within 2-4 s, and the gesture action is captured through a camera; S20, gesture training: different control gestures are collected, personalized gestures are trained, and gesture types and gesture quantity are increased; S30, gesture recognition: a viewing picture is captured in real time through the camera, the captured gesture is recognized, and compared with the trained gesture data input into the system to obtain a gesture result; and S40, interaction control: interaction control is performed on the recognized gesture to obtain a control effect corresponding to the recognized gesture, and man-machine interaction control is achieved. According to the invention, non-contact control is realized, multi-person cooperative operation can be carried out, the man-machine interaction is relatively strong, the intelligent degree is high, personalized gesture customization and interaction control function selection can be carried out, the flexibility is good, and the development prospect is relatively good.

Description

technical field [0001] The invention belongs to the technical field of non-contact gesture control, in particular to an intelligent interactive gesture control method and device. Background technique [0002] With the development of science and technology and the continuous popularization of online teaching, the frequency of using computers in the teaching field continues to increase. Both the school and the society are committed to scientific and technological teaching and convenient teaching, and the teaching methods are constantly upgraded and convenient. In the field of teaching, the use of computers for non-contact gesture control teaching is very applicable both online and offline, and students and teachers can achieve collaborative operations to improve teaching efficiency, which is convenient and meets development needs. [0003] In most conferences, computers need to be used for projection, and the speaker enriches the conference content by projecting ppt, pdf, pic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06N3/04G06N3/08
CPCG06F3/017G06N3/08G06N3/045
Inventor 徐吉锋
Owner ZHEJIANG UNIV OF FINANCE & ECONOMICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap