Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Human-computer interaction method based on artificial intelligence

A technology of human-computer interaction and artificial intelligence, applied in the input/output of user/computer interaction, mechanical mode conversion, computer components, etc., can solve the problems of slow recognition speed, difficult to distinguish, poor user experience, etc., and achieve recognition speed Fast, high accuracy, and high recognition frame rate

Active Publication Date: 2022-05-10
BEIHANG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the model based on convolutional neural network has achieved the task of image cognition. However, this type of model has serious limitations in understanding image sequences, and cannot identify the semantic correlation between consecutive images, that is, it cannot respond to dynamic behaviors. to recognize or understand
[0003] But in the real world, most behaviors cannot be judged by static pictures. For example, a picture is extracted from the middle process of zooming out or zooming in. The static pictures are basically the same, even for humans, it is difficult to distinguish
[0004] Although there are dynamic gesture recognition products or methods such as Kinect, they all need specific hardware equipment, so they do not have universality; in addition, such products or methods have higher requirements for users, and the operation before use complicated steps
[0005] Moreover, the traditional recognition method has low accuracy and stability for dynamic gesture recognition, slow recognition speed, and poor user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-computer interaction method based on artificial intelligence
  • Human-computer interaction method based on artificial intelligence
  • Human-computer interaction method based on artificial intelligence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0073] A total of 15G video training sets were created by crawling and combining open source gesture recognition videos. The dynamic gestures in the video include zooming, panning, clicking, grabbing, and rotating.

[0074] The recognition model is built through the TensorFlow deep learning engine. The recognition model includes a spatial channel sub-model and a time channel sub-model, both of which are I3D models. Its structure is as follows figure 2 shown.

[0075] Process the video clips in the video training set, use OpenCV to extract video clips frame by frame to obtain video frame pictures, and use the Farnback method to process video clips to obtain optical flow estimation, use frame pictures to train the spatial channel sub-model, a total of 6000 training steps , the error tends to 0 after training, and the training error change curve is as follows Figure 5 As shown; the optical flow estimation is used to train the time channel sub-model, a total of 9000 training st...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a man-machine interaction method based on artificial intelligence. The man-machine interaction method comprises the following steps: establishing an identification model; inputting the video into a recognition model, and recognizing the video to obtain a dynamic gesture of a character in the video; the recognition model comprises a space channel sub-model and a time channel sub-model, the space channel sub-model processes space information for video frames, and the time channel sub-model processes time sequence information and motion feature information for video clips. The man-machine interaction method based on artificial intelligence has the advantages of being high in recognition precision, high in frame rate, high in speed and the like.

Description

technical field [0001] The invention relates to a human-computer interaction method based on artificial intelligence, in particular to a dynamic meeting gesture recognition method, which belongs to the technical field of image recognition and detection. Background technique [0002] In computer vision recognition, we can classify images and detect objects in images. At present, the model based on convolutional neural network has achieved the task of image cognition. However, this type of model has serious limitations in understanding image sequences, and cannot identify the semantic correlation between consecutive images, that is, it cannot respond to dynamic behaviors. to recognize or understand. [0003] But in the real world, most behaviors cannot be judged by static pictures. For example, a picture is extracted from the middle process of zooming out or zooming in. The static pictures are basically the same, even for humans, it is difficult to distinguish them. [0004]...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01G06V20/40G06V40/16G06V40/20
CPCG06F3/017
Inventor 王田程嘉翔丁好吕金虎张宝昌刘克新
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products