Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Human-Computer Interaction Method Based on Artificial Intelligence

A human-computer interaction and artificial intelligence technology, applied in the input/output of user/computer interaction, mechanical mode conversion, computer parts and other directions, can solve the problems of slow recognition speed, poor user experience, indistinguishable, etc. The effect of high rate, fast recognition speed and high accuracy rate

Active Publication Date: 2022-07-15
BEIHANG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the model based on convolutional neural network has achieved the task of image cognition. However, this type of model has serious limitations in understanding image sequences, and cannot identify the semantic correlation between consecutive images, that is, it cannot respond to dynamic behaviors. to recognize or understand
[0003] But in the real world, most behaviors cannot be judged by static pictures. For example, a picture is extracted from the middle process of zooming out or zooming in. The static pictures are basically the same, even for humans, it is difficult to distinguish
[0004] Although there are dynamic gesture recognition products or methods such as Kinect, they all need specific hardware equipment, so they do not have universality; in addition, such products or methods have higher requirements for users, and the operation before use complicated steps
[0005] Moreover, the traditional recognition method has low accuracy and stability for dynamic gesture recognition, slow recognition speed, and poor user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Human-Computer Interaction Method Based on Artificial Intelligence
  • A Human-Computer Interaction Method Based on Artificial Intelligence
  • A Human-Computer Interaction Method Based on Artificial Intelligence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0073] A total of 15G video training set was created by crawling and combining with open source gesture recognition videos. The dynamic gestures in the video include zooming, panning, clicking, grabbing, and rotating.

[0074] The recognition model is built through the TensorFlow deep learning engine. The recognition model includes a spatial channel sub-model and a time channel sub-model, both of which are I3D models. The structure is as follows figure 2 shown.

[0075] The video clips in the video training set are processed, and OpenCV is used to extract the video clips frame by frame to obtain video frame pictures, and the Farnback method is used to process the video clips to obtain optical flow estimation. , the error is close to 0 after training, and the training error curve is as follows Figure 5 As shown; the optical flow estimation is used to train the time channel sub-model, a total of 9000 steps are trained, the error after training is close to 0, and the training ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a human-computer interaction method based on artificial intelligence, comprising the following steps: establishing a recognition model; inputting a video into the recognition model, recognizing the video, and obtaining dynamic gestures of characters in the video; the recognition model includes a spatial channel sub-model And the temporal channel sub-model, the spatial channel sub-model processes the spatial information for video frames, and the temporal channel sub-model processes the information for the timing information and motion features of the video clips. The artificial intelligence-based human-computer interaction method disclosed by the invention has many advantages, such as high recognition accuracy, high frame rate, high speed, and the like.

Description

technical field [0001] The invention relates to a human-computer interaction method based on artificial intelligence, in particular to a dynamic conference gesture recognition method, which belongs to the technical field of image recognition and detection. Background technique [0002] In computer vision recognition, we can classify images and detect objects in images. At present, models based on convolutional neural networks have achieved image cognition tasks. However, such models have serious limitations in understanding image sequences, and cannot identify the semantic correlation between consecutive images, that is, they cannot understand dynamic behaviors. to identify or understand. [0003] However, in the real world, most behaviors cannot be judged by static pictures. For example, when a picture is extracted from the middle of a zoom-out or zoom-in gesture, the static pictures are basically the same, even for humans, it is difficult to distinguish. [0004] Althoug...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06V20/40G06V40/16G06V40/20
CPCG06F3/017
Inventor 王田程嘉翔丁好吕金虎张宝昌刘克新
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products