Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video event recognition method based on top-down motion attention mechanism

A technology of video event and attention mechanism, which is applied to computer components, character and pattern recognition, instruments, etc., can solve problems such as poor pertinence, low recognition accuracy, and interference in the classification process

Active Publication Date: 2011-04-27
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF4 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In order to solve the technical problem that the background information of the prior art interferes with the classification process, the extracted features are not targeted, and the recognition accuracy is low. Therefore, the purpose of the present invention is to provide a fusion of video static features and dynamic features. Video Event Recognition Method Based on Top-Down Motion Attention Mechanism

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video event recognition method based on top-down motion attention mechanism
  • Video event recognition method based on top-down motion attention mechanism
  • Video event recognition method based on top-down motion attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0047] Execution environment of the present invention adopts a Pentium 4 computer with 3.0G Hz central processing unit and 2G byte memory and has compiled the algorithm program of efficient video event recognition with Matlab and C language, can also adopt other execution environments, here No longer.

[0048] The overall framework of the system scheme of the present invention is attached figure 2 , using a computer to implement a video event recognition task based on a top-down motion attention mechanism, which contains five main modules:

[0049] Interest point detection module 1, the main function of this module is to divide the video database into two parts: training set (training video) and test set (testing video)...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video event recognition method based on a top-down motion attention mechanism, which comprises the following steps of: 1, detecting points of interest of each frame in each video in a video set on a computer by using Gaussian difference detector, wherein the video set comprises a training video set and a testing video set; 2, extracting scale-invariant characteristic description sub-characteristics and light stream characteristics from the detected points of interest of each frame; 3, establishing an apparent word list and a motion word list; 4, learning the probability of each motion word about each type of events on the training video set and establishing a motion information-based attention histogram; 5, calculating the similarity between videos in the video set by using the distance of a bulldozer, and generating a kernel function matrix; and 6, training a support vector machine classifier by using the obtained kernel function matrix so as to obtain classifier parameters, classifying the tested video sets, and outputting classification results.

Description

technical field [0001] The invention relates to the field of computer application technology, in particular to a video event recognition method. Background technique [0002] In recent years, with the rapid development of the Internet, the promotion and popularization of technologies such as video compression technology, DVD, WebTV, and third-generation mobile communication technology (3G), especially the construction of broadband networks, people have more and more opportunities to interactively access video information. More and more video portals have emerged, such as Youku and Tudou in China, and Youtube in foreign countries. Video information producers in the world, such as TV stations, film producers, advertising producers, etc., and even various digital capture devices such as digital cameras, digital video cameras, etc. New video materials are continuously produced, and digital video media has begun to flood people's living spaces. [0003] How to enable people to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/66
Inventor 胡卫明李莉
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products