Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Automatic video annotation method based on automatic classification and keyword marking

An automatic classification and video annotation technology, applied in the field of video recognition, can solve problems such as time-consuming and resource-consuming, inaccuracy of each pixel, and search engines unable to retrieve and analyze each picture of the video, and achieve the effect of improving performance.

Inactive Publication Date: 2012-06-20
PEKING UNIV
View PDF0 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although these "contents" can better express video information, this retrieval method needs to search by comparing these high-dimensional feature information, which consumes a lot of time and resources, which is unacceptable to general network users and is also the current reality. stage is not feasible, so the video retrieval provided by major websites today, such as Google, MSN, YouTube, Baidu, etc., all rely on the description of the text metadata of the video for retrieval
Their search engine cannot analyze every picture in the video like content-based retrieval, let alone be accurate to every pixel, so they cannot search for videos that have not been annotated

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic video annotation method based on automatic classification and keyword marking
  • Automatic video annotation method based on automatic classification and keyword marking
  • Automatic video annotation method based on automatic classification and keyword marking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples serve to illustrate the present invention, but do not limit the scope of the present invention.

[0059] Such as figure 2 As shown, the automatic video annotation method based on automatic classification and keyword labeling according to the present invention is divided into two processes for different video collections: the training system process and the identification and annotation video process, respectively in the figure with solid arrows and Dashed arrows indicate.

[0060] During training, it is first necessary to extract the global features and local features of the video. The global features are used to train the SVM model so that it can recognize different categories, and the local features are used to establish an index model corresponding to multiple features and keywor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an automatic video annotation method based on automatic classification and keyword marking. The automatic video annotation method comprises the following steps of: S1, carrying out preprocessing on a video classification feature; S2, extracting the global feature and the local feature of a video, wherein the global feature is used for training an SVM (Support Vector Machine) model to enable the SVM model to identify different types; and the local feature is used for establishing a multi-feature index model with multiple features which correspond to keywords; and S3, for un-annotated videos from a user, extracting the global feature and the local feature and then enabling the SVM model to identify specific types of the videos by adopting the global feature; and retrieving relevant keywords in the multi-feature index model for annotating by using the local feature; and S4, ordering an annotation result according to a certain weight and then returning the annotation result to the user. According to the automatic video annotation method, the marking performance of the video is improved.

Description

technical field [0001] The invention relates to the technical field of video recognition, in particular to an automatic video annotation method based on automatic classification and keyword labeling. Background technique [0002] With the advancement of science and technology, especially the development and promotion of multimedia digital technology, the reduction of storage costs, the increase of network transmission bandwidth, the improvement of computer processing speed, and the popularization of high-performance computing environments, the objects processed by modern information retrieval and scale have changed a lot. The rapid expansion of multimedia information containing various types of data such as text, images, audio, and video has gradually become the mainstream of information, and has had an important impact on people's lives and social development. Multimedia information has its own characteristics. On the one hand, it has a large amount of information. Seeing ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 崔斌姚俊杰陈琛舒清雅
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products