Video segment searching method based on contents

A technology of video fragments and fragments, which is applied in the field of content-based video fragment retrieval, and can solve the problems of slow retrieval of fragments

Inactive Publication Date: 2003-12-10
北京大学计算机科学技术研究所 +1
View PDF0 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Two problems are: 1. Automatically segment multiple segments similar to the query segment from the video library; 2. Arrange these similar segments according to the similarity from high to low
This method can perform precise retrieval and similarity retrieval at the same time, but its problems are: (1) It only considers the number of similar shots of two clips, but does not consider the impact of many-to-many shot similarity (granularity) on the overall similarity , therefore, even if all shots of segment Y are similar to only one shot of segment X, Y will be considered similar to X; (2) The proposed assumption does not hold, that is, the similar frames inside the two shots do not necessarily correspond in time order Similarity; (3) The similarity of the shots is judged based on the longest sequence of similar frames of the two shots. This kind of comparison based on each frame makes the retrieval speed of the clips relatively slow.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video segment searching method based on contents
  • Video segment searching method based on contents
  • Video segment searching method based on contents

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0048] figure 1 Listed the schematic flow chart of each step method of the present invention, comprises the following steps: 1, lens retrieval

[0049] First, use the spatio-temporal slice algorithm (spatio-temporal slice) for shot boundary detection, and divide the video in the query segment X and video library Y into shots. For a detailed description of the spatio-temporal slice algorithm, please refer to the document "Video Partitioning by Temporal Slice Coherency"[ C.W.Ngo, T.C.Pong, and R.T.Chin, IEEE Transactions on Circuits and Systems for Video Technology, Vol.11, No.8, pp.941-953, August, 2001]; then according to the literature "Motion-based Video Representation for Scene Change Detection”[C.W.Ngo, T.C.Pong, and H.J.Zhang, International Journal of Computer Vision, Vol.50, No.2, pp.127-143, Nov 2002], detect camera motion information within the shot,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to a video segment search method based on the contents. It adopts maximum matching of graph theory and its optimum matching so as to raise search accuracy and search speed. Said method includes the following steps: firstly, investigating continuity of similar scene to obtain a similar segment, primarily, then utilizing Hungarian algorithm capable of implementing maximum matching to define true similar segment, then adopting the combination of Kuhn-Munkres algorithm capable of making optimum matching and dynamic program algorithm to resolve the metric problem of segment similarity. The tests show that said method can obtain higher search accuracy and more quickly searching speed.

Description

technical field [0001] The invention belongs to the technical field of video retrieval, and in particular relates to a content-based video segment retrieval method. Background technique [0002] With the accumulation of TV station video programs, the increase of online digital video, and a large number of multimedia applications such as digital library, video on demand, and distance teaching, how to quickly retrieve the required information from the massive video is very important. Traditional video retrieval based on keyword descriptions cannot meet the needs of mass video retrieval because of limited description ability, strong subjectivity, manual annotation, and poor intuition. Therefore, since the 1990s, content-based video retrieval technology has become a hot research topic. [0003] Content-based video segment retrieval is the main method of content-based video retrieval, which refers to finding all similar segments from the video library given a query segment. Con...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G11B27/10H04N5/93
Inventor 彭宇新杨宗桦肖建国
Owner 北京大学计算机科学技术研究所
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products