Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video abstraction generating method based on sketch

A video summary and sketch technology, applied in the field of human-computer interaction, can solve problems such as inability to effectively describe videos

Inactive Publication Date: 2010-08-18
INST OF SOFTWARE - CHINESE ACAD OF SCI
View PDF0 Cites 54 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Static summaries based on frame images cannot effectively describe the dynamic or hidden information in videos, and obtaining video content through dynamic summaries still requires people to browse videos linearly and sequentially

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video abstraction generating method based on sketch
  • Video abstraction generating method based on sketch
  • Video abstraction generating method based on sketch

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0077] In order to enable those skilled in the art to better understand the present invention, the sketch-based video summary generation method provided by the present invention will be further described in detail below in conjunction with the accompanying drawings, but this does not constitute a limitation to the present invention.

[0078] 1. Select the video resource to be processed. In this example, a video shot about 5 minutes long is selected from a famous movie as the object;

[0079] 2. Use the method described in the previous step 1 and step 2 to perform lens segmentation, key frame extraction and video semantic analysis on the video segment

[0080] 3. Use the key frame screening method described in the previous step 3 to filter the key frames obtained in the previous step, automatically and manually, to obtain the final key frame, as shown in the attached image 3 shown;

[0081] 4. Use interactive methods to generate static sketches for each key frame image, as sh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video abstraction generating method based on sketches, which belongs to the field of man-machine interaction. The method comprises the following steps: (1) carrying out shot segmentation and shot screening on the video to obtain key frames; (2) carrying out character analysis and scene analysis on the key frames, and determining the semantic significance level of each key frame according to the character analysis; (3) calculating an image quality assessed value of each key frame, and screening the key frames according to the image quality assessed value and the semantic significance level value; (4) generating a video object sketch according to each key frame determined in step (3); (5) resetting the size of the corresponding sketch according to the size of the abstraction drawing region and the significance level of the video contents corresponding to each sketch; and (6) determining the position of each sketch by utilizing the scene analysis result, generating connecting lines among the sketches, and connecting the sketches to generate a video abstraction. By using the method of the invention, the sketch abstraction can intensively and effectively reflect the main plot semanteme of the video, thereby conforming to the perception habits of users.

Description

technical field [0001] The invention belongs to the field of human-computer interaction, and in particular relates to a sketch-based video summary generation method. Background technique [0002] With the popularization of digital equipment and the development of Internet technology, the number of video resources has grown massively. The popularity of digital equipment has greatly reduced the cost of video resource collection, and people can use digital DV or DC to realize video resource collection anytime and anywhere. At the same time, with the development of Internet technology and streaming media technology, videos can be spread rapidly through the Internet, making it more convenient for people to obtain video resources. It is precisely because of the existence of these two main reasons that video media information in personal information is increasing day by day, which puts forward higher requirements for how to quickly obtain video content for effective organization a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04N5/14
Inventor 滕东兴马翠霞杨海燕陈佳王宏安戴国忠
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products