Method and device for generating video abstract and image processing system including device

Abstract

The invention provides a method for generating a video abstract of a video signal, comprising a video decoding step, a subtitle characteristic acquiring step and a video abstract generating step, wherein the video decoding step is used for decoding the video signal in order to obtain a multi-frame video decoding image; the subtitle characteristic acquiring step is used for acquiring at least one of characteristics of every subtitle in all the subtitles included in the multi-frame video decoding image, wherein the characteristics are as follows: the lasting time of the subtitle, the position of the subtitle in the corresponding video decoding image, the character size of the subtitle, recognition codes and reliability of the subtitle image after optical character recognition (OCR); and the video abstract generating step is used for processing at least one characteristic of the acquired subtitle according to the relationship between the content of the video signal and the characteristics of the subtitle so as to generate the video abstract adaptable to the content of the video signal. By using the method of the invention, the video abstract capable of correctly reflecting the main contents of original video files is generated. The invention further provides a device for generating the video abstract of the video signal and an image processing system with the device.

Description

technical field [0001] The present invention generally relates to the technical field of video image processing, and more specifically, relates to a method and device for generating video summaries, and an image processing system including the device. Background technique [0002] Video Summary VS (Video Summarization) refers to a short summary formed for a video file, which is used to summarize the main content of the video file. Two different types of video summarization are commonly used today. The first one is called "SVS (Static Video Summary, Static Video Summary)", which consists of a series of key frames (key frames) extracted or synthesized from the original video file. The second is called "DVS (Dynamic Video Skimming), which is composed of a group of continuous video clips (video clips), a reduced version of the original video file. [0003] In the above method for forming a video summary in the prior art, a video shot boundary detection technology (shot boundar...

AI Technical Summary

Problems solved by technology

[0004] However, in most videos, the above-mentioned SVS based on video shots includes too many video shots, and the video shots involved in the above conversion may not necessarily reflect the main content of the video file. Therefore, although the final video summary includes many frame image, but still fails to provide important information about the original video file

For example, in a story-telling video, many video lens transitions may be included, and these video lens transitions are only to explain the time and place involved in the story development process to ensure the integrity of the story telling or as a foreshadowing for the development of the plot. However, the video shots and their associated frames involved in these conversions have little to do with the main content of the story itself, so if these frames are included in the video summary, it will make it impossible to accurately obtain the outline of the story from the video summary

[0005] There is also a similar defect in the DVS in the above-mentioned prior art, that is, it is difficult to obtain a video summary that accurately reflects the main content of the original video file

Images