Real-time video abstract generation method based on user preferences

A real-time video and user technology, applied in the field of image processing, can solve problems such as inability of users to participate, poor user experience, waste of user time, etc., to achieve the effects of ensuring integrity and optimality, improving user satisfaction, and optimizing update strategies

Active Publication Date: 2011-09-14
臻睿(北京)信息技术有限公司
View PDF3 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This kind of operation is complicated, the user experience is poor, the efficiency is low, and a lot of time is wasted for users
At the same time, most of the mature summarization algorithms only focus on the video that has been shot. Users need to wait for the video to be shot before they can sum up the video. The user is completely invisible to the video summarization process and cannot participate in it. to the whole process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time video abstract generation method based on user preferences
  • Real-time video abstract generation method based on user preferences
  • Real-time video abstract generation method based on user preferences

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be further described in detail below in conjunction with the accompanying drawings.

[0025] A method for generating real-time video summaries based on user preferences proposed by the present invention, such as figure 1 As shown, it specifically includes the following steps:

[0026] Step 1: Analyze the current video frame sequence S in real time, S={f i |p≤i≤q}, where p and q represent the first frame and the last frame of the video frame sequence S respectively, f i Indicates the i-th frame in the video frame sequence S. Analyze the image features of the adjacent i-th frame and the i+1-th frame in the current video sequence, the image features include color histogram and pixel value, let i=p, start from the first frame in the video frame sequence S, calculate the i-th The color histogram and pixel value joint difference value TDiff of the frame and the i+1th frame i .

[0027] The color histogram and pixel value joint difference value ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time video abstract generation method based on user preferences. The method provided by the invention comprises the following steps: 1, calculating a color histogram and the joint difference value of pixel values; 2, judging whether the image features of two adjacent frames have obvious changes; 3, calculating a color histogram and the joint difference value of the pixel values; 4, obtaining the piecewise boundary of a potential video; 5, setting a key frame of a video frame sequence; 6, updating the key frame by using an optimal frame; and 7, establishing a Gaussian mixture model so as to obtain the key frame serving as a real-time video abstract result. According to the method disclosed by the invention, through establishing the Gaussian mixture model to learn the user preferences, and considering the different needs of different users on key frames, the update strategy is optimized, thereby improving the customer satisfaction.

Description

technical field [0001] The invention belongs to the field of image processing, and in particular relates to a novel method for generating real-time video summaries based on user preferences. Background technique [0002] With the continuous improvement of the performance of mobile devices and the emergence of a large number of video sharing websites, more and more people choose to use mobile devices to shoot videos to share the highlights of their lives with others. In order to quickly find and browse video clips, people hope to be able to mark and summarize the video. Although there are already tools that can index and tag videos, such as iMovie, these tools require extensive, time-consuming human involvement. Meanwhile, performing real-time video summarization while the user is shooting video is a very challenging task. For videos taken by users, since the content of the videos taken by users is irregular and the structure of the video contents cannot be predicted, it is...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 牛建伟霍达童超
Owner 臻睿(北京)信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products