Method for automatically generating main character abstract in television program

A technology for main characters and TV programs. It is applied in the fields of digital data processing, special data processing applications, instruments, etc. It can solve the time-consuming, labor-intensive and difficult problems of manual labeling and segmentation, and achieve the effect of improving efficiency and reducing clustering time.

Inactive Publication Date: 2012-11-28
BEIJING UNIV OF POSTS & TELECOMM
View PDF4 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Manual labeling and segmentation is time-consuming and labor-intensive. In the face of massive video dat...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for automatically generating main character abstract in television program
  • Method for automatically generating main character abstract in television program
  • Method for automatically generating main character abstract in television program

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0011] The present invention will be described in further detail below in conjunction with the accompanying drawings. Such as image 3 As shown, the video program content is divided into marked shot paragraphs and unmarked shot paragraphs, and is distributed in each time segment of the whole video. The present invention analyzes each marked shot paragraph by analyzing the marked shot paragraphs. Summary of main characters. There have been many methods and inventions described on how to obtain the time position information of the marked lens segment, for example, extract the unique mark of the fixed position from the key frame, obtain positive and negative samples, and use the support vector machine (SVM) Train a template to determine whether it is a logo, use the template to extract key frames from the program video to be processed, and decide whether it is a key frame of a marked shot segment, so as to integrate the time information of these key frames to obtain a marked sho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for automatically generating a main character abstract in a television program. According to the method, image characteristics and an unsupervised clustering method in a video are combined, so that main characters in a program video are extracted, an interviewer and an interviewee are marked, and a preview of the main character abstract is generated; and therefore, the user experience is enhanced. The method comprises the following steps of: extracting a key frame at a uniform time interval based on a video paragraph with marks, performing face detection and characteristic extraction, performing linear clustering on face images based on characteristics, obtaining rough character classifications according to time information and space information of the face images, obtaining a precise clustering result through graph-theory-based clustering, filtering the main character classifications of independent paragraphs by an adaptive method, integrating filter results of all the paragraphs, secondarily performing the graph-theory-based clustering, judging the interviewer and the interviewee according to a rule, and marking and generating the main character abstract of each paragraph. By the unsupervised clustering method, the structure is simple, and the method is easy to implement; and the method is relatively high in universality and robustness.

Description

technical field [0001] The invention belongs to the field of multimedia information processing and retrieval, and uses the extraction and analysis of the face features of characters in images in videos to provide a method for summarizing main characters in TV content. Applying the inventive method can automatically generate a summary of characters, and can mark interviewers and interviewees, and is a method for processing video content of TV programs with automatic calculation, strong robustness and low algorithm complexity. Background technique [0002] Nowadays, with the rapid spread and vigorous development of radio and television and the Internet, multimedia information as the data side has also been greatly increased. These massive data have spawned many emerging applications: digital TV, Internet TV, video websites, etc. , the needs of users for browsing experience and viewing experience have also increased accordingly, and it has become an urgent requirement to be abl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 董远秦钢
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products