Supercharge Your Innovation With Domain-Expert AI Agents!

Method for analyzing TV video based on role

A technology for video analysis and TV dramas, applied in the field of video analysis, can solve problems such as limiting the scope of application of video matching methods

Active Publication Date: 2014-09-03
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the one hand, unlike TV drama scripts, subtitle files are not provided by default in TV dramas in many non-English-speaking countries, which limits the applicability of timestamp-based script-video matching methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for analyzing TV video based on role
  • Method for analyzing TV video based on role
  • Method for analyzing TV video based on role

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0021] figure 2 It is a flow chart of the role-based TV drama video analysis method proposed by the present invention. Such as figure 2 Shown, the TV play video analysis method based on role that the present invention proposes comprises the following steps:

[0022] Step 1, extract the character histogram to characterize the character appearance relationship in the video and the script.

[0023] The present invention proposes the concept of a character histogram to characterize the appearance relationship of characters in movies / TV dramas. The character histogram is defined as a vector, each dimension of which corresponds to a character, and its magnitude reflects the number of times the character appears in the scen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for analyzing a TV video based on roles, which can correlate a script and the video by corresponding relationship between names and faces so as to enable the semantic scene structure to be accurately mapped to the video from the script. The method comprises the steps of extracting column diagram of the names and faces from the script and the video, respectively, and then using a generation model to model the shooting process of the TV play. From studying of the model parameters, the corresponding relationship between the names and faces can be learned without supervision; from hidden-state ratiocination, the division of the video scene can be obtained optimally. The invention can automatically identify identity of the video face under a condition without manual mark, so that the invention is suitable for analyzing large-scale video content. Meanwhile, because of introducing script document as guidance, the obtained scene division has the advantages of being semantically understandable and comparable.

Description

technical field [0001] The invention relates to the field of video analysis, in particular to a role-based TV drama video analysis method. Background technique [0002] With the vigorous development of the television industry, hundreds of TV dramas are produced and broadcast all over the world every year. A large number of TV dramas have greatly enriched people's entertainment life, but at the same time it has brought great difficulties to the effective storage and acquisition of data. In this context, automatic video analysis and indexing methods are particularly important. It can associate low-level visual information with high-level semantics, thus providing people with a natural concept-based content access method. [0003] At present, the analysis work for TV dramas is mainly realized through the matching of scripts and videos. With the help of the detailed description of the storyline and character interaction process in the TV drama script, people can accurately de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30G06K9/00
Inventor 徐常胜卢汉清梁超
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More