End-to-end news program structuring method and structuring framework system thereof

A structured and news technology, applied in speech analysis, instrument, character and pattern recognition, etc., can solve the problem of unsatisfied real-time performance of the secondary editing of news programs, avoid human interference with information, reduce errors, and ensure accuracy sexual effect

Active Publication Date: 2019-07-12
CHENGDU SOBEY DIGITAL TECH CO LTD
View PDF11 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is: in order to solve the problem of unsatisfied real-time performance of news program access and secondary editing by using the original manual method to segment and label the ever-increasing massive news streams, the present invention provides a terminal The end-to-end news program structuring method and its structural framework system integrate cross-modal information such as news grammar, visual features, audio features, and text semantics, and integrate various artificial intelligence technologies such as computer vision, machine learning, and natural language processing. , realized the segmentation of Scene level and Story level structure of news programs and automatic description of core metadata at one time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • End-to-end news program structuring method and structuring framework system thereof
  • End-to-end news program structuring method and structuring framework system thereof
  • End-to-end news program structuring method and structuring framework system thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] Such as figure 1 and figure 2 As shown, this embodiment provides an end-to-end news program structuring method and a structured framework system based on the method, the structured framework system includes a bottom-up Shot level, a Scene level and a Story level, and the The Shot level includes multiple Shots, where each Shot is a shot segment composed of multiple consecutive Frames with similar visual features, and the Scene level includes multiple Scenes, where each Scene is composed of multiple Shots with similar semantic features Scene fragments, the Story level includes multiple stories, where each Story is a program fragment with a complete story description composed of multiple Scenes, a news program is mainly composed of one or more Story, each Scene The core metadata includes Topic, Categorization, Person and Keyword, and the core metadata of each Story includes Topic, Person and Keyword.

[0032] Described a kind of end-to-end news program structuring metho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an end-to-end news program structuring method and a structuring framework system thereof, and relates to the technical field of news program processing, the method comprises the following steps: preprocessing an input news program to obtain audio resources and video resources of the news program; extracting basic information in the audio resource and the video resource by utilizing an ASR voice recognition technology, an OCR character recognition technology and a Shot Detection technology; based on the extracted basic information, extracting semantic theme information of each mode, carrying out fusion clustering on the semantic theme information of each mode by adopting a cross-mode theme fusion extraction algorithm, and outputting a Scene theme; meanwhile, carryingout cross-modal scene detection, and outputting a Scene level; performing scene aggregation and segmentation on the obtained Scene hierarchy and Scene theme by utilizing a CRF scene marking algorithm; and outputting the Story layer and the Scene layer with the same semantics. According to the method, the Story layer and the Story theme which have the same semantics are focused on, secondary utilization of the news programs is facilitated, and the use timeliness of the news programs is improved.

Description

technical field [0001] The present invention relates to the technical field of news program processing, and more specifically relates to an end-to-end news program structuring method and its structuring framework system. Background technique [0002] With the development of the times and the advancement of technology, video indexing and retrieval is an important issue and has great significance. And TV news is a large part of the video, and it is also a video that will be used repeatedly. For example, for on-demand broadcasting of TV news, it is necessary to segment the TV news stream, and then mark each segment of TV news stream with metadata, so as to quickly index and access; TV news programs are used as a material again, and used as The editorial materials of other news programs often reuse valuable fragments of news, and it is also necessary to decompose the TV news stream according to the structure of TV news and mark the valuable fragments. [0003] News video is an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/439H04N21/44H04N21/472G06K9/20G06K9/34G10L15/26
CPCH04N21/4394H04N21/44008H04N21/47205G10L15/26G06V10/225G06V30/153
Inventor 王炜温序铭谢超平李杰严照宇孙翔罗明利
Owner CHENGDU SOBEY DIGITAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap