Paragraph-Video Alignment for News Commentary

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face inefficiency in acquiring news as they need to read multiple reports to extract desired information, with existing technologies not providing a corresponding video for news commentaries, leading to low efficiency in news acquisition.

Innovation Solution

A method and apparatus that aligns a paragraph with a video by acquiring a commentary and a candidate material resource set, determining a candidate material resource sequence based on matching degrees, playing durations, and text lengths, and generating a video corresponding to the commentary, using optimization algorithms like dynamic programming or shortest path optimization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple news reports are gathered to extract desired information, then the completeness of information is improved, but the time required for information acquisition increases

Engineering Contradiction:
Improvecompleteness of informationVSAvoidtime required for information acquisition
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent creates a video copy that visually represents the commentary content, allowing users to quickly grasp information through visual perception rather than reading multiple text reports. The video serves as a synthesized copy that consolidates information from multiple sources into a single accessible format.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent segments the commentary into paragraphs and aligns each paragraph with corresponding video clips. This segmentation allows the system to match specific text portions with relevant visual content, creating a structured video representation that preserves information completeness while reducing acquisition time.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If a video is generated to represent the commentary, then the vividness and readability of news information is improved, but the complexity of the system increases

Engineering Contradiction:
Improvereadability and vividness of news informationVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an alignment model as an intermediary that bridges the commentary text and video clips. This model calculates matching degrees between paragraphs and candidate video clips, automatically selecting the most appropriate visual content without requiring complex manual curation or high system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent uses parameter optimization (such as matching degree thresholds and playback duration adjustments) to control the video generation process. By adjusting these parameters, the system can balance between information completeness and system complexity, making the generation process more manageable.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If the playback duration of video clips is adjusted to match paragraph lengths, then the alignment between video and commentary is improved, but the difficulty of detecting and measuring appropriate durations increases

Engineering Contradiction:
Improvealignment precision between video and commentaryVSAvoiddifficulty of determining appropriate video duration
Core Design Contradiction:
Manufacturing precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent employs an optimization algorithm that uses feedback from the alignment model to iteratively adjust video clip durations. The system calculates matching degrees between paragraphs and video clips, and uses this feedback to optimize the playback duration, achieving precise alignment without manual measurement.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs self-service by automatically determining appropriate video durations through the optimization algorithm. The alignment model itself provides the duration information needed, eliminating the need for external measurement or manual intervention in determining appropriate playback lengths.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11758088B2Method and apparatus for aligning paragraph and video
Publication Date: 2023.09.12 BAIDU COM TIMES TECH (BEIJING) CO LTD
  • US11758088B2 patent drawing
  • US11758088B2 patent drawing
  • US11758088B2 patent drawing

AI summary

Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.