Online Video Subtitle Synthesis for Information Completeness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users may miss important information while playing videos without subtitles, especially in noisy environments or when dialogue is in a dialect or foreign language, leading to a poor user experience.

Innovation Solution

A video processing method that parses online video files to obtain audio and video streams, generates subtitles based on the audio stream using statistical models, and synthesizes these with the video stream for display on the screen, enhancing user experience by providing subtitles and optimizing video quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If subtitles are generated and synthesized with video stream, then information completeness is improved, but processing complexity increases

Engineering Contradiction:
Improveinformation completenessVSAvoidprocessing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent generates subtitles in advance from the audio stream before final video rendering, and pre-synthesizes them with the video stream. This preliminary action ensures that subtitles are ready when needed, improving information completeness without adding complexity during real-time playback.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediate subtitle stream as a separate data layer between the audio stream and the final video output. This intermediary approach allows subtitles to be processed and synthesized independently, managing complexity by separating the subtitle generation process from the main video rendering pipeline.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If video processing operations are performed, then video quality is improved, but processing time increases

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs video processing operations including decoding, rendering, and subtitle synthesis in advance before the final display. By completing these operations preliminarily, the system ensures high video quality is achieved without delaying the actual video playback to end users.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11418832B2Video processing method, electronic device and computer-readable storage medium
Publication Date: 2022.08.16 GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
  • US11418832B2 patent drawing
  • US11418832B2 patent drawing
  • US11418832B2 patent drawing

AI summary

Disclosed are a video processing method an electronic device and a computer-readable storage medium. The electronic device includes a display screen. The video processing method includes: obtaining an audio stream and a video stream by parsing a video file; wherein the video file is an online video; generating a subtitle stream based on the audio stream; obtaining a target video stream by synthesizing the subtitle stream and the video stream; and displaying the target video stream on the display screen.