HDR Video Subtitle Processing via Separate Data Frames

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for processing high dynamic range (HDR) videos with subtitles result in poor subtitle display effects due to the lack of separate processing for dynamic metadata HDR videos, as existing technologies do not effectively handle subtitle content during video processing.

Innovation Solution

A method and apparatus that separately transmit HDR video data and subtitle information frames through a transmission interface, allowing for independent processing and synchronization, using techniques such as time-division, frequency-division, or channel-division multiplexing, and incorporating features like version identification and length fields within the subtitle information frames to ensure proper formatting and flexibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If existing video processing methods are used to process dynamic metadata HDR video including subtitles, then the video content can be displayed, but the subtitle display effect is poor

Engineering Contradiction:
Improvesubtitle display effectVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the video processing into two independent streams: one for video content and one for subtitle information. The video data and subtitle data are separated into different data structures, allowing independent processing of each stream. This enables optimized tone mapping for video while applying separate processing rules for subtitles, thereby improving subtitle display effect without unnecessarily complicating the overall system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts subtitle information from the combined video-subtitle stream and places it into a separate data structure. This extraction allows the subtitle processing to be decoupled from video processing, enabling specialized handling of subtitle tone mapping and display parameters, which directly addresses the poor subtitle display effect while maintaining manageable processing complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

2Manufacturing precision

If separate processing of video and subtitle is implemented, then subtitle display effect is improved, but data transmission complexity increases

Engineering Contradiction:
Improvesubtitle display effectVSAvoiddata transmission complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent merges the separately processed video data and subtitle information into a unified output stream for display. While the processing is separate, the final composition combines both streams synchronously, ensuring that the improved subtitle processing integrates seamlessly with the video content without creating transmission bottlenecks or excessive complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent designs a universal processing framework that can handle both video and subtitle data through a common architecture. The separation of processing logic is achieved within a multi-functional system that uses standardized data structures and processing pipelines, preventing transmission complexity from escalating despite the specialized handling of different data types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If dynamic metadata HDR video is processed without separate subtitle handling, then processing is simpler, but subtitle luminance and color adaptation is inaccurate

Engineering Contradiction:
Improveluminance and color adaptation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality by implementing different processing rules for different parts of the data stream. Video data receives tone mapping based on dynamic metadata, while subtitle data receives specialized processing with its own luminance and color adaptation parameters. This localized processing approach ensures accurate adaptation for each data type without requiring complete system complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces dynamic processing where the handling of subtitle data adapts based on the video content and display capabilities. The subtitle processing parameters are dynamically adjusted according to the scene luminance, color space, and display device characteristics, achieving high measurement precision for luminance and color adaptation while maintaining flexible, manageable processing complexity through adaptive algorithms.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11375154B2Method and apparatus for processing high dynamic range video including subtitle
Publication Date: 2022.06.28 HUAWEI TECH CO LTD
  • US11375154B2 patent drawing
  • US11375154B2 patent drawing
  • US11375154B2 patent drawing

AI summary

A method and an apparatus for processing a high dynamic range (HDR) video including a subtitle, where the method includes: encapsulating HDR video data into a video data frame that matches a transmission interface; encapsulating subtitle information into a subtitle information frame that matches the transmission interface; and separately transmitting the video data frame and the subtitle information frame to a display device through the transmission interface, where the video data frame and the subtitle information frame are packets in two types of formats. According to the method provided in this application, content and subtitle information of a dynamic metadata HDR video are separately transmitted to the display device. In this way, the display device can obtain the separated video content and subtitle information, and then separately perform corresponding processing on the HDR video and a subtitle.