Subtitle Decode Unit HDR Color Space Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems fail to seamlessly integrate subtitle data with high dynamic range (HDR) images, causing a feeling of strangeness due to differences in color and brightness when standard dynamic range (SDR) subtitle data is displayed on HDR content.

Innovation Solution

An information processing apparatus that decodes subtitle data reproduction control information to acquire color space, electro-optical transfer function, and color depth designation information, generating output subtitle data compatible with HDR images by applying the appropriate color space and transfer function.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If TTML subtitle data in sRGB color space is displayed on HDR image content, then subtitle data can be displayed on the screen, but the viewer feels difference in color and brightness between the image and subtitle, causing a feeling of strangeness

Engineering Contradiction:
Improvesubtitle display compatibilityVSAvoidcolor and brightness consistency
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies parameter changes by converting subtitle data from sRGB color space to BT.2020 color space, and transforming the electro-optical transfer function from gamma 2.4 to SMPTE ST 2084. This changes the colorimetric parameters and brightness characteristics of the subtitle data to match HDR image parameters, eliminating the feeling of strangeness while maintaining display compatibility

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces an intermediary conversion process that acts as a mediator between SDR subtitle data and HDR image content. The conversion unit transforms subtitle data through intermediate color space and transfer function representations, enabling seamless integration with HDR content without direct incompatibility

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If HDR image content with expanded color and brightness ranges is used, then more natural image quality is achieved, but subtitle data in standard color space appears inconsistent with the image

Engineering Contradiction:
Improveimage quality and naturalnessVSAvoidsubtitle integration compatibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent changes the parameters of subtitle data to match HDR image parameters by converting color space from sRGB to BT.2020 and electro-optical transfer function from gamma 2.4 to SMPTE ST 2084. This enables subtitle data to adapt to HDR content while maintaining the expanded color and brightness ranges that provide natural image quality

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent makes the subtitle processing system universal by implementing automatic detection of content type (HDR or SDR) and applying appropriate conversion parameters. The same subtitle data can be displayed on both HDR and SDR content by adjusting the conversion parameters, achieving multi-functionality and broad compatibility

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If subtitle data is converted to match HDR color space and transfer function, then color and brightness consistency is achieved, but additional processing steps are required

Engineering Contradiction:
Improvecolor and brightness consistencyVSAvoidprocessing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-converting subtitle data to HDR-compatible color space and transfer function during the subtitle rendering process. The conversion is performed in advance before subtitle display, ensuring consistency without requiring complex real-time processing during playback

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements self-service by enabling the playback device to automatically detect whether content is HDR or SDR and autonomously apply the appropriate conversion parameters. The system serves itself by making intelligent decisions about parameter selection without requiring manual configuration or complex external control

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10750149B2Information processing apparatus, information recording medium, information processing method, and program
Publication Date: 2020.08.18 SONY GROUP CORP
  • US10750149B2 patent drawing
  • US10750149B2 patent drawing
  • US10750149B2 patent drawing

AI summary

Provided is an information processing apparatus including: a data processing unit configured to execute a data reproduction process. The data processing unit includes a decode unit that decodes reproduction control information of subtitle data included in reproduction target data, and the decode unit acquires color space designation information, electro-optical transfer function (EOTF) designation information, and color depth designation information that are recorded in subtitle data reproduction control information, and generates output subtitle data in accordance with acquired information.