Transparent Display Closed Captioning for Ambient Light Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional transparent displays in wearable devices face challenges in displaying closed caption information due to varying ambient lighting conditions, which can affect visibility and readability, and often obscure visible objects, leading to an undesirable user experience.

Innovation Solution

A head-mounted device with a transparent display and an image capturing device that dynamically controls the display of closed caption information based on ambient lighting conditions by determining image characteristics and adjusting display settings to ensure clear readability without obscuring the view of associated audio content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If closed caption information is displayed on transparent display with high brightness to improve readability, then visibility of text is improved, but visible objects in the displayed AV content are obscured

Engineering Contradiction:
Improvebrightness of closed caption informationVSAvoidobscuration of visible objects
Core Design Contradiction:
Illumination intensityVSObject-generated harmful factors

Solution Approach 1:

The patent applies local quality by adjusting display characteristics (brightness, contrast, color) of closed caption information based on the specific ambient lighting conditions detected in different regions. The system analyzes the captured image to determine lighting characteristics and selectively modifies display parameters in relevant areas to ensure text readability while preserving visibility of underlying objects and content.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamics by continuously monitoring ambient lighting conditions through the image capturing device and dynamically adjusting the display characteristics of closed caption information in real-time. The system responds to changing light conditions by modifying brightness, contrast, and other parameters to maintain optimal readability without obscuring visible objects, creating an adaptive display system.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If display characteristics are adjusted to adapt to varying ambient lighting conditions, then readability of closed caption information is improved, but display complexity increases

Engineering Contradiction:
Improvereadability of closed caption informationVSAvoiddisplay control system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies self-service by enabling the display system to automatically adjust its characteristics based on ambient lighting conditions detected by the integrated image capturing device. The system autonomously analyzes the captured image to determine lighting characteristics and modifies display parameters without requiring manual user intervention, thereby improving readability while managing complexity through automation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements universality by using the image capturing device to serve multiple functions: capturing the scene for AV content display, analyzing ambient lighting conditions, and providing input for adjusting closed caption information display characteristics. This multi-functional approach allows the system to adapt to varying lighting conditions without adding separate dedicated sensors or control mechanisms.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If closed caption information is displayed continuously to provide complete audio content information, then information completeness is improved, but visual obstruction of audio content increases

Engineering Contradiction:
Improvecompleteness of audio content informationVSAvoidvisual obstruction of audio content
Core Design Contradiction:
Loss of informationVSObject-generated harmful factors

Solution Approach 1:

The patent applies local quality by strategically positioning and sizing closed caption information within the display area to minimize obstruction of visible objects and audio content. The system analyzes the captured image to determine appropriate display regions and adjusts the spatial characteristics of text information, ensuring complete audio content information is provided while reducing visual interference with the underlying content.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10885339B2Display of information related to audio content based on ambient lighting conditions
Publication Date: 2021.01.05 SONY GROUP CORP
  • US10885339B2 patent drawing
  • US10885339B2 patent drawing
  • US10885339B2 patent drawing

AI summary

A head-mounted device includes a first image capturing device, a transparent display, and circuitry. The first image capturing device captures an image of a scene in a line-of-sight (LOS) of a wearer of the head-mounted device. The circuitry receives an audio segment that corresponds to audio content. The circuitry determines a level of each image characteristic of a background portion and a foreground portion of the captured image. The circuitry estimates a first region on a display portion of the transparent display for display of text information associated with the received audio segment. The circuitry determines a level of each display characteristic from a set of display characteristics for the text information based on the estimated first region and the determined level of each image characteristic. The circuitry controls the display of the text information in the estimated first region of the display portion of the transparent display.