AR Headset Closed Captioning via Segmentation and Local Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to accommodate individual preferences for closed captioning during shared video viewing experiences, leading to dissatisfaction among users with differing needs or preferences for captioning.

Innovation Solution

A headset with augmented reality processing capabilities that identifies user preferences and presents closed captioning data accordingly, allowing users to customize their captioning settings independently while viewing the same audio video content as others.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If closed captioning is presented on the video display, then users with hearing impairment or preference can consume content adequately, but users who do not like closed captioning will be dissatisfied

Engineering Contradiction:
Improvecaptioning accommodationVSAvoiduser satisfaction
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system divides the captioning delivery into separate channels: traditional video displays continue to show content without captions, while AR headsets provide captions to users who need them. This segmentation allows different user groups to receive appropriate captioning without interfering with each other's viewing experience.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies captioning selectively to specific users based on their preferences or needs, rather than uniformly to all viewers. Users with hearing impairments or who prefer captions receive them through their AR headsets, while other users experience content without captions, creating localized quality adjustment for each user's viewing experience.

Inventive Principle:
Principle #3Local quality

2Ease of operation

If closed captioning is not presented on the video display, then users who do not like closed captioning are satisfied, but users with hearing impairment cannot adequately consume content

Engineering Contradiction:
Improveuser satisfactionVSAvoidcaptioning accommodation
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The AR headset acts as an intermediary device that bridges the gap between users with different captioning needs. It receives the same video content as the main display but adds captioning functionality specifically for users who require it, without affecting the main display's caption-free presentation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system moves the captioning delivery from the traditional 2D video display plane to a new dimension through AR headsets. This creates a separate delivery channel where captions can be presented to specific users in three-dimensional space, allowing simultaneous caption-free and captioned viewing experiences.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Loss of information

If closed captioning is presented on the video display, then all users can see the same content, but individual user preferences for captioning cannot be customized

Engineering Contradiction:
Improvecontent accessibilityVSAvoidpreference customization
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The system implements dynamic captioning delivery that adapts to each user's real-time preferences or needs. Users can independently control whether they receive captions through their AR headsets, allowing the system to dynamically adjust captioning presentation based on individual user characteristics rather than applying a static uniform approach.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system allows users to pre-configure their captioning preferences before viewing content. Users with hearing impairments or who prefer captions can set their preferences in advance, so that when they view content through their AR headsets, the appropriate captioning is automatically provided without requiring real-time adjustments.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11076112B2Systems and methods to present closed captioning using augmented reality
Publication Date: 2021.07.27 LENOVO SWITZERLAND INTERNATIONAL GMBH
  • US11076112B2 patent drawing
  • US11076112B2 patent drawing
  • US11076112B2 patent drawing

AI summary

In one aspect, a headset includes a housing, a processor coupled to the housing, a first display coupled to the housing and accessible to the processor, and storage coupled to the housing and accessible to the processor. The storage bears instructions executable by the processor to identify a closed captioning setting, receive closed captioning data indicating closed captioning text at the headset, and present the closed captioning text in accordance with the closed captioning setting on the first display of the headset using augmented reality processing.