Selective Sign Language Video Window Multiplexing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing television systems lack the ability to provide a sign language window that can be easily enabled or disabled and repositioned by users, as they are typically embedded in the main content and require two separate video streams, increasing bandwidth and hardware costs.

Innovation Solution

The implementation of multiple packet identifiers for main and sign language content allows for content substitution, enabling the sign language window to be turned on or off and repositioned without increasing bandwidth or hardware costs, using packet swapping and re-encoding techniques to create a merged stream with interchangeable macroblocks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If two separate video streams are used for main content and sign language, then sign language can be displayed, but bandwidth consumption and hardware costs increase

Engineering Contradiction:
Improvesign language display capabilityVSAvoidbandwidth consumption
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent merges the main video stream and sign language video stream into a single multiplexed stream. The main content and sign language content are transmitted together in one stream, allowing the receiver to selectively display either the main content or the sign language content based on user preference, thereby reducing bandwidth consumption while maintaining sign language display capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The single video stream serves multiple functions by containing both main content and sign language content. The same stream can be used to provide either standard video output or sign language interpretation output, making the system versatile without requiring separate transmission channels

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If sign language window is embedded in main content, then it can be displayed, but users cannot easily enable or disable or reposition it

Engineering Contradiction:
Improvesign language display capabilityVSAvoiduser control capability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system dynamically allows users to switch between displaying main content and sign language content, and to reposition the sign language window to different locations on the screen. This dynamic control capability enables users to adjust the display according to their needs without being constrained by a fixed embedded position

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If two separate video streams are used for main content and sign language, then sign language can be displayed, but hardware costs increase

Engineering Contradiction:
Improvesign language display capabilityVSAvoidhardware requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines the processing of main content and sign language content into a single processing pipeline. By multiplexing both content types into one stream and using a single processing system to handle the combined stream, the hardware complexity is reduced compared to maintaining separate processing chains for each content type

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10204433B2Selective enablement of sign language display
Publication Date: 2019.02.12 SONY GROUP CORP
  • US10204433B2 patent drawing
  • US10204433B2 patent drawing
  • US10204433B2 patent drawing

AI summary

Content substitution and/or picture-in-picture technology is used to provide a sign language window that provides a sign language interpretation of audio content in main program audio/video content. The sign language window can be selectively disabled by a user that does not wish to view the sign language video. Also, in some implementations, the user can move the sign language window to a desired location on the display. The desired location may be one of a plurality of pre-defined display locations. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.