Audiovisual Data Stream Segmentation for Flexible Audio Replacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional audiovisual content item data streams, such as the MPEG-2 Transport Stream, lack optimal flexibility and result in high data rates due to parallel audio representations, necessitating an improved approach that enhances flexibility while maintaining backwards compatibility.

Innovation Solution

A method for generating audiovisual content item data streams with a first audiovisual data stream containing mandatory and replaceable audio data, allowing alternative audio data to replace the replaceable audio data, thereby providing flexible and efficient representation of alternative audio representations within the existing transport stream structure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If parallel audio representations are included in the transport stream, then alternative audio tracks (e.g., different languages) are supported, but the data rate increases and flexibility is limited

Engineering Contradiction:
ImproveflexibilityVSAvoiddata rate
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The audio representation is segmented into mandatory audio data and replaceable audio data within a single elementary stream. The mandatory audio data contains essential audio components that must be present, while the replaceable audio data contains alternative audio components (such as different language tracks) that can be selectively replaced. This segmentation allows multiple audio representations to be supported without requiring separate parallel elementary streams for each, thereby reducing the overall data rate while maintaining flexibility.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If multiple separate elementary streams are used for alternative audio tracks, then audio flexibility is provided, but the stream structure becomes complex and data rate increases

Engineering Contradiction:
Improveaudio track selectionVSAvoidstream structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Multiple alternative audio representations are merged into a single elementary stream by combining mandatory audio data with replaceable audio data. This merging approach consolidates what would traditionally require multiple separate elementary streams into one unified stream, simplifying the overall stream structure and reducing complexity in the transport stream while still allowing receivers to select between different audio representations by replacing the replaceable audio data portion.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If conventional transport stream structure is maintained, then backwards compatibility is ensured, but flexibility for alternative audio representations is reduced

Engineering Contradiction:
Improvealternative audio representationVSAvoidbackwards compatibility
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The elementary stream structure is made dynamic by introducing replaceable audio data portions that can be selectively replaced with alternative audio representations. While the overall transport stream structure and mandatory audio data portions remain static and compatible with conventional systems, the replaceable portions allow for flexible substitution with alternative audio tracks. This dynamic approach enables enhanced functionality while preserving backwards compatibility, as receivers can operate with the mandatory audio data alone or enhance it by replacing the replaceable portions if supported.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11375252B2Audiovisual content item data streams
Publication Date: 2022.06.28 KONINKLIJKE PHILIPS NV
  • US11375252B2 patent drawing
  • US11375252B2 patent drawing
  • US11375252B2 patent drawing

AI summary

A transmitting apparatus generates an audiovisual content item data stream (e.g. transport stream) comprising a plurality of individual audiovisual data streams with audiovisual components for the content item. A generator (301-307) generates a first stream comprising both mandatory audio data and replaceable audio data for the audio representation where the replaceable audio data being data can be replaced by alternative audio data. A combiner (309) includes the resulting stream into the content item data stream. A receiving apparatus includes an extractor (403) which extracts the mandatory audio data from the received stream. A replacer (415) may replace the replaceable audio data by alternative audio data and an output (415) can generate an audio signal from the mandatory and alternative audio data. The approach may specifically provide an improved and more flexible data stream for audiovisual content.