Inline Codec Switching via Embedded Transition Signals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video and audio data processing systems face synchronization issues during codec switching, particularly during on-the-fly transitions, due to differences in processing blocks between video decoders and processors handling program-specific information.

Innovation Solution

Incorporating supplemental information within video and audio data to indicate transition points between different codecs, allowing decoders to anticipate and seamlessly switch between codecs in real-time, enabling efficient inline codec switching and splicing of locally-stored content into remotely-sourced content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional signaling methods (PMT/stream_type) are used to indicate video codec, then initialization and channel tuning are adequate, but on-the-fly codec switching causes synchronization issues between video decoder and processor

Engineering Contradiction:
Improvecodec switching capabilityVSAvoidsynchronization between video decoder and processor
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent embeds codec identification information directly within the encoded video data stream at the point where codec switching occurs. This preliminary embedding allows the processor to anticipate and prepare for codec changes before they happen, eliminating synchronization delays. The supplemental information is inserted in advance within the data stream itself, enabling the processor to retrieve and act on codec change notifications without waiting for separate PSI updates.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges the codec identification function into the video data stream by embedding supplemental information directly within the encoded video portions. This combines what were previously separate functions (video decoding and codec identification) into a unified process, allowing the processor to obtain codec information from the same data stream that the video decoder processes, thereby eliminating synchronization issues between separate processing blocks.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If separate codec versions are created for different formats, then codec compatibility is ensured, but system complexity and processing overhead increase

Engineering Contradiction:
Improvecodec compatibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic codec switching by embedding supplemental information that enables real-time transitions between different video codecs (e.g., MPEG-2, AVC, HEVC) within a single unified data stream. The system can adaptively change codecs based on content requirements without requiring separate pre-configured codec versions, reducing system complexity while maintaining versatility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent creates a universal data stream structure that can carry multiple codec types through embedded supplemental information. A single processing system can handle various video codecs by retrieving codec identification from the data stream itself, eliminating the need for multiple specialized processing paths and reducing overall system complexity while maintaining broad codec compatibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10554992B2Inline codec switching
Publication Date: 2020.02.04 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US10554992B2 patent drawing
  • US10554992B2 patent drawing
  • US10554992B2 patent drawing

AI summary

Techniques described herein are directed to the inline switching of video and/or audio codecs for video and/or audio data. A first device encodes data that includes portion(s) that are encoded using a first codec and portion(s) that are encoded using a second codec. The encoder may further encode supplemental information in the data. The supplemental information is used by the decoder to determine a transition between the first and second portion(s). The decoder can thus anticipate the transition and properly switch the codec used to decode the data in real-time. Techniques described herein are also directed to the splicing of locally-stored content into content received from a remotely-located source. For example, targeted advertisements that are stored locally may be played back during commercial breaks of live content. The locally-stored targeted advertisements may replace the commercials provided via the remotely-located source.