Transitional Effect Encoding Using Decoder-Side Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Transitional effects in video coding present challenges due to limited inter-frame motion, leading to inefficient compression and poor visual quality when conventional predictive-based coding is used, as viewers are less sensitive to signal noise during scene changes.

Innovation Solution

Implementing specific encoding and decoding techniques that detect transitional effects and use interpolation methods similar to frame rate up-conversion (FRUC) to simulate these effects, reducing the need for full predictive frames and minimizing bandwidth and processing overhead, while allowing for improved data compression and visual quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If conventional predictive-based coding is used for transitional effects, then compression efficiency is maintained, but visual quality deteriorates due to signal noise during scene changes

Engineering Contradiction:
Improvecompression efficiencyVSAvoidvisual quality
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

Instead of applying predictive coding from the previous frame to generate the transitional effect, the patent inverts the approach by having the encoder detect transitional effects and signal them to the decoder, which then synthesizes the effect frames independently using the current and next frames. This reversal eliminates the accumulation of prediction errors that degrade visual quality while maintaining compression efficiency.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent introduces an intermediary mechanism: a transitional effect detector in the encoder that identifies when transitional effects occur and sends detection information to the decoder. This intermediary allows the decoder to switch from conventional predictive decoding to transitional effect synthesis mode, resolving the contradiction between maintaining compression and improving visual quality during transitions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If full predictive frames are encoded for transitional effects, then visual quality is maintained, but data transmission volume increases

Engineering Contradiction:
Improvevisual qualityVSAvoiddata transmission volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential information needed to reproduce transitional effects at the decoder side. Instead of transmitting full predictive frames, the encoder detects transitional effects and extracts minimal detection information (flags, parameters) that enable the decoder to synthesize the effect frames locally. This dramatically reduces data transmission volume while maintaining visual quality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses copying by transmitting references to existing frames (current and next frames) rather than encoding new predictive frames. The decoder copies pixel data from these reference frames and combines them to synthesize transitional effect frames, eliminating the need to transmit redundant predictive information while preserving visual quality.

Inventive Principle:
Principle #26Copying

3Loss of energy

If inter-frame compression is used for transitional effects, then compression ratio is improved, but detection precision of transitional effects becomes challenging

Engineering Contradiction:
Improvecompression ratioVSAvoiddetection precision
Core Design Contradiction:
Loss of energyVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by having the encoder perform transitional effect detection before encoding the actual frame data. The detector analyzes frame differences and identifies transitional effects in advance, allowing the system to prepare appropriate encoding parameters and detection information. This preliminary detection step ensures high precision in identifying transitions while maintaining efficient compression.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8239766B2Multimedia coding techniques for transitional effects
Publication Date: 2012.08.07 QUALCOMM INC
  • US8239766B2 patent drawing
  • US8239766B2 patent drawing
  • US8239766B2 patent drawing

AI summary

This disclosure is directed to techniques for encoding and decoding transitional effects, i.e., visual video effects that are used to transition from a current scene of a multimedia sequence. According to the disclosed techniques, an encoding device detects a transitional effect associated with a multimedia sequence during the encoding of the multimedia sequence, and transmits information as part of an encoded multimedia sequence to identify the transitional effect associated with the encoded multimedia sequence to a decoder. The information may comprise metadata that can be used by the decoder to simulate or re-create the transitional effect. The decoder simulates a transitional effect in response to the information.