Audio Video Format Modification with Side Information

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge in audio-visual production and distribution is the need to adapt audio and video content formats to different devices with varying capabilities, leading to successive transformations that can result in noticeable artifacts, affecting user experience due to differences in dynamic range and coding costs.

Innovation Solution

A method and electronic device that modify audio and video content formats by applying up-conversions, down-conversions, mappings, or clipping operations, with associated side information to maintain quality and compatibility across devices, ensuring that format modifications are reversible and bijective, and preserving the original content's quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If successive format transformations are applied to adapt content to different devices, then compatibility across heterogeneous devices is improved, but content quality deteriorates due to artifacts

Engineering Contradiction:
Improvedevice compatibilityVSAvoidcontent quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by performing format transformations in advance during content production and distribution, rather than repeatedly at each device interface. The content is pre-adapted to various formats and stored with metadata indicating the applied transformations. This allows devices to receive pre-processed content in their required format without undergoing multiple successive transformations, thereby preserving quality while maintaining compatibility.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If larger dynamic range is used for signal representation, then content quality is improved, but storage and transmission bandwidth requirements increase

Engineering Contradiction:
Improvesignal qualityVSAvoiddata volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by allowing different portions of the content distribution system to use different dynamic ranges according to their specific requirements. The content can be stored and transmitted in high dynamic range formats where quality is paramount, while being adaptively transformed to lower dynamic ranges for devices with limited capabilities. This selective application of quality levels optimizes the balance between signal quality and data volume requirements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11678025B2Methods for processing audio and/or video contents and corresponding signal, devices, electronic assembly, system, computer readable program products and computer readable storage media
Publication Date: 2023.06.13 INTERDIGITAL VC HOLDINGS INC
  • US11678025B2 patent drawing
  • US11678025B2 patent drawing
  • US11678025B2 patent drawing

AI summary

The disclosure relates to a method including applying a first format modification to an audio and video input content in a first format to output a content complying with a second format, information about the first format modification being associated to the output content. The disclosure also relates to a method including obtaining an audio and video input content complying with an input format and information about a first format modification applied to the input content and determining a second format modification to apply to the input content by taking account of the first format modification. It also relates to corresponding signal, devices, electronic assembly, system, computer readable program products and storage media.