Artistic Intent Preservation in Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding systems often distort or eliminate artistic intent during compression, leading to a loss of intended color, object emphasis, and overall visual quality in encoded content.

Innovation Solution

The system identifies artistic intent positions and characteristics through signaling or content analysis, applying artistic intent preservation coding and processing to maintain these characteristics, allowing users to configure treatment of pixels or blocks for enhanced fidelity and error resilience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If video coding compression is applied to reduce storage and transmission bandwidth, then storage and transmission efficiency are improved, but artistic intent and visual quality are distorted or eliminated

Engineering Contradiction:
Improvestorage and transmission efficiencyVSAvoidartistic intent preservation
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies different coding strategies to different regions of the video content based on their artistic importance. Artistic intent positions are identified and marked, allowing the encoder to apply higher fidelity coding (lower QP values) to these specific regions while using standard compression for non-artistic regions. This local differentiation preserves artistic intent where it matters most while maintaining overall compression efficiency.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the video content into artistic intent positions and non-artistic positions based on analyzed characteristics. This segmentation allows the coding system to treat different segments differently - applying enhanced preservation coding to artistic segments while using standard compression for others, thus resolving the contradiction between overall compression efficiency and local quality preservation.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If standard video coding is applied to reduce bitrate, then transmission bandwidth is reduced, but error resilience and robustness deteriorate

Engineering Contradiction:
Improvetransmission bandwidthVSAvoiderror resilience
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent applies varying levels of error protection and coding robustness to different regions. Artistic intent positions receive enhanced error resilience and robustness treatment, while non-artistic regions use standard error protection. This allows the system to maintain acceptable reliability for critical content while reducing overall bandwidth consumption through selective protection.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11323722B2Artistic intent based video coding
Publication Date: 2022.05.03 INTERDIGITAL MADISON PATENT HLDG
  • US11323722B2 patent drawing
  • US11323722B2 patent drawing
  • US11323722B2 patent drawing

AI summary

Expressions of artistic intent are identified (e.g. by signaling or content analysis) and expressed as a set of artistic intent positions P.sub.ART and artistic intent characteristics C.sub.ART, Artistic intent characteristics C.sub.ART may be signaled and used to identify artistic intent positions P.sub.ART. Artistic intent preservation coding and processing may be applied to sample positions P.sub.ART to preserve characteristics C.sub.ART. A coding user interface may permit a user to specify an artistic set (e.g. P.sub.ART and/or C.sub.ART) and to select and/or configure treatment of pixels and/or blocks associated with an artistic set, such as a fidelity enhancement, QP adjustment value and/or postprocessing. Content priority or importance levels may be impliedly and/or expressly indicated at fine (e.g. pixel, sample) and/or coarse (e.g. block) levels of content for varying (e.g. enhanced, reduced) levels of treatment in content coding, delivery, processing and/or error resilience/robustness.