Video Stream Data Insertion Without Quality Degradation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Inserting additional data, such as watermarks, into a Moving Picture Expert Group (MPEG) bitstream can degrade picture quality and reduce coding efficiency due to repeated coding burdens in video codecs like HEVC, especially when additional data is inserted after coding is completed.

Innovation Solution

A method and apparatus that select a target picture in the bitstream for additional data insertion, transform and code a second picture that refers to the target picture using a lossless scheme, and generate a data sequence based on the modified target and second pictures, allowing the second picture to refer to the modified target picture, thereby minimizing additional coding of other pictures in the bitstream.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If additional data is inserted into a coded video stream, then copyright protection is achieved, but picture quality degrades and coding efficiency is reduced

Engineering Contradiction:
Improvecopyright protectionVSAvoidpicture quality
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent segments the video stream into different picture types (I pictures, P pictures, B pictures) and applies different processing strategies to each. I pictures containing additional data are identified and isolated, while P and B pictures that reference them are selectively re-encoded to maintain quality without re-encoding all pictures in the stream.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary identification of I pictures that contain inserted additional data before the decoding process. This allows the system to proactively determine which subsequent P and B pictures will be affected and prepare re-encoding operations in advance, preventing quality degradation before it occurs.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If additional data is inserted into a picture, then watermarking is achieved, but repeated coding burden increases

Engineering Contradiction:
Improvewatermark insertionVSAvoidcoding efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements a feedback mechanism where the system monitors the video stream to identify I pictures containing additional data. Based on this feedback, it dynamically determines which P and B pictures require re-encoding and adjusts the coding process accordingly, avoiding unnecessary re-encoding of pictures that don't reference the watermarked I pictures.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Instead of re-encoding all pictures in the stream (excessive action), the patent applies re-encoding only to the minimal necessary subset of P and B pictures that directly or indirectly reference the watermarked I pictures (partial action), thereby maintaining coding efficiency while ensuring quality.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If pictures referencing the watermarked picture are re-encoded, then picture quality is maintained, but coding complexity increases

Engineering Contradiction:
Improvepicture qualityVSAvoidcoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality management by treating different pictures differently based on their reference relationships. Only P and B pictures that reference watermarked I pictures are re-encoded with full quality, while other pictures maintain their original encoding. This localized approach maintains overall picture quality without uniformly increasing coding complexity across the entire stream.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10757433B2Method and apparatus for inserting additional data into video stream without degrading picture quality
Publication Date: 2020.08.25 MARKANY
  • US10757433B2 patent drawing
  • US10757433B2 patent drawing
  • US10757433B2 patent drawing

AI summary

A method of inserting additional data into a moving image stream, according to some embodiments of the present invention, includes receiving a first coded bitstream, electing a first picture PA into which additional data is to be inserted from the first coded bitstream, generating a first picture PA′ by inserting the additional data into the selected first picture PA, selecting a second picture PB directly referring to the first picture PA, generating a second picture PB′ by transforming and coding the selected second picture PB in a manner that decoding the second picture PB′ obtains the second picture PB with reference to the first picture PA′ and generating a data sequence based on the first picture PA′ and the second picture PB.