Predictive Random Access Picture Using Background Reference

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques face challenges in efficiently managing the large amounts of data required for high-quality video streaming, leading to increased storage and transmission burdens, and existing random access methods are limited in their ability to handle the complexity of video data effectively.

Innovation Solution

The introduction of a predictive random access picture that depends on a background picture, encoded using inter-prediction, allows for efficient management of bandwidth and storage by utilizing video analytics to generate background pictures which can be used as reference for encoding and decoding, enabling improved random access capabilities within the video bitstream and transport/application levels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional random access methods are used in video coding, then random access capability is maintained, but bandwidth and storage requirements increase significantly

Engineering Contradiction:
Improverandom access capabilityVSAvoidbandwidth and storage requirements
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The patent pre-generates background pictures from video sequences and stores them separately. During random access operations, these pre-computed background pictures are used as reference frames to predict and reconstruct random access pictures, eliminating the need to store and transmit multiple full-resolution reference frames. This preliminary preparation reduces bandwidth and storage while maintaining random access capability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces background pictures as an intermediary element between the video source and random access pictures. Instead of directly using previous random access pictures for prediction, the system uses these generated background pictures as intermediate reference frames. This intermediary approach allows more efficient prediction with reduced data transmission requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If high-quality video data is transmitted to meet consumer demands, then video quality is improved, but the burden on communication networks and storage devices increases

Engineering Contradiction:
Improvevideo qualityVSAvoidvideo data volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent extracts the background component from video sequences and separates it from foreground objects. By identifying and extracting background portions in each captured picture, the system creates a dedicated background picture that can be reused for multiple random access operations. This extraction reduces the amount of data that needs to be transmitted and stored while preserving video quality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the representation parameters of video data by using background pictures with potentially lower resolution or compressed formats since they serve as reference frames rather than final output. The background pictures can be encoded with different quality parameters compared to foreground content, optimizing the overall bit rate while maintaining perceived video quality.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10063861B2Methods and systems of performing predictive random access using a background picture
Publication Date: 2018.08.28 QUALCOMM INC
  • US10063861B2 patent drawing
  • US10063861B2 patent drawing
  • US10063861B2 patent drawing

AI summary

Techniques and systems are provided for performing predictive random access using a background picture. For example, a method of decoding video data includes obtaining an encoded video bitstream comprising a plurality of pictures. The plurality of pictures include a plurality of predictive random access pictures. A predictive random access picture is at least partially encoded using inter-prediction based on at least one background picture. The method further includes determining, for a time instance of the video bitstream, a predictive random access picture of the plurality of predictive random access pictures with a time stamp closest in time to the time instance. The method further includes determining a background picture associated with the predictive random access picture, and decoding at least a portion of the predictive random access picture using inter-prediction based on the background picture.